Thursday, January 27, 2005

Become Crawler Info For Webmasters

A few days ago I told you about the new Become shopping search engine and gave you a glimpse at what you can expect from it. Michael wanted me to clarify one point from that post. I said that there is a way to guarantee your site is crawled by the Become crawler/spider. But it needs a bit of clarification.

Currently, Become has no plans to offer a 'submit your site here' form and the only way to guarantee your site is listed in the Become index is to be linked to from another site the BecomeBot has already crawled. Since they'll be launching the engine with approximately 2.5 billion pages in their index, that should make it pretty easy to ensure your site is crawled by the BecomeBot. It's also important to note that the mere fact the BecomeBot has spidered your site doesn't mean you'll be listed in their index. Once their crawler fetches your site the indexer determines whether or not your site is shopping related, if it's not then it will not make it into the search results. More information can be found at their webmasters page.

I hope that clarifies things a bit. Let me know if and of you have any questions.

Posted By Jason Dowdell at 11:21 AM
Permanent Link: Become Crawler Info For Webmasters | Comments (0)

Post a Comment

Name:
Email:
WebSite:
Comment:
Remember Me
Subscribe