Joeychgo
04-20-2006, 09:51 AM
Speaking at PubCon in Boston, Matt Cutts has confirmed one of the infrastructure changes for BigDaddy
"Matt Cutts confirmed today that the AdSense mediapartners bot (aka mediabot) is indexing pages for use in the Big Daddy Google index."
Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy.
Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.
As commented on by Danny Sullivan, widely considered the worlds foremost authority on SEO:
Pages with AdSense will not be indexed more frequently. It's literally just a crawl cache, so if e.g. our news crawl fetched a page and then Googlebot wanted the same page, we’d retrieve the page from the crawl cache. But there's no boost at all in rankings if you're in AdSense or Google News. You don’t get any more pages crawled either.
In other words, there are two big issues with the AdSense crawler helping Googlebot:
Since the AdSense crawler swoops in fast, it could be a way for people to effectively get fast inclusion of their pages. Just add AdSense, wait for the AdSense bot to fly in, and you're set.
Is having the AdSense crawler likely to get you a RANKING boost, in addition to getting INDEXED faster. I've capitalized both words to stress them, as a reminder that being in the index isn't the same as ranking well for a query.Matt's saying that no to both cases. There is no ranking boost. As for fast indexing, no to that as well. The AdSense bot is simply refreshing the cached copy of your page -- but the copy in the index, what people are searching on, won't be updated.
"Matt Cutts confirmed today that the AdSense mediapartners bot (aka mediabot) is indexing pages for use in the Big Daddy Google index."
Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy.
Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.
As commented on by Danny Sullivan, widely considered the worlds foremost authority on SEO:
Pages with AdSense will not be indexed more frequently. It's literally just a crawl cache, so if e.g. our news crawl fetched a page and then Googlebot wanted the same page, we’d retrieve the page from the crawl cache. But there's no boost at all in rankings if you're in AdSense or Google News. You don’t get any more pages crawled either.
In other words, there are two big issues with the AdSense crawler helping Googlebot:
Since the AdSense crawler swoops in fast, it could be a way for people to effectively get fast inclusion of their pages. Just add AdSense, wait for the AdSense bot to fly in, and you're set.
Is having the AdSense crawler likely to get you a RANKING boost, in addition to getting INDEXED faster. I've capitalized both words to stress them, as a reminder that being in the index isn't the same as ranking well for a query.Matt's saying that no to both cases. There is no ranking boost. As for fast indexing, no to that as well. The AdSense bot is simply refreshing the cached copy of your page -- but the copy in the index, what people are searching on, won't be updated.

