Google's robots.txt lets Googlebot into mobile movies
John Campbell noticed a m.google.com result in a standard Google web search. Eagle eyes make for good SEO.
It's just a quick check to confirm that John's right and to narrow down where Googlebot has started to pick these mobile search results from. There's a way into Google's mobile movie results. The big deal, by the way, is that Google tries very hard not to include search results in search results.
It's also easy enough to spot the hole that Googlebot has crawled through. It looks like the robots.txt file on m.google.com is set up to block /movies?. Perhaps these results where on that URL structure at the past but the robots.txt doesn't block the current pattern.
It's just a quick check to confirm that John's right and to narrow down where Googlebot has started to pick these mobile search results from. There's a way into Google's mobile movie results. The big deal, by the way, is that Google tries very hard not to include search results in search results.
It's also easy enough to spot the hole that Googlebot has crawled through. It looks like the robots.txt file on m.google.com is set up to block /movies?. Perhaps these results where on that URL structure at the past but the robots.txt doesn't block the current pattern.
