Google gives up – Figures out how to crawl AJAX based sites !

Once upon a time AJAX was taboo, or many feared to use it because Google couldn’t figure out what it was all about (at least in the code). But AJAX got popular. AJAX is here to stay. Now Google gives up, finds new ways to get around knowing AJAX better.

Google has now proposed a new standard for making AJAX based websites crawlable.

In Google’s words -

This will benefit webmasters and users by making content from rich and interactive AJAX-based websites universally accessible through search results on any search engine that chooses to take part. We believe that making this content available for crawling and indexing could significantly improve the web.

Some of the goals that will be achieved with this proposal.

• Minimal changes are required as the AJAX website grows
• Users and search engines see the same content (no cloaking)
• Search engines can send users directly to the AJAX URL (not to a static copy)
• Site owners have a way of verifying that their AJAX website is rendered correctly and thus that the crawler has access to all the content

And, here’s how Google think webmasters should build their content, so as to allow effective web crawling of their pages.

1. Slightly modify the URL fragments for stateful AJAX pages

2. Use a headless browser that outputs an HTML snapshot on your web server

3. Allow search engine crawlers to access these URLs by escaping the state

4. Show the original URL to users in the search results

And, here’s a whole document on making your AJAX websites crawlable.

More details here on making AJAX crawlable

Possibly related SEO & Social Media Articles

• Plugin to display content based on Search Engine Query
  If your traffic source is more of search engine referrals and if there’s a high bounce rate, that should ring bells at the dashboard. Shouldn’t it ? Well, it just means that many people who come to your blog through search engines looking for something is not actually finding it – and are disappointed. So, [...]...
• Get the Google Search Engine Optimization Guide
  No, this is not an E-Book from me but the folks at Google Webmasters themselves! Google Webmasters team have (finally) released an E-Book called the “Search Engine Optimization Guide” for webmasters that covers all the basics on what Search Engine Optimization is and what webmasters can do to make their websites better in terms of search [...]...
• How to get Google SiteLinks and control them
  Sitelinks are more common these days. Popular blogs and websites have been awarded Google sitelinks recently. Google’s explanation is that this is a completely automated phenomena and there’s nothing one can do do help the sitelinks appear for his/her site on the Googel SERPs. Daily SEO blog has a sitelink and there are some random links [...]...
• Submit a single sitemap to all your sites on Google webmasters
  Google today announced that webmasters could submit their Sitemaps for multiple hosts on a single dedicated host. So let’s say that you own www.example.com and mysite.google.com and you have Sitemaps for both hosts, e.g. sitemap-example.xml and sitemap-mysite.xml. Until today, you would have to store each Sitemap on its respective host. If you tried to place sitemap-mysite.xml [...]...
• Remove other sites from the Google search results
  Google has a new option for webmasters – that enables us to remove a particular information on a website from it’s search results. Vanessa Fox today released the Webpage removal tool that will enable users to delete off indexed pages from your site on Google’s index and also information/pages on other sites. The latter [...]...