Home
About me
Advertise
Sitemap
Wordpress SEO
Contact
Hire me
SEO jargon busters
RSS feeds
Daily SEO Blog
Aug
20

How to get rid of crawl errors created due to language translation plugins (or 404 errors)

Last day, a blogger was seeking help with a problem he encountered on Google Webmasters. He was using a language translation plugin that automatically translated pages in his website to various different languages. Don’t want to name the plugin here, but I know that it used the Google translator / Babelfish translator service. Now the problem appeared when a lot of these translated URLS started showing up as “page not found” on the Google webmasters console.

I’m assuming that lot of these URLs weren’t approachable because the translation service wasn’t reliable and it would block any automations (which the plugin was using). The plugin clearly is creating some problems here, automatically generating URLs that aren’t really reachable.

Now, there is nothing to panic here as Google webmaster tools normally pick up every feeble 404 signal and just so that the webmaster is aware, shows them on the Webmaster console. These URL’s can be later spidered by Google, and works fine when the translation service is active. But normally, when you have lots of pages to translate, there might be a problem.

So how to fix this problem of large number of 404 errors?

Solution 1 – If you have limited number of URLs

You could manually delete them off your site / turn off the plugin.

Solution 2 – 301 Redirects

You could also issue a 301 redirects to the original URL (without the translation parameters)

Solution 3 – If there are large number of URLS

i) Find out the pattern in the URLs – For instance, for arabic translation the plugin would be using something like – http://www.dailyseoblog.com/ar/originalurl (ar for Arabic)

With this, issue a command on the Robots.txt file to block scanning all those URLs in the same format.

Example : This command will block all crawling towards the directory “ar” and urls – dailyseoblog.com/ar~

 

User-agent: *

Disallow: /ar/

 

Sometimes, if your translated pages URL structure is complicated, it could run to problems, but generally this is a good solution.

Solution 4 – Google URL removal tool

If none of these methods successfully works, you have Google to your rescue.

Go to the Google Removal Tool and suggest the URLs you’d like to get removed from the index.

404-url-removal

In this case, you can’t suggest mass removal, so you might want to do this in parts by downloading the entire 404 error list from the Google Webmasters console, and pasting them to the removal tool suggestions. I’d really suggest this tool for fine tunings and not mass removals though.

Hope it helped.

SEO SpyGlass Recommended SEO software:
SEO SpyGlass enables you to secretly (and ethically) spy on your competition and see exactly why they rank better than you. Just launch SEO SpyGlass, and in a matter of minutes you will know everything humanly possible about why any site ranks well.
Try it today!

Category: SEO Quicktips | Author: Mani Karthik
SEO Wordpress Themes
  1. JavsNo Gravatar

    Thanks for the post,Mani. This information may help the webmasters to know about the site pages and avoid the creation of orphan pages in their domain which reduces the site’s credibility.

    Reply

  2. ronnypassarge (ronnypassarge)No Gravatar

    How to get rid of crawl errors created due to language translation … http://tinyurl.com/mntas3

    Reply

  3. BaderNo Gravatar

    Thanks for this useful way , seems that google crawler based ” I WANT IT ALL ” style lol

    Reply





Click to cancel reply

  • SEO blog Recommends

    Free Personal Budgeting Software
  • Subscribe to SEO Blog

    Enter your email address:

  • Recommended Softwares


    Rank Tracker Website Auditor
  • SEO Blogging tips

    • How to submit a sitemap for Yahoo!
    • 5 SEO Mistakes I Learned from as an Online Marketer !
    • How to get Google SiteLinks and control them
    • SEO practices to avoid - SEO Tips
    • How to submit a website to Google
    • Top traffic generating keywords
    • What is SEO or Search Engine Optimization
    • Quick Search Engine Optimization for your images
    • Google Ranks are not about Page Rank or Site Age-The BloggingTips.com example
    • SEO quotient review - Stephan Miller
  • Recent SEO blog posts

    • Yahoo adds New Search Features to enhance your search experience
    • New One Line Google Text Ads spotted on Digg
    • Backlink Anchor – Keyword Ratio Match – New Golden rule of SEO ?
    • Cheap SEO is not always the best SEO – Cheap is what it is !
    • Top 35 News Sources on Twitter you should follow : Keep updated with the latest news
    • Does links on the same page have equal importance on Google?
    • How to get rid of crawl errors created due to language translation plugins (or 404 errors)
    • 9 Tips to build credibility & trust on your blog
    • Yahoo BOSS’s Vik Singh among top 35 Young Innovators of 2009
    • 5 Humble Reasons why I think Bing is actually better than Google !
    • Find your Twitter personality – Try the new Yahoo Mojo
    • 5 Cool SEO iPhone Apps for checking SEO stats and reports
    • 10 Cool Twitter Custom Button Generators & Badges
    • 5 SEO Mistakes I Learned from as an Online Marketer !
    • Twitter is for ? The Google suggest way
  • Active users @ SEO Blog

    • Nihar
    • darrenmonroe (Darren S...
    • Jacques Snyman | Web D...
    • Javs
    • Nihar
  • Tags @ Daily SEO Blog

    ads adsense backlinks blog blogger Blogging blogosphere blogs categories check crawler crawling crowd Excel google image images indexing india indian instances internet javascript keywords links pages rank robots search engine optimization seo tips serps sitemap submit tags templates theme themes upload video wordpress Wordpress SEO wordpress seo wordpress tips yahoo youtube
  • Popular at Daily SEO blog

    • 10 Twitter tools to effectively manage your followers (104)
    • How to get indexed by Google in 48 hours (94)
    • How to get free backlinks (69)
    • Free SEO Wordpress theme – SEO Blog (69)
    • 9 Twitter Tips that will help you gain respect in the Twitterverse (Like @Zaibatsu) (63)
    • 25 SEO Gurus you should follow on Twitter (51)
    • The 50 Most Influential & Top Twitter Users in India (51)
    • New Wordpress theme - "SEO Green" from DailySEOblog (50)
    • Ultimate list of Dofollow Social Bookmarking sites (47)
    • SEO for Wordpress - A quick guide (45)
  • Blogger Podcasts

    Monika Mundell - Blogger(thewritersmanifesto.com) Daniel Scocco - Blogger (Dailyblogtips.com)
  • Social Media Profiles

Basic SEO Tips

  • Change the way your site appears on Google SERPs
  • Control Google's crawl frequency to your site
  • How does Google see your site?
  • Importance of footer text in SEO
  • Optimizing header images
  • SEO tips for MSN search engine
  • Optimizing blog titles for Google
  • SEO friendly layout
  • What is an SEO friendly site structure?
  • Importance of keywords - SEO Tips
  • Anchor text importance - SEO Tip
  • SEO Tips for blogs and bloggers
  • Absolute links or relative links is good for SEO?
  • Important SEO tips for wordpress

SEO Tips for blogs

  • 24 Must have SEO plugins for Wordpress
  • SEO Tips - Copy writing guide
  • How to get quality backlinks?
  • Social media and link building tips
  • SEO Tips - Landing page Optimization
  • How to increase traffic to your blog?
  • How to increase your Page Rank?
  • Image optimization tips for blogs
  • 7 steps to your blog's SEO
  • How and where to find incoming links?
  • SEO tips for Google
  • SEO metrics to track
  • How to build a sitemap for blogger
  • How to get Google sitelinks?
  • Find out when Google indexed you
Mani Karthik Hi, I'm Mani Karthik, Pro Blogger & SEO Consultant from India. I blog, I Tweet, help websites with SEO. Loves working from home office. Quit my day job as SEO consultant 4 years ago, to pursue full time blogging and consultation. Living the dream now.
>> More about me


© 2009 DailySEOblog.com Privacy policy SEO jobs