Comments on: WordPress Blog Not Indexed by Google

By: Dan

Dan — Fri, 08 Jul 2011 21:16:50 +0000

Hi Dan,

It honestly does not appear that you have done anything terribly wrong here, but I would fix as many of the validation errors as possible. I am assuming you meant robots.txt not robot.txt as the latter is not correct.

You mention “crossposted” content. I’m not sure what you are trying to accomplish or mean by this, but Google will definitely penalize you for duplicate content. I don’t know how weighted this would be across sites like in your case.

If you block search engines from indexing your wp-content folder, your image uploads will be omitted. I can see where this might penalize you if a spider goes looking for something and then stops because of this. You might try opening up all restrictions in robots.txt or temporarily renaming it to see if therein lies the problem…

Did you create/upload a Google site map (XML format)? In case you weren’t aware, there is a great plugin for WordPress that does just this – automatically. It’s called Google XML Sitemaps and the link is here.

I wouldn’t be surprised to find that changing and updating your permalinks causes Google to lose its index of you. It may just take some plain old-fashioned time.

Judging by your site’s html source code, you have a Google Webmaster Tools validation META tag in there. I would look closely at the Google Webmaster Tools info…

Also, it would be great to know what you find out on this and post it to share with others…

-Dan

By: Dan

Dan — Fri, 08 Jul 2011 11:02:04 +0000

Hi Dan,

My recently new wordpress site is not indexing correctly. Im not sure if this is because I have recently changed the permalink format and Google needs time to recrawl it (I have submitted both the main site page and blog URLS), or if it is related to my SEO ultimate setup or errors in the site.

Submitting the site to the validator gave 25 errors. This surprised me as I purchased the theme. However, a lot of these look fairly harmless..
http://validator.w3.org/check?uri=http%3A%2F%2Fwww.deviouscreations.co.uk&charset=%28detect+automatically%29&doctype=Inline&group=0

I have also set up my robot.txt file using SEO Ultimate’s File Editor override as:

User-agent: *
Allow: /
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content
Disallow: /t/

User-agent: Mediapartners-Google
Allow: /

User-agent: Adsbot-Google
Allow: /

User-agent: Googlebot-Image
Allow: /

User-agent: Googlebot-Mobile
Allow: /

However, my new posts never show up. Instead, the same posts that are crossposted to my live journal show up instead! So you get the cross posts, not the originals.

What have I done wrong??

By: Dan

Dan — Fri, 01 Jul 2011 01:09:27 +0000

My pleasure, Rick. Hope you find some good information to help with this…

By: Rick

Rick — Thu, 30 Jun 2011 18:43:12 +0000

Hi Dan,

Thank you so much for taking the time to look at my blog. I will look into the errors that you pointed out.

Thanks again!

Rick

By: Dan

Dan — Thu, 30 Jun 2011 04:43:00 +0000

Hi Rick, You site does appear to be indexed in Google, just not very well. I checked your site with the W3C Markup Validation Service, and there were several errors found. Here is a link to the validator results. There are some things such as DOCTYPE that you'll want to fix. Using the Google "link: " backlink checker revealed an indexed yet broken link to the blog's home page:

Parse error: syntax error, unexpected ';' in /home/content/w/e/b ...
www.stacyvencill.com/blog/ - Cached
Parse error: syntax error, unexpected ';' in /home/content/w/e/b/webmastersav/html/blog/index.php on line 6.

It appears that this error no longer exists. You also have a reference to a missing XML Namespace facebook.com identifier in your html opening tag:

I would recommend trying to re-submit your site to Google manually, and for a reason tell them that it was previously broken. I would also sign up for and add your site to a Google Webmaster Tools account. This will give you great insight into what Google actually sees when trying to index your site, along with any errors encountered. It is a good idea to get some other sites to link to yours as it will help your link popularity. You might also consider that the drugs mentioned on this site are likely included in the keyword list of online pharmaceutical spammers. Hopefully you find this useful, Dan

By: Rick

Rick — Wed, 29 Jun 2011 21:05:27 +0000

Hi Dan, I know this is an old thread but I’m really hoping you can help me out. I’m not sure what is going on with my blog. http://www.stacyvencill.com/blog . It’s been up for a few weeks, I’ve added a sitemap via Google, but still having issues. Any you help you can provide would be greatly appreciated. Cheers!

By: Dan

Dan — Wed, 17 Nov 2010 10:09:07 +0000

@ online freesite: I'm not sure if this is the case, but something that comes to mind is that if you purchase a pre-existing domain name, you are purchasing the history of this domain name as well, good or bad. If any owner(s) abused basic SEO guidelines, such as keyword padding, allowing spam comments, linking to questionable sites, etc., it could take a little while to rectify. Again, I don't know if this is relevant in your case(s). I would suggest fixing any HTML code errors that show up using the W3C Markup Validation Service. Modern web browsers are pretty good at "fixing" broken code for display, but the Google (and other search engine) spider programs are very literal and could stop processing a page when they come to any simple formatting or code issues. Google offers a manual web site submission form that has a comment field at Add your URL to Google. If you haven't used this tool already, I you might try it... Hope this helps, Dan

By: online freesite

online freesite — Thu, 04 Nov 2010 05:57:46 +0000

I have a new site that I have been trying to get indexed for the past 2 weeks. I have tried almost everything and nothing is working. Usually my new sites are indexed within hours so this is very frustrating.