Search Engine Optimization

Archive for - November 9, 2009

Ensuring Your Pages are Spidered

You may find that some of your pages are missing from the search engine results. In order to find if the page is missing from the index:

  • Take page URL and search for it
  • Take a snippet of the text from the page, put it into quotation marks and search for it. (this is also a great way to check for duplicate content).
  • Go to Google, type site:www.yourdomain.com and see which pages show up. You can do the same with Yahoo using Yahoo site explorer, but Yahoo days are numbered.

In my first web project I’ve worked hard to create high quality content, then put it all together as a website. My mistake was making too many directories, up to 5 levels deep, and not linking them well. The result was that Google did not crawl deep pages, so the pages never had a chance of ranking, even though pages were of very high quality. It still bogs in my mind, why wouldn’t Google crawl those pages? Though located deep within the site, they have links from different categories. Doesn’t it make sense for Google to crawl as many pages as possible, no matter how deep? I guess I shouldn’t complain because it creates work for SEOs.

Once you discover pages that have not been crawled and indexed you can:

  • Submit pages to search engines
  • Link to them from outside sites.

Comments Back to Top Back to Homepage

Blog Post Separator