Online marketing information can change quickly This article is 10 years and 235 days old, and the facts and opinions contained in it may be out of date.
Getting a site indexed correctly is a critical aspect to good search rankings. It never ceases to amaze me how many sites have less than half of their unique content indexed by the engines. I guess it surprises the SE’s as well, because their index seem to be getting much bigger lately, and they are making definite strides to improve on how well dynamic sites are spidered.
Creating a sitemap has always been a valuable technique towards getting a site indexed properly, and with recent developments from Google sitemaps and Yahoo’s site explorer (*coming soon) it is even more important to use the tools at your disposal for getting your site more effectively indexed.
Search Engine Sitemap Tools
Google Sitemap Tools
Standalone / downloadable sitemap generators
- GWebCrawler from Trytobreak
- Sitemap URL filter tool
- Endsheet sitemap generator
- Google Code recommended sitemap tools
Online sitemap generators
Audit my PC Online Sitemap Generator **recommended – up to 50k urls
- XML Sitemaps Online Generator – up to **recommended – up to 500 urls
- Blocklayer generator
- Blocklayer sitemap editor
- Java sitemaps tool
For websites that update often, the suggested methodology is to find a script that runs off your webserver. The script should batch process on a nightly, weekly, or monthly basis and ping Google sitemaps with the appropriate changes. The scope of installing a script like this is beyond the patience of the author, but if you have a good programmer or web developer they should be able to pull it off fairly easily. Below are a few potential scripts to check out.
Sitemap Webserver Scripts
- WordPress sitemap creator
- WordPress Plugin sitemap creator
- A bunch more available via Code.google.com
General Sitemap Tool / Link Checker
Sitemap Submission Resources
- Yahoo Site Explorer (coming soon)
- Google Sitemaps
- Yahoo .txt file sitemap submission
- Website spidering tools
- Everything you need to know about Google sitemaps
- DigitalPoint Sitemap Discussion
- WMW discussions
- SEW Discussions
If you’ve had an exceptional experience with a sitemap generator or script, please let me know so I can add it to the list.
Please note…not all software has been tested, and there is no guarantees that downloadable software does not have spyware attached to it. If you know of any of the programs that are attaching anything sketchy upon installation, please let me know so I can remove them from the list.