Create a test crawler
Go to the CrawlTrack tools page and click on the link named Create a test crawler, then follow the instructions. The script registers a test user agent, gives you the address to visit and then shows whether the visit was recorded.
Open the tools page
The wrench icon in the main menu leads to the tools page, which holds the tag, the crawler list update and the test crawler.
Request the test visit
Visit the address shown, using the test user agent. If the visit appears in the crawler list within a few minutes, the tag is present and the database is writable.
Read the result
If the visit does not appear, the tag is missing on the page you visited, the page is cached by another layer, or the database credentials are wrong.
Still empty after a test? Work through the troubleshooting page, starting with the write permission on the cache folder.
Test tool references
Sources and further reading, all outside this site. They open in a new context and are listed for reference only.
- User agent definition what the test crawler imitates
- HTTP status codes reading the responses during a test
- HTTP 200 OK a successful hit
- Robots exclusion standard how crawlers are told what to do
- Verifying Googlebot checking a claimed crawler
- Bing webmaster tools Microsoft side verification
- PHP error reporting seeing failures