Skip to the main content

Free and open source since 2005, running on your own server

CrawlTrack Webmaster dashboard

Technical data

For those who want to understand how CrawlTrack works, and possibly modify it, here are the two structures that matter: the files on disk and the tables in the database.

File tree

The archive contains the main CrawlTrack folder with its include, language, graphs and cache directories. Two files are created during installation: crawltrack.php at the root and configconnect.php in the include folder.

crawltrack/ cache/ graphs/ artichow/ font/ include/ configconnect.php language/ english.php french.php german.php spanish.php turkish.php dutch.php crawltrack.php index.php

The language folder holds one file per language. The font folder receives the simsun file when Russian graphs are needed. The cache folder must be writable by the web server.

Database structure

Configuration data is stored in the database since version 1.5.0, which greatly improves compatibility with hosting providers because there are fewer permission problems. Statistics tables are written by the tag and read by the dashboard.

The tools page gives the list of CrawlTrack tables, the number of records for each table and the size of the database. That page is the quickest way to see whether a table is growing as expected after a new site is added.

Before modifying any file, copy the installation folder. A modification made for one release will usually need to be repeated after the next update.

Developer references

Sources and further reading, all outside this site. They open in a new context and are listed for reference only.