Why you need CrawlProtect
You are careful. You update the scripts you use, you choose sophisticated passwords, the computer you upload from has a current antivirus, and you never transfer files by FTP from a public computer. In short, you apply the common sense rules that avoid most hacking.
CrawlProtect goes further by blocking:
- some code injection attempts
- some SQL injection attempts
- some visits coming from crawlers known as badbots, the crawlers used by hackers
- some website copiers
- some shell command execution attempts
As with every protection system, CrawlProtect cannot guarantee that your website will never be hacked, but it is one more wall that attackers have to pass.
The risks linked to a hacking
Hacking of your site may have consequences that are more or less dramatic. The attacker can simply replace your homepage with a page claiming the exploit. The danger is that he has found a way into your site, and nothing says he will not do more damage next time.
He can erase all your data, including in the most severe cases your databases. There are also more pernicious hacks, undetectable at first but far more dangerous for your visitors and for you. The attacker can add malicious scripts to your pages which retrieve the data entered by your visitors, or inject a virus on their computer. He can also add pages that serve as a trap for phishing, and in that last case your criminal liability may be incurred.
How CrawlProtect protects you
CrawlProtect acts at two levels. First, with the htaccess file, which analyses the incoming requests on your site and immediately blocks those recognised as hacking attempts: script injection, SQL query injection, queries made by robots known as badbots, and so on.
The second level of protection depends on you. CrawlProtect offers an easy way to change the permissions of your files and folders to the most appropriate level in a few clicks.
A short explanation about permissions
The chmod command changes the access rights on files and folders. It is a Unix command that does not exist on Windows, and by extension the term describes the permissions of a file or directory. The value associated with a permission is mostly given as a three digit number.
- The first digit describes the rights of the owner of the file
- The second digit describes the rights of the group of the owner
- The third digit covers all the other users
- 0 means no right
- 4 means right to read
- 5 means right to read and execute
- 6 means right to read and write
- 7 means right to read, write and execute
You realise immediately that if your directories are at 777, everyone has the right to read, execute and especially to write them. Leaving your door wide open and hoping nobody will rob you is not a plan. CrawlProtect proposes 555 for your folders, so nobody, not even you, has the right to write in them and so to add any malicious script. You switch back to 755, where you alone can write, to make a modification on your site. It may be somewhat restrictive, but not that much given the ease of use of CrawlProtect.
For your files the principle is the same: CrawlProtect proposes 444, and you switch to 644 to make a modification. These levels give attackers a hard time, and there is a good chance they will look for an easier target.
Support CrawlProtect
If you like CrawlProtect, you can take part in its development in different ways.
- Speak about CrawlProtect around you, on your websites and blogs.
- Add a link to the CrawlProtect page on your website, using the badge below. The title can be: Website protected by CrawlProtect.
- Use CrawlProtect as a channel to present your products and services; all the information needed is on this site.
![]()
You can copy this badge to your own server and display it from there.
Contact and support
The site protection script CrawlProtect is developed by Jean Denis Brun. The support forum is the fastest way to reach the team, and the documentation covers installation, updates and the usual errors.
Thanks
Enycu, who regularly posts on the OVH forum and who is at the origin of most of the rules used in the CrawlProtect htaccess file.
Protection references
Sources and further reading outside this site. They are listed for reference and open in a new context.
- OWASP Top Ten the risks the script targets
- Apache htaccess guide the file CrawlProtect writes
- Chmod and file permissions the numbers explained above
- OVH community forum where the first rules were discussed
- Apache mod rewrite the htaccess rules
- Mod security a server level companion
- Suhosin hardened php
- OWASP file permissions attack categories
- Let's Encrypt serve the site over https
- CrawlTrack forum CrawlProtect support board