Bot-Trap V1.00
Asked Modified Viewed 5,690 times
asked
Bot-Trap V1.00
About Bot-Trap: The Bot-Trap is a simple infusion that catches bots that ignore the robots.txt, and site rippers who don't read the robots.txt.
What Happens: When a bad bot go's to the robots.txt file and ignores the file's directives telling it not to go to /infusions/bottrap/badbots.php, the Bot-Trap catches it and posts the ip and User agent to the Bot-Trap blacklist DB banning it access to the PHPFusion site.
When the Bot-Trap catches a bad bot the Bot-Trap Agent will come online and sends a PM with the info (IP, User agent) to the site super administrator and also to the site email address (options below).
The Bot-Trap is also useful if a ripper visits the site and starts to download everything it can find. It will quickly stumble upon one of the /infusions/bottrap/badbots.php bait links placed around the site, Once visiting /infusions/bottrap/badbots.php, it will be unable to download any more stuff as it will be blacklisted. Once the bot or ripper discovers it is locked out, it may thrash about a bit, trying to retrieve any largish files it may have an url for, but of course it will just be redirected somewhere else and nothing else, and will quickly move on.
Use with care to make sure you don't lock out visitors that you do want, or even worse don't lock your self out.
If you do lock your self out of your own site and have a dynamic IP Address you can simply restart/reset your router this will give you a new IP Address and you can then access your site again and remove the other IP from the Bot-Trap blacklist.
If you do not have a Dynamic IP Address you will need to go into your Database and look in the DB_BOTTRAP for your IP and remove it manually.
No Guarantees: While the Bot-Trap will trap bad bots that do not obey the robots.txt it is not a solution to completely stop Spam on your site but it does help.
The Bot-Trap has been used on PHPFusion Mods UK for almost 1 year and has trapped 177 Bad Bots.
It does what it's is meant to do it traps them bots who do not obey robots.txt
!BEFORE INSTALLING PLEASE READ THE README_EN.html CAREFULLY!
*Registration/login required
About Bot-Trap: The Bot-Trap is a simple infusion that catches bots that ignore the robots.txt, and site rippers who don't read the robots.txt.
What Happens: When a bad bot go's to the robots.txt file and ignores the file's directives telling it not to go to /infusions/bottrap/badbots.php, the Bot-Trap catches it and posts the ip and User agent to the Bot-Trap blacklist DB banning it access to the PHPFusion site.
When the Bot-Trap catches a bad bot the Bot-Trap Agent will come online and sends a PM with the info (IP, User agent) to the site super administrator and also to the site email address (options below).
The Bot-Trap is also useful if a ripper visits the site and starts to download everything it can find. It will quickly stumble upon one of the /infusions/bottrap/badbots.php bait links placed around the site, Once visiting /infusions/bottrap/badbots.php, it will be unable to download any more stuff as it will be blacklisted. Once the bot or ripper discovers it is locked out, it may thrash about a bit, trying to retrieve any largish files it may have an url for, but of course it will just be redirected somewhere else and nothing else, and will quickly move on.
Use with care to make sure you don't lock out visitors that you do want, or even worse don't lock your self out.
If you do lock your self out of your own site and have a dynamic IP Address you can simply restart/reset your router this will give you a new IP Address and you can then access your site again and remove the other IP from the Bot-Trap blacklist.
If you do not have a Dynamic IP Address you will need to go into your Database and look in the DB_BOTTRAP for your IP and remove it manually.
No Guarantees: While the Bot-Trap will trap bad bots that do not obey the robots.txt it is not a solution to completely stop Spam on your site but it does help.
The Bot-Trap has been used on PHPFusion Mods UK for almost 1 year and has trapped 177 Bad Bots.
It does what it's is meant to do it traps them bots who do not obey robots.txt
!BEFORE INSTALLING PLEASE READ THE README_EN.html CAREFULLY!
[Download]*
*Registration/login required
Nice, and very good. Thanks Craig!
answered
anti-social bad bot, lol
answered
Quote
KasteR wrote:
Nice, and very good. Thanks Craig!
Hi Kaster,
Your welcome!
Kind Regards Craig
Quote
PolarFox wrote:
anti-social bad bot, lol
Hi Polarfox,
Haha! yes they are ill behaved anti social bots. Pfft!! :P
We Scottish HATE BOTS! :P
Kind Regards
Craig
answered
I'm not sure but this bot blocked ip '66.249.76.148' on my site. WHOIS said it's google bot. That's not so good to block it?
answered
If one is interested in Google page rank and such stuff, no, then that should probably not be blocked.
Maybe you are able to prevent blocking of some "bots"?
You can have it exclude certain IP's from what I read.
Maybe you are able to prevent blocking of some "bots"?
You can have it exclude certain IP's from what I read.
answered
Quote
encoresin wrote:
I'm not sure but this bot blocked ip '66.249.76.148' on my site. WHOIS said it's google bot. That's not so good to block it?
Well, So your saying Google Does not obey robox.txt? Of course Google obeys it and it would have read to keep out of bottrap so it would not be real google.
Anyway stick this in robots.txt to tell google it's ok....
Code Download source
User-agent: Mediapartners-Google
Disallow:
User-agent: Googlebot
Disallow:
User-agent: Googlebot/2.1
Disallow:It does not block Search Engines that obey robots.txt.
EDIT: Confirmed this Googlebot for some reason does not obey robots.txt so he is bad...
Look here then scroll to the bottom.....
http://www.projecthoneypot.org/ip_66.249.76.175
Quote
For some reason this google bot does not respect my robots.txt file disallowing all search engines. Had to add it to .htaccess. My error log is full of this IP address continuing to try to access my site. Makes me wonder if it is a bad guy spoofing to be google
Good to See Bot Trap is doing it's job correctly. ;)
Edited by Craig on 05-03-2013 16:36,
answered
Okay. Thank you :)
— 1 year later —
Crazy_Prof
Crazy_Prof 10
Circuit development with microcontrollers
(German Site)
http://listner-elektronik.de/
(German Site)
http://listner-elektronik.de/
- Newbie, joined since
- Contributed 3 posts on the community forums.
- Started 1 thread in the forums
I have install Bot-Trap like the instruction, but I have a problem, if I would seen the entries:
Fatal error: Call to undefined function curl_init() in /infusions/bottrap/bottrap_admin.php on line 194
What can I do?
Fatal error: Call to undefined function curl_init() in /infusions/bottrap/bottrap_admin.php on line 194
What can I do?
answered
Hi,
Seems your host does not support Curl, ok, In Bot-Trap Admin disable Stop Forum Spam IP Check.
Regards
Seems your host does not support Curl, ok, In Bot-Trap Admin disable Stop Forum Spam IP Check.
Regards
Crazy_Prof
Crazy_Prof 10
Circuit development with microcontrollers
(German Site)
http://listner-elektronik.de/
(German Site)
http://listner-elektronik.de/
- Newbie, joined since
- Contributed 3 posts on the community forums.
- Started 1 thread in the forums
@Craig: Now it works...thank you...
answered
Your welcome!
Category Forum
Panels and InfusionsLabels
None yet
Statistics
- Views 0 views
- Posts 11 posts
- Votes 0 votes
- Topic users 6 members
6 participants
Homdax 10
- Fusioneer, joined since
- Contributed 2,247 posts on the community forums.
- Started 108 threads in the forums
Craig 14
- Fusioneer, joined since
- Contributed 4,462 posts on the community forums.
- Started 212 threads in the forums
- Started this discussions
PolarFox 8
- Veteran Member, joined since
- Contributed 1,633 posts on the community forums.
- Started 29 threads in the forums
encoresin 10
- Junior Member, joined since
- Contributed 12 posts on the community forums.
- Started 3 threads in the forums
KasteR 10
- Senior Member, joined since
- Contributed 290 posts on the community forums.
- Started 1 thread in the forums
Crazy_Prof 10
Circuit development with microcontrollers
(German Site)
http://listner-elektronik.de/
(German Site)
http://listner-elektronik.de/
- Newbie, joined since
- Contributed 3 posts on the community forums.
- Started 1 thread in the forums
Notifications
Track thread
You are not receiving notifications from this thread.
Related Questions