Control Web Panel

Other => Other => Topic started by: ~Q~ on April 23, 2022, 08:28:11 PM

Title: How to block a domain name based bot from crawling the server.
Post by: ~Q~ on April 23, 2022, 08:28:11 PM
 I want to block a bot coming from turing.threedgraphics.com

It crawls the server day and night.
Can you point me to a howto on how to block it on a CWP CentOS server.
Thank you.
Title: Re: How to block a domain name based bot from crawling the server.
Post by: Sandeep on April 24, 2022, 05:30:40 AM
you can use htaccess to block user agent or the bot name
more info here
https://chemicloud.com/kb/article/block-bad-bots-and-spiders-using-htaccess/