Author Topic: How to block a domain name based bot from crawling the server.  (Read 277 times)

0 Members and 1 Guest are viewing this topic.

Offline
*
 I want to block a bot coming from turing.threedgraphics.com

It crawls the server day and night.
Can you point me to a howto on how to block it on a CWP CentOS server.
Thank you.

Offline
*****
Re: How to block a domain name based bot from crawling the server.
« Reply #1 on: April 24, 2022, 05:30:40 AM »
you can use htaccess to block user agent or the bot name
more info here
https://chemicloud.com/kb/article/block-bad-bots-and-spiders-using-htaccess/