Author Topic: How to block a domain name based bot from crawling the server. (Read 2426 times)

~Q~ · « **on:** April 23, 2022, 08:28:11 PM »

I want to block a bot coming from turing.threedgraphics.com

It crawls the server day and night.
Can you point me to a howto on how to block it on a CWP CentOS server.
Thank you.

Sandeep · « **Reply #1 on:** April 24, 2022, 05:30:40 AM »

you can use htaccess to block user agent or the bot name
more info here
https://chemicloud.com/kb/article/block-bad-bots-and-spiders-using-htaccess/

Control Web Panel

Author Topic: How to block a domain name based bot from crawling the server. (Read 2426 times)

How to block a domain name based bot from crawling the server.

Re: How to block a domain name based bot from crawling the server.