Print Page - How to block a domain name based bot from crawling the server.

Title: How to block a domain name based bot from crawling the server.
Post by: ~Q~ on April 23, 2022, 08:28:11 PM

I want to block a bot coming from turing.threedgraphics.com

It crawls the server day and night.
Can you point me to a howto on how to block it on a CWP CentOS server.
Thank you.

Title: Re: How to block a domain name based bot from crawling the server.
Post by: Sandeep on April 24, 2022, 05:30:40 AM

you can use htaccess to block user agent or the bot name
more info here
https://chemicloud.com/kb/article/block-bad-bots-and-spiders-using-htaccess/

Control Web Panel

Other => Other => Topic started by: ~Q~ on April 23, 2022, 08:28:11 PM