Login
Register
Home
Wiki Knowledge Base
FreeDNS
Facebook
Linux Support
Control Web Panel
MENU
Home
Help
Search
Login
Register
Control Web Panel
»
Other
»
Other
»
How to block a domain name based bot from crawling the server.
« previous
next »
Print
Pages: [
1
]
Author
Topic: How to block a domain name based bot from crawling the server. (Read 2445 times)
0 Members and 3 Guests are viewing this topic.
~Q~
Newbie
Posts: 11
How to block a domain name based bot from crawling the server.
«
on:
April 23, 2022, 08:28:11 PM »
I want to block a bot coming from turing.threedgraphics.com
It crawls the server day and night.
Can you point me to a howto on how to block it on a CWP CentOS server.
Thank you.
Logged
Sandeep
Global Moderator
Hero Member
Posts: 1697
Re: How to block a domain name based bot from crawling the server.
«
Reply #1 on:
April 24, 2022, 05:30:40 AM »
you can use htaccess to block user agent or the bot name
more info here
https://chemicloud.com/kb/article/block-bad-bots-and-spiders-using-htaccess/
Logged
Home
:
https://control-webpanel.com
|
Support
:
https://control-webpanel.com/contact
|
Docs
:
https://docs.control-webpanel.com
|
Wiki
:
https://wiki.centos-webpanel.com
Print
Pages: [
1
]
« previous
next »
Control Web Panel
»
Other
»
Other
»
How to block a domain name based bot from crawling the server.