Author Topic: Robots being provided a 500 error  (Read 3860 times)

0 Members and 1 Guest are viewing this topic.

Offline
*
Robots being provided a 500 error
« on: December 02, 2021, 05:14:47 AM »
For some reason any robots are being provided with a 500 internal server error. But users are okay?

Any ideas? CWP Pro on Centos 7.

Tried updating PHP and server updates with no fix.

Offline
*
Re: Robots being provided a 500 error
« Reply #1 on: December 02, 2021, 05:19:00 AM »
Code: [Select]
172.105.169.250 - - [02/Dec/2021:16:15:01 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.173.108 - - [02/Dec/2021:16:15:21 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:15:58 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:16:23 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:16:57 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:17:25 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:18:02 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:18:27 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"

Offline
*
Re: Robots being provided a 500 error
« Reply #2 on: December 02, 2021, 05:21:09 AM »
Code: [Select]
103.xxx.xxx.xxx - - [02/Dec/2021:16:20:42 +1100] "GET /robots.txt HTTP/1.1" 500 127 "-" "Screaming Frog SEO Spider/16.3"
103..xxx.xxx.xxx - - [02/Dec/2021:16:20:42 +1100] "GET / HTTP/1.1" 500 32997 "-" "Screaming Frog SEO Spider/16.3"

Offline
*
Re: Robots being provided a 500 error
« Reply #3 on: December 02, 2021, 05:27:20 AM »
Code: [Select]
17.121.114.44 - - [02/Dec/2021:16:25:56 +1100] "GET /robots.txt HTTP/1.1" 500 127 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)"

Offline
*
Re: Robots being provided a 500 error
« Reply #4 on: December 02, 2021, 05:50:37 AM »
http://forum.centos-webpanel.com/apache/apache-not-loading-sites-well-after-cwp-to-cwppro-version-0-9-8-244/ < I did the same thing and I recently did updates which broke it! CWP upgrade broke it.

Offline
*
Re: Robots being provided a 500 error
« Reply #5 on: December 02, 2021, 06:10:53 AM »
try to check domainlogs error_log...can be mod_security
VPS & Dedicated server provider with included FREE Managed support for CWP.
http://www.studio4host.com/

*** Don't allow that your server or website is down, choose hosting provider with included expert managed support for your CWP.

Offline
*
Re: Robots being provided a 500 error
« Reply #6 on: December 02, 2021, 06:58:23 PM »
Quote
try to check domainlogs error_log...can be mod_security

I don't have mod_security installed.

After some further trial and error, I tried to even upload files and was getting errors. In the end, I terminated that account (since it was the only one with the issue) and started fresh. Issue now resolved.