Robots being provided a 500 error

[geekcohen]

For some reason any robots are being provided with a 500 internal server error. But users are okay?

Any ideas? CWP Pro on Centos 7.

Tried updating PHP and server updates with no fix.

[geekcohen]

Code Select Expand

172.105.169.250 - - [02/Dec/2021:16:15:01 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.173.108 - - [02/Dec/2021:16:15:21 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:15:58 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:16:23 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:16:57 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:17:25 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:18:02 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:18:27 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"


[geekcohen]

Code Select Expand

103.xxx.xxx.xxx - - [02/Dec/2021:16:20:42 +1100] "GET /robots.txt HTTP/1.1" 500 127 "-" "Screaming Frog SEO Spider/16.3"
103..xxx.xxx.xxx - - [02/Dec/2021:16:20:42 +1100] "GET / HTTP/1.1" 500 32997 "-" "Screaming Frog SEO Spider/16.3"


[geekcohen]

Code Select Expand

17.121.114.44 - - [02/Dec/2021:16:25:56 +1100] "GET /robots.txt HTTP/1.1" 500 127 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)"


[geekcohen]

http://forum.centos-webpanel.com/apache/apache-not-loading-sites-well-after-cwp-to-cwppro-version-0-9-8-244/ < I did the same thing and I recently did updates which broke it! CWP upgrade broke it.

[studio4host]

try to check domainlogs error_log...can be mod_security

[geekcohen]

try to check domainlogs error_log...can be mod_security

I don't have mod_security installed.

After some further trial and error, I tried to even upload files and was getting errors. In the end, I terminated that account (since it was the only one with the issue) and started fresh. Issue now resolved.