Control Web Panel

WebPanel => Apache => Topic started by: geekcohen on December 02, 2021, 05:14:47 AM

Title: Robots being provided a 500 error
Post by: geekcohen on December 02, 2021, 05:14:47 AM
For some reason any robots are being provided with a 500 internal server error. But users are okay?

Any ideas? CWP Pro on Centos 7.

Tried updating PHP and server updates with no fix.
Title: Re: Robots being provided a 500 error
Post by: geekcohen on December 02, 2021, 05:19:00 AM
Code: [Select]
172.105.169.250 - - [02/Dec/2021:16:15:01 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.173.108 - - [02/Dec/2021:16:15:21 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:15:58 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:16:23 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:16:57 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:17:25 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.169.250 - - [02/Dec/2021:16:18:02 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
172.105.190.118 - - [02/Dec/2021:16:18:27 +1100] "GET / HTTP/1.1" 500 32997 "-" "Better Uptime Bot Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
Title: Re: Robots being provided a 500 error
Post by: geekcohen on December 02, 2021, 05:21:09 AM
Code: [Select]
103.xxx.xxx.xxx - - [02/Dec/2021:16:20:42 +1100] "GET /robots.txt HTTP/1.1" 500 127 "-" "Screaming Frog SEO Spider/16.3"
103..xxx.xxx.xxx - - [02/Dec/2021:16:20:42 +1100] "GET / HTTP/1.1" 500 32997 "-" "Screaming Frog SEO Spider/16.3"
Title: Re: Robots being provided a 500 error
Post by: geekcohen on December 02, 2021, 05:27:20 AM
Code: [Select]
17.121.114.44 - - [02/Dec/2021:16:25:56 +1100] "GET /robots.txt HTTP/1.1" 500 127 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)"
Title: Re: Robots being provided a 500 error
Post by: geekcohen on December 02, 2021, 05:50:37 AM
http://forum.centos-webpanel.com/apache/apache-not-loading-sites-well-after-cwp-to-cwppro-version-0-9-8-244/ < I did the same thing and I recently did updates which broke it! CWP upgrade broke it.
Title: Re: Robots being provided a 500 error
Post by: studio4host on December 02, 2021, 06:10:53 AM
try to check domainlogs error_log...can be mod_security
Title: Re: Robots being provided a 500 error
Post by: geekcohen on December 02, 2021, 06:58:23 PM
Quote
try to check domainlogs error_log...can be mod_security

I don't have mod_security installed.

After some further trial and error, I tried to even upload files and was getting errors. In the end, I terminated that account (since it was the only one with the issue) and started fresh. Issue now resolved.