Nagios Xi and CWP Pro problem

[Starburst]

I use Nagios XI to monitor 3 servers.
Currently 2 are Pro and 1 isn't.

Nagios monitors all processes and report fine on all 3.

But when the daily cron is run on the 2 Pro CWP servers it stops reporting correctly to Nagios unless that server is rebooted.
The Non-Pro CWP server is fine.

Any suggestions?

[Igor S.]

Try to check if Nagios server accessible from the server and check the firewall's whitelist.

[Starburst]

Try to check if Nagios server accessible from the server and check the firewall's whitelist.

Nagios XI server is white listed, everything works fine until in the morning when the cron.daily runs.
Then on the 2 server running CWPPro stop reporting the check_all_procs to Nagios correctly. But 1 server not running Pro continues OK.

The 2 servers running Pro, when rebooted, start reporting correctly again.
Just trying to narrow down what is running at that time causing the problem.


Thanks,
David

[Starburst]

Igor? Anyone?

[Sandeep]

this are 3rd party scripts, we didn't support it. Check the nagios log why it is not working

[Starburst]

Sandeep,

With all due respect this isn't a Nagios problem according to the logs.

Something is running in the cron.daily that is causing the problem according to the timestamps in the logs.

And funny enough the 2 servers running CWP Pro are having the problem, while another CWP Non-Pro server is not.

Reboot the server(s) running CWP Pro and it runs fine for 23 hours 55 mins until cron.dail runs again, and then server has to be rebooted to start functioning again.

I'm just trying to narrow down exactly what CWP runs that could be causing this.

[rcschaff]

Out of curiosity, does the service shut down after an update.
Do you really need to restart the entire server, or can you just restart the service...

[Starburst]

Out of curiosity, does the service shut down after an update.
Do you really need to restart the entire server, or can you just restart the service...

After cron.daily runs it stops sending the correct # of processes running, 6 instead of about 140, xinetd is still running and all other monitors are working correctly.

I've tried restarting the xinetd service, but doesn't do anything.

Only thing that bring back CWPPro reporting correctly is a server reboot.

And again, it's only happening on the CWPPro servers.
The Non-Pro server is OK.

Hence why I've been trying to figure out what runs differently on CWPPro, from looking in /etc/cron.daily @ CWP and other in that directory, I don't see anything.

And it's very weird that the logs show it stops reporting correctly at the same time as that.

I'm tring a couple things different on 1 of the CWPPro servers tonight, but at this point I'm just shotgunning.

[ejsolutions]

Would munin not suffice as an alternative? I have had it running fine for months on various servers/VPS.
Just a thought.

[Starburst]

Would munin not suffice as an alternative? I have had it running fine for months on various servers/VPS.
Just a thought.

Never seen munin before, but have used MRTG & RRDTool.

I like Nagios because it will send out notifications if a service stops responding like WhatsUp Gold.

RRDTool is great for monitoring bandwidth usage on network cards, switches and routers.
I had used it for the 95%tile.

[ejsolutions]

I started using MRTG just over 20 years ago.
I use the basics of munin on all servers, plus DNS monitoring on my nameservers. It is possible to set up alerts though I don't utilise that aspect ( I should! ).

[Starburst]

I started using MRTG just over 20 years ago.
I use the basics of munin on all servers, plus DNS monitoring on my nameservers. It is possible to set up alerts though I don't utilise that aspect ( I should! ).

MRTG & RRDTool is great for bandwidth monitoring.

Nagios is great for service monitoring (http, ftp, smtp, pop/imap, etc) if a service stops responding it will send an email & text alert.

The each have their areas they are good in.

[ejsolutions]

How about extending Monit?
https://www.howtoforge.com/tutorial/server-monitoring-with-munin-and-monit-on-centos/
(Though note the CWP Pro possible restriction.)

[Starburst]

How about extending Monit?
https://www.howtoforge.com/tutorial/server-monitoring-with-munin-and-monit-on-centos/
(Though note the CWP Pro possible restriction.)

What's nice with Nagios, is you can monitor multiple servers.

Had a problem with the Dovecot service dying, and it still was showing active on the server, but an external check showed it non-responsive.

[ejsolutions]

I presume that you've tried a cron with

Code Select Expand

/etc/rc.d/init.d/nagios reload
or

Code Select Expand

/usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg
and set it to run after that cwp one has done it's thing.

Perhaps add it to the end of /etc/cron.daily/cwp ? Though I suspect that won't work - better to look at how long the cwp one runs (approximately) and execute a timed cron, using crontab.