Show Posts
This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.
Pages: [1]
1
CentOS 7 Problems / kswapd0 over 500% CPU Usage
« on: April 10, 2020, 09:22:50 AM »
Hi CWP!
I am having a big problem with my installation
I followed the wiki
set hostname
created a package
created a user
added a domain
and its all working but i cant figure out why kswapd0 is having so much usage.
first, it seems Firewall was not set up correctly those bunch of emails i received, I tried to ignore those false alarms
and kswapd0 high usage never showed up for a week or two.
change my database ports and ssh ports to negate all those spam logins(hell knows where they came from)
and now its back.
https://prnt.sc/rwmnoh
- i have swappiness set to 0
- i have a lot of RAM space
- 12 Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz processors
- Disk Raid SSD 500GB
I already tried:
systemctl stop httpd
systemctl stop mysqld
sync && echo 2 > /proc/sys/vm/drop_caches
systemctl start mysqld
systemctl start httpd
and all i have is ONE LARAVEL SITE
the crontab process is not much.
i dont know what else could've gone wrong in my set up
this is my top:
top - 11:17:37 up 1:44, 2 users, load average: 6.97, 7.00, 6.95
Tasks: 230 total, 2 running, 121 sleeping, 0 stopped, 0 zombie
%Cpu(s): 58.2 us, 0.3 sy, 0.0 ni, 41.4 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem : 65787508 total, 59105236 free, 4870992 used, 1811280 buff/cache
KiB Swap: 5242876 total, 5242876 free, 0 used. 60170128 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3189 root 20 0 2442256 2076 1416 S 599.3 0.0 619:32.79 kswapd0
15223 amavis 20 0 691788 578364 7504 R 100.0 0.9 0:04.37 clamd
9305 root 20 0 221780 17992 9628 S 0.7 0.0 0:18.57 php-fpm
11671 root 20 0 221696 17972 9676 S 0.7 0.0 0:16.77 php-fpm
11818 root 20 0 221816 18016 9684 S 0.7 0.0 0:18.10 php-fpm
3963 beamium 20 0 1381572 13956 7668 S 0.3 0.0 0:03.50 beamium
14778 root 20 0 158936 8732 7388 S 0.3 0.0 0:00.52 sshd
1 root 20 0 191680 5980 3964 S 0.0 0.0 0:03.23 systemd
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
3 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 rcu_gp
4 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 rcu_par_gp
6 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/0:0H-kb
8 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 mm_percpu_wq
9 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/0
10 root 20 0 0 0 0 I 0.0 0.0 0:03.01 rcu_sched
11 root 20 0 0 0 0 I 0.0 0.0 0:00.00 rcu_bh
12 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/0
13 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/0
14 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/1
15 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/1
16 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/1
18 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/1:0H-kb
19 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/2
20 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/2
21 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/2
23 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/2:0H-ev
24 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/3
25 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/3
26 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/3
28 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/3:0H-kb
29 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/4
30 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/4
31 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/4
33 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/4:0H-kb
34 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/5
35 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/5
36 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/5
38 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/5:0H-kb
39 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/6
40 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/6
41 root 20 0 0 0 0 S 0.0 0.0 0:00.22 ksoftirqd/6
43 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/6:0H-kb
44 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/7
45 root rt 0 0 0 0 S 0.0 0.0 0:00.54 migration/7
46 root 20 0 0 0 0 S 0.0 0.0 0:00.06 ksoftirqd/7
48 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/7:0H-kb
49 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/8
50 root rt 0 0 0 0 S 0.0 0.0 0:00.54 migration/8
51 root 20 0 0 0 0 S 0.0 0.0 0:00.02 ksoftirqd/8
53 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/8:0H-kb
54 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/9
cat /proc/3189/maps
7f89bbe00000-7f89bc000000 rw-p 00000000 00:0c 23865 /anon_hugepage (deleted)
7f89bc000000-7f89bc200000 rw-p 00000000 00:0c 308121 /anon_hugepage (deleted)
7f89bc200000-7f89bc400000 rw-p 00000000 00:0c 302427 /anon_hugepage (deleted)
7f89bc400000-7f89bc600000 rw-p 00000000 00:0c 23030 /anon_hugepage (deleted)
7f89bc600000-7f89bc800000 rw-p 00000000 00:0c 304314 /anon_hugepage (deleted)
7f89bc800000-7f89bca00000 rw-p 00000000 00:0c 303706 /anon_hugepage (deleted)
7f89bca00000-7f89cca00000 rw-p 00000000 00:0c 306570 /anon_hugepage (deleted)
7f89cca00000-7f8a4ea00000 rw-p 00000000 00:0c 306569 /anon_hugepage (deleted)
7f8a4ea88000-7f8a4eaa8000 rwxp 00000000 00:00 0
7f8a4eaa8000-7f8a4eaaa000 ---p 00000000 00:00 0
7f8a4eaaa000-7f8a4eabf000 rw-p 00000000 00:00 0
7f8a4eabf000-7f8a4eadf000 rwxp 00000000 00:00 0
7f8a4eadf000-7f8a4eae1000 ---p 00000000 00:00 0
7f8a4eae1000-7f8a4eaf6000 rw-p 00000000 00:00 0
7f8a4eaf6000-7f8a4eb16000 rwxp 00000000 00:00 0
7f8a4eb16000-7f8a4eb18000 ---p 00000000 00:00 0
7f8a4eb18000-7f8a4eb2d000 rw-p 00000000 00:00 0
7f8a4eb2d000-7f8a4eb4d000 rwxp 00000000 00:00 0
7f8a4eb4d000-7f8a4eb4f000 ---p 00000000 00:00 0
7f8a4eb4f000-7f8a4eb64000 rw-p 00000000 00:00 0
7f8a4eb64000-7f8a4eb84000 rwxp 00000000 00:00 0
7f8a4eb84000-7f8a4eb86000 ---p 00000000 00:00 0
7f8a4eb86000-7f8a4eb9b000 rw-p 00000000 00:00 0
7f8a4eb9b000-7f8a4ebbb000 rwxp 00000000 00:00 0
7f8a4ebbb000-7f8a4ebbd000 ---p 00000000 00:00 0
7f8a4ebbd000-7f8a4ebd2000 rw-p 00000000 00:00 0
7f8a4ebd2000-7f8a4ebf2000 rwxp 00000000 00:00 0
7f8a4ebf2000-7f8a4ebf4000 ---p 00000000 00:00 0
7f8a4ebf4000-7f8a4f3f5000 rw-p 00000000 00:00 0
7f8a4f3f5000-7f8a4f3f7000 ---p 00000000 00:00 0
7f8a4f3f7000-7f8a4fbf8000 rw-p 00000000 00:00 0
7f8a4fbf8000-7f8a4fbfa000 ---p 00000000 00:00 0
7f8a4fbfa000-7f8a503fb000 rw-p 00000000 00:00 0
7f8a503fb000-7f8a503fd000 ---p 00000000 00:00 0
7f8a503fd000-7f8a50bfe000 rw-p 00000000 00:00 0
7f8a50bfe000-7f8a50c00000 ---p 00000000 00:00 0
7f8a50c00000-7f8a50c15000 rw-p 00000000 00:00 0
7f8a50c15000-7f8a50c16000 r--s 00000000 09:02 25298103 /usr/share/zoneinfo/Europe/Berlin
7f8a50c16000-7f8a50c2c000 r--p 00000000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50c2c000-7f8a50de8000 r-xp 00016000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50de8000-7f8a50e56000 r--p 001d2000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50e56000-7f8a50e61000 rw-p 0023f000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50e61000-7f8a50e9f000 rw-p 00000000 00:00 0 [heap]
7f8a50e9f000-7f8a50f66000 rw-p 00000000 00:00 0 [heap]
7ffe10c96000-7ffe10cb7000 rw-p 00000000 00:00 0 [stack]
7ffe10d9c000-7ffe10d9f000 r--p 00000000 00:00 0 [vvar]
7ffe10d9f000-7ffe10da1000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
I dont know what to do anymore. google says im OOM but i have lots of RAM space more than enough to run one site
please help me
I am having a big problem with my installation
I followed the wiki
set hostname
created a package
created a user
added a domain
and its all working but i cant figure out why kswapd0 is having so much usage.
first, it seems Firewall was not set up correctly those bunch of emails i received, I tried to ignore those false alarms
and kswapd0 high usage never showed up for a week or two.
change my database ports and ssh ports to negate all those spam logins(hell knows where they came from)
and now its back.
https://prnt.sc/rwmnoh
- i have swappiness set to 0
- i have a lot of RAM space
- 12 Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz processors
- Disk Raid SSD 500GB
I already tried:
systemctl stop httpd
systemctl stop mysqld
sync && echo 2 > /proc/sys/vm/drop_caches
systemctl start mysqld
systemctl start httpd
and all i have is ONE LARAVEL SITE
the crontab process is not much.
i dont know what else could've gone wrong in my set up
this is my top:
top - 11:17:37 up 1:44, 2 users, load average: 6.97, 7.00, 6.95
Tasks: 230 total, 2 running, 121 sleeping, 0 stopped, 0 zombie
%Cpu(s): 58.2 us, 0.3 sy, 0.0 ni, 41.4 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem : 65787508 total, 59105236 free, 4870992 used, 1811280 buff/cache
KiB Swap: 5242876 total, 5242876 free, 0 used. 60170128 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3189 root 20 0 2442256 2076 1416 S 599.3 0.0 619:32.79 kswapd0
15223 amavis 20 0 691788 578364 7504 R 100.0 0.9 0:04.37 clamd
9305 root 20 0 221780 17992 9628 S 0.7 0.0 0:18.57 php-fpm
11671 root 20 0 221696 17972 9676 S 0.7 0.0 0:16.77 php-fpm
11818 root 20 0 221816 18016 9684 S 0.7 0.0 0:18.10 php-fpm
3963 beamium 20 0 1381572 13956 7668 S 0.3 0.0 0:03.50 beamium
14778 root 20 0 158936 8732 7388 S 0.3 0.0 0:00.52 sshd
1 root 20 0 191680 5980 3964 S 0.0 0.0 0:03.23 systemd
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
3 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 rcu_gp
4 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 rcu_par_gp
6 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/0:0H-kb
8 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 mm_percpu_wq
9 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/0
10 root 20 0 0 0 0 I 0.0 0.0 0:03.01 rcu_sched
11 root 20 0 0 0 0 I 0.0 0.0 0:00.00 rcu_bh
12 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/0
13 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/0
14 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/1
15 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/1
16 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/1
18 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/1:0H-kb
19 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/2
20 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/2
21 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/2
23 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/2:0H-ev
24 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/3
25 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/3
26 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/3
28 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/3:0H-kb
29 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/4
30 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/4
31 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/4
33 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/4:0H-kb
34 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/5
35 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/5
36 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/5
38 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/5:0H-kb
39 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/6
40 root rt 0 0 0 0 S 0.0 0.0 0:00.53 migration/6
41 root 20 0 0 0 0 S 0.0 0.0 0:00.22 ksoftirqd/6
43 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/6:0H-kb
44 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/7
45 root rt 0 0 0 0 S 0.0 0.0 0:00.54 migration/7
46 root 20 0 0 0 0 S 0.0 0.0 0:00.06 ksoftirqd/7
48 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/7:0H-kb
49 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/8
50 root rt 0 0 0 0 S 0.0 0.0 0:00.54 migration/8
51 root 20 0 0 0 0 S 0.0 0.0 0:00.02 ksoftirqd/8
53 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/8:0H-kb
54 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/9
cat /proc/3189/maps
7f89bbe00000-7f89bc000000 rw-p 00000000 00:0c 23865 /anon_hugepage (deleted)
7f89bc000000-7f89bc200000 rw-p 00000000 00:0c 308121 /anon_hugepage (deleted)
7f89bc200000-7f89bc400000 rw-p 00000000 00:0c 302427 /anon_hugepage (deleted)
7f89bc400000-7f89bc600000 rw-p 00000000 00:0c 23030 /anon_hugepage (deleted)
7f89bc600000-7f89bc800000 rw-p 00000000 00:0c 304314 /anon_hugepage (deleted)
7f89bc800000-7f89bca00000 rw-p 00000000 00:0c 303706 /anon_hugepage (deleted)
7f89bca00000-7f89cca00000 rw-p 00000000 00:0c 306570 /anon_hugepage (deleted)
7f89cca00000-7f8a4ea00000 rw-p 00000000 00:0c 306569 /anon_hugepage (deleted)
7f8a4ea88000-7f8a4eaa8000 rwxp 00000000 00:00 0
7f8a4eaa8000-7f8a4eaaa000 ---p 00000000 00:00 0
7f8a4eaaa000-7f8a4eabf000 rw-p 00000000 00:00 0
7f8a4eabf000-7f8a4eadf000 rwxp 00000000 00:00 0
7f8a4eadf000-7f8a4eae1000 ---p 00000000 00:00 0
7f8a4eae1000-7f8a4eaf6000 rw-p 00000000 00:00 0
7f8a4eaf6000-7f8a4eb16000 rwxp 00000000 00:00 0
7f8a4eb16000-7f8a4eb18000 ---p 00000000 00:00 0
7f8a4eb18000-7f8a4eb2d000 rw-p 00000000 00:00 0
7f8a4eb2d000-7f8a4eb4d000 rwxp 00000000 00:00 0
7f8a4eb4d000-7f8a4eb4f000 ---p 00000000 00:00 0
7f8a4eb4f000-7f8a4eb64000 rw-p 00000000 00:00 0
7f8a4eb64000-7f8a4eb84000 rwxp 00000000 00:00 0
7f8a4eb84000-7f8a4eb86000 ---p 00000000 00:00 0
7f8a4eb86000-7f8a4eb9b000 rw-p 00000000 00:00 0
7f8a4eb9b000-7f8a4ebbb000 rwxp 00000000 00:00 0
7f8a4ebbb000-7f8a4ebbd000 ---p 00000000 00:00 0
7f8a4ebbd000-7f8a4ebd2000 rw-p 00000000 00:00 0
7f8a4ebd2000-7f8a4ebf2000 rwxp 00000000 00:00 0
7f8a4ebf2000-7f8a4ebf4000 ---p 00000000 00:00 0
7f8a4ebf4000-7f8a4f3f5000 rw-p 00000000 00:00 0
7f8a4f3f5000-7f8a4f3f7000 ---p 00000000 00:00 0
7f8a4f3f7000-7f8a4fbf8000 rw-p 00000000 00:00 0
7f8a4fbf8000-7f8a4fbfa000 ---p 00000000 00:00 0
7f8a4fbfa000-7f8a503fb000 rw-p 00000000 00:00 0
7f8a503fb000-7f8a503fd000 ---p 00000000 00:00 0
7f8a503fd000-7f8a50bfe000 rw-p 00000000 00:00 0
7f8a50bfe000-7f8a50c00000 ---p 00000000 00:00 0
7f8a50c00000-7f8a50c15000 rw-p 00000000 00:00 0
7f8a50c15000-7f8a50c16000 r--s 00000000 09:02 25298103 /usr/share/zoneinfo/Europe/Berlin
7f8a50c16000-7f8a50c2c000 r--p 00000000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50c2c000-7f8a50de8000 r-xp 00016000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50de8000-7f8a50e56000 r--p 001d2000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50e56000-7f8a50e61000 rw-p 0023f000 09:02 2621511 /root/.configrc/a/kswapd0
7f8a50e61000-7f8a50e9f000 rw-p 00000000 00:00 0 [heap]
7f8a50e9f000-7f8a50f66000 rw-p 00000000 00:00 0 [heap]
7ffe10c96000-7ffe10cb7000 rw-p 00000000 00:00 0 [stack]
7ffe10d9c000-7ffe10d9f000 r--p 00000000 00:00 0 [vvar]
7ffe10d9f000-7ffe10da1000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
I dont know what to do anymore. google says im OOM but i have lots of RAM space more than enough to run one site
please help me
Pages: [1]
