New Zabbix Install | Server unreachable | Lack free swap space | Server not running

[SJ-NCI]

Hi,

I've used Zabbix in the past but this is the first time I've every tried to install it.

Azure Linux VM Spec;

Ubuntu 18.04
2 vcpus
8 GiB memory

Zabbix Install

Version: 4.4
OS: Ubuntu
OS Version: 18.04
Database: MySQL
Web Server: Apache

This looked alright initially, then it asked for some swap space, so we added 2GB.

admin@SRV-Zabbix:~$ free -m
total used free shared buff/cache available
Mem: 7953 596 6571 9 785 7057
Swap: 2047 0 2047

But the problem "Lack of free swap space on Zabbix server" has since come back

Then I have the recurring "Zabbix agent on Zabbix server is unreachable for 5 minutes" problem.

I've tricked around with the zabbix_server.conf & zabbix_agentd.conf to the points where I think I've caused more problems than I've solved.

Can anyone with a bit more experience have a quick look at the attached files and let me know where I'm gone wrong?

Thanks a million.

[Markku]

Hi, what do the Zabbix server and agent log files say?

Markku

[SJ-NCI]

Hi - thanks for the reply.

Here's the logs;

sudo tail -n 1000 /var/log/zabbix/zabbix_server.log | more

69096:20200205:151717.234 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '10.10.1.38' (111)
69096:20200205:151717.234 database is down: reconnecting in 10 seconds
69096:20200205:151727.234 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '10.10.1.38' (111)
69096:20200205:151727.234 database is down: reconnecting in 10 seconds

sudo tail -n 1000 /var/log/zabbix/zabbix_agentd.log | more

68860:20200205:093513.175 using configuration file: /etc/zabbix/zabbix_agentd.conf
68860:20200205:093513.177 agent #0 started [main process]
68861:20200205:093513.178 agent #1 started [collector]
68862:20200205:093513.178 agent #2 started[listener #1]
68863:20200205:093513.180 agent #3 started[listener #2]
68864:20200205:093513.189 agent #4 started[listener #3]
68860:20200205:093527.322 Got signal [signal:15(SIGTERM),sender_pid:69013,sender_uid:112 ,reason:0]. Exiting ...
68860:20200205:093527.324 Zabbix Agent stopped. Zabbix 4.0.17 (revision a528a0a4bc).
69095:20200205:093536.577 Starting Zabbix Agent [Zabbix Server]. Zabbix 4.0.17 (revision a528a0a4bc).
69095:20200205:093536.577 **** Enabled features ****
69095:20200205:093536.577 IPv6 support: YES
69095:20200205:093536.577 TLS support: YES
69095:20200205:093536.577 **************************
69095:20200205:093536.577 using configuration file: /etc/zabbix/zabbix_agentd.conf
69095:20200205:093536.577 agent #0 started [main process]
69102:20200205:093536.578 agent #4 started[listener #3]
69101:20200205:093536.580 agent #3 started[listener #2]
69100:20200205:093536.581 agent #2 started[listener #1]
69099:20200205:093536.584 agent #1 started [collector]

Let me know if you need more logs or for me to run a different command, or anything.

[Markku]

How did you configure your zabbix user in the database? If you went with the "zabbix@localhost" syntax, set your Zabbix server to connect to localhost, not to the IP address.

Markku

[SJ-NCI]

Thanks,

The Zabbix server is now running, but I still have "Zabbix agent on Zabbix server is unreachable for 5 minutes" & "Lack of free swap space on Zabbix server"


Logs;

sudo tail -n 1000 /var/log/zabbix/zabbix_server.log | more

91211:20200205:154407.897 Starting Zabbix Server. Zabbix 4.0.17 (revision a528a0a4bc).

91211:20200205:154407.897 ****** Enabled features ******
91211:20200205:154407.897 SNMP monitoring: YES
91211:20200205:154407.897 IPMI monitoring: YES
91211:20200205:154407.897 Web monitoring: YES
91211:20200205:154407.897 VMware monitoring: YES
91211:20200205:154407.897 SMTP authentication: YES
91211:20200205:154407.897 Jabber notifications: YES
91211:20200205:154407.897 Ez Texting notifications: YES
91211:20200205:154407.897 ODBC: YES
91211:20200205:154407.897 SSH2 support: YES
91211:20200205:154407.897 IPv6 support: YES
91211:20200205:154407.897 TLS support: YES
91211:20200205:154407.897 ******************************
91211:20200205:154407.897 using configuration file: /etc/zabbix/zabbix_server.conf
91211:20200205:154407.910 current database version (mandatory/optional): 04000000/04000005
91211:20200205:154407.910 required mandatory version: 04000000
91211:20200205:154407.910 server #0 started [main process]
91222:20200205:154407.910 server #1 started [configuration syncer #1]
91229:20200205:154408.013 server #3 started [timer #1]
91230:20200205:154408.014 server #4 started [http poller #1]
91233:20200205:154408.014 server #6 started [history syncer #1]
91234:20200205:154408.015 server #7 started [history syncer #2]
91237:20200205:154408.015 server #8 started [history syncer #3]
91238:20200205:154408.015 server #9 started [history syncer #4]
91244:20200205:154408.017 server #13 started [task manager #1]
91247:20200205:154408.019 server #15 started [poller #2]
91248:20200205:154408.021 server #16 started [poller #3]
91249:20200205:154408.022 server #17 started [poller #4]
91242:20200205:154408.022 server #11 started [proxy poller #1]
91241:20200205:154408.023 server #10 started [escalator #1]
91243:20200205:154408.023 server #12 started [self-monitoring #1]
91231:20200205:154408.023 server #5 started [discoverer #1]
91228:20200205:154408.024 server #2 started [housekeeper #1]
91246:20200205:154408.024 server #14 started [poller #1]
91250:20200205:154408.035 server #18 started [poller #5]
91258:20200205:154408.035 server #23 started [trapper #4]
91259:20200205:154408.036 server #24 started [trapper #5]
91252:20200205:154408.036 server #19 started [unreachable poller #1]
91260:20200205:154408.037 server #25 started [icmp pinger #1]
91257:20200205:154408.037 server #22 started [trapper #3]
91256:20200205:154408.041 server #21 started [trapper #2]
91268:20200205:154408.042 server #27 started [alerter #1]
91269:20200205:154408.042 server #28 started [alerter #2]
91270:20200205:154408.042 server #29 started [alerter #3]
91255:20200205:154408.043 server #20 started [trapper #1]
91271:20200205:154408.043 server #30 started [preprocessing manager #1]
91267:20200205:154408.044 server #26 started [alert manager #1]
91279:20200205:154409.048 server #33 started [preprocessing worker #3]
91276:20200205:154409.049 server #32 started [preprocessing worker #2]
91272:20200205:154409.145 server #31 started [preprocessing worker #1]

sudo tail -n 1000 /var/log/zabbix/zabbix_agentd.log | more

91081:20200205:154413.048 failed to accept an incoming connection: connection from "127.0.0.1" rejected, allowed hosts: "10.10.1.38"
91081:20200205:154513.069 failed to accept an incoming connection: connection from "127.0.0.1" rejected, allowed hosts: "10.10.1.38"
91083:20200205:154613.102 failed to accept an incoming connection: connection from "127.0.0.1" rejected, allowed hosts: "10.10.1.38"

[Markku]

You were totally right: you really caused the problems to your setup

Change Server in the agent configuration file back to 127.0.0.1.

Markku

[SJ-NCI]

HA! I knew I was only making things worse.

Thanks a million, I'm all sorted now.

Time for a snapshot