Ad Widget

**MRedbourne** · 28-12-2023, 21:06

Can you post the OS information belonging to the Zabbix Agent and Zabbix Server?

37482:20231228:115242.411 Starting Zabbix Agent [<REDACTED>]. Zabbix 4.0.17 (revision a528a0a4bc).

Would seem that you're running an LTS that was EOL around 2 years ago. I'd suggest patching that. It no longer receives general or security updates.

37497:20231228:115242.424 active check configuration update from [serverlinux:10051] started to fail (cannot connect to [[serverlinux]:10051]: [111] Connection refused)

Your Zabbix server is refusing the connection. You mentioned it's running in NAT. You need to check two firewall policies potentially.

1. Perimeter/Internal Corporate Firewall.
2. Host firewall (ufw, iptables, firewalld)

ufw status | grep -i "10051"
firewall-cmd --list-all | grep -i "10051"
iptables -L INPUT -v -n | grep -i "10051"

If those don't return any results (you're likely to only have one of the apps installed on Zabbix Server), the host firewall is likely rejecting the connection. Check your perimeter firewalls as well for any traffic destined to TCP\10051. Note what the perimeter says. "Timeout" usually means either the host dropped it, or isn't listening. If the perimeter/internal firewall dropped the connection, have a look at the ACLs.

Edit: Also check netstat.
sudo netstat -tunlp | egrep -i "10050|10051"

If netstat only shows one listening port (10050), Zabbix Server isn't configured correctly.

**GillezDeleuze** · 29-12-2023, 12:34

Thank you for the fast reply and also sorry for long response.
Also my zabbix server version is Zabbix 6.4.8 and it runs in kubernetis
And you absolutely right, agent runs on 20.04 but i can't upgrade it for several reasons (
and firewall is ok, but yeah seems that zabbix-server not configured properly cause
```
root@serverlinux:/home/kubeadm/k_yamls/k_zabbix_mariadb# sudo netstat -tunlp | egrep -i "10050|10051"
tcp 0 0 0.0.0.0:10050 0.0.0.0:* LISTEN 3060077/zabbix_agen
tcp6 0 0 :::10050 :::* LISTEN 3060077/zabbix_agen

```
Probably i should post my kuber settings to clearify it
```
root@serverlinux:/home/kubeadm/k_yamls/k_zabbix_mariadb# cat zabbix-server-deploy.yaml
apiVersion: v1
kind: Service
metadata:
name: zabbix-server
namespace: kube-system
labels:
app: zabbix-server
spec:
type: NodePort
ports:
- port: 10051
targetPort: 10051
nodePort: 30017
protocol: TCP
selector:
app: zabbix-server

---

apiVersion: apps/v1
kind: Deployment
metadata:
name: zabbix-server
namespace: kube-system
labels:
name: zabbix-server
app: zabbix-server
spec:
replicas: 1
revisionHistoryLimit: 3
selector:
matchLabels:
name: zabbix-server
strategy:
rollingUpdate:
maxSurge: 30%
maxUnavailable: 30%
template:
metadata:
labels:
name: zabbix-server
app: zabbix-server
spec:
hostname: zabbix-server
volumes:
- name: zabbix-storage
persistentVolumeClaim:
claimName: zabbix-pvc
containers:
- name: zabbix-server
image: zabbix/zabbix-server-mysql
imagePullPolicy: IfNotPresent
resources:
limits:
cpu: 400m
memory: 1024Mi
requests:
cpu: 100m
memory: 100Mi
ports:
- containerPort: 10051
env:
- name: DB_SERVER_HOST
value: "mariadb-server"
- name: MYSQL_USER
value: "xxx"
- name: MYSQL_PASSWORD
value: "xxx"
- name: MYSQL_DATABASE
value: "zxxx"
- name: ZBX_CACHESIZE
value: "1024M"
#- name: TZ
#value: "Asia/Shanghai"
volumeMounts:
- name: zabbix-storage
mountPath: /usr/lib/zabbix/alertscripts
- name: zabbix-storage
mountPath: /usr/lib/zabbix/externalscripts
```

**MRedbourne** · 29-12-2023, 13:06

Hey Mate,

Unfortunately, I know little about K8s. Can you redact and post:

/etc/zabbix/zabbix_server.conf
/var/log/zabbix/zabbix_server.log

Does your zabbix-server have AppArmour/AppArmor installed? If so, what do the policies look like?

Restart the zabbix-server daemon and try running "ausearch -m avc -ts recent". Does that return anything?

**GillezDeleuze** · 29-12-2023, 18:03

Good evening!)
So, in my kuber pod most of strings in /etc/zabbix/zabbix_server. and this file totally repeat servers settings from previous mesage) but here it is in .txt format)

and also some logs (events with this agent on this time) but i guess its not about it, the meybe caused because i changed settings (disabled passive interface on this agent)
215:20231228:115150.717 Zabbix agent item "proc.num" on host "staffcop-pc" failed: first network error, wait for 15 seconds
216:20231228:115207.694 resuming Zabbix agent checks on host "staffcop-pc": connection restored
212:20231228:115644.561 Zabbix agent item "system.cpu.load[all,avg5]" on host "staffcop-pc" failed: first network error, wait for 15 seconds
216:20231228:115659.045 resuming Zabbix agent checks on host "staffcop-pc": connection restored
214:20231228:115949.470 Zabbix agent item "system.users.num" on host "staffcop-pc" failed: first network error, wait for 15 seconds
216:20231228:120005.218 resuming Zabbix agent checks on host "staffcop-pc": connection restored
214:20231228:120142.760 Zabbix agent item "system.cpu.load[all,avg15]" on host "staffcop-pc" failed: first network error, wait for 15 seconds
216:20231228:120158.381 resuming Zabbix agent checks on host "staffcop-pc": connection restored
214:20231228:120249.616 Zabbix agent item "system.users.num" on host "staffcop-pc" failed: first network error,

```
That is
```
AppArmour/AppArmor not on angent and not in kuber server
kubeadm@serverlinux:~$ sudo ausearch -m avc -ts recent
<no matches> zz0.64ws03dyyapzz

**Markku** · 29-12-2023, 19:17

nodePort: 30017

Based on some searching your Zabbix server service is now exposed on port 30017 for the outside world, not on the default port 10051, so you need to configure the new port on the active agent(s).

Markku

**GillezDeleuze** · 09-01-2024, 09:07

Ok, Markku, i'll try to... Thanks

Ad Widget

Can't deal with Zabbix active check

Can't deal with Zabbix active check

Comment

Comment

Comment

Comment

Comment

Comment