Zabbix server crashed

[smacdoug]

Shortly after upgrading to 2.2 and configuring some new hosts, the server crashed with this error:

4221:20140123:095639.846 [file:strpool.c,line:53] zbx_mem_realloc(): please increase CacheSize configuration parameter

I changed the CacheSize parameter to the maximum of 2G, and also increased the momory allocated to the VM on which Zabbix is running to 4G. However the Zabbix server still won't start.

[zillions]

Did you reboot the server after the memory upgrade?

Are you seeing any other issues/alerts in the logs?

How is your resource utilization looking, still have free memory?

Could you please post the lines of the zabbix_server.log from when you try to restart the service?

[smacdoug]

Yes, I've triedzabbix_server.log all those things. When I try to start the server today, nothing appears in the zabbix_server.log file. I've looked in a few other logs, but nothing stands our.

I tried re-installing the packages, but it failed with

Error: Sub-process /usr/bin/dpkg returned an error code (1)

As for the resources, I have over 3GB free in memory on my VM.

[zillions]

Are you running a separate DB server? What kind of DB? I only have experience with MySQL for the backend.
Probably obvious, but double check that the DB is running, and see if you're getting any errors or anything when you try to start that service. Also, when you did the upgrade, my understanding is that the upgrade extends the schema, were there any issues with that in the logs?

I don't have much experience in your specific scenario, but I would start at the bottom, verify each piece and work upwards. Like make sure the DB starts ok, make sure no errors, then try remotely connecting to it via console with the account that Zabbix uses. Then when that works, start trying to get the frontend connected to it, watch the logs, verify that the services are running, etc...

Sorry I don't have more detailed advice. We are only a week or so from doing our own upgrade from 2.0.5 to 2.2.0, so if we run into any issues I'll post them here.

[smacdoug]

I reinstalled Zabbix on a clean system and restored the db from the previous install. Everything worked for a few days till today when it crashed again. Nothing is logged when I tried to restart. I had the increase CacheSize advice in the log before it stopped, so I increased it to the maximum again and restarted, but the server won't start.

[zillions]

Is your DB running out of space, do you have housekeeper or another cleanup utility setup?

[jeffc]

FYI we are seeing the same issue, we have an open bug on it but no traction yet. We just (a few minutes ago) installed zabbix 2.2.2RC1 and waiting to see if this helps us at all.

Let us know if you are able to resolve this elsewhere, we will do the same.

[jeffc]

Forgot to include the bug report https://support.zabbix.com/browse/ZBX-7566