Large setup suggestions

[pa5nt]

Hi.
at the moment we are using a number of tools.
prtg for network monitoring
grafana for nice graphs
and a tool in house made based on eraly used in house build tools.


the network is build up of Juniper SRX gateways and routers and here and ther some 4G and dsl vigor modems nothing special.

grafana is used for displaying some important graphs and numbers.

the inhouse build tool handles 150000 items via snmp and via different type of pollers(sort of proxy).
the pollers connect via iptunnels with lantronix to rs485 and rs232 devices and stores this in a database. and items a presented to a homemade snmp agent.

the problem is that this tool is slow and not fun to work with and is the child of our main sw developer.
luckly i am not the only one who thinks that the tools are crap.

i would like to convert to zabbix V5 and not looking for a quote but a general specs in hardware and other thing i need to considerg before i go for the "kill"

- items 150000+ adding more every day .
- hosts 500+ adding more every week.
- item update rate 60sec some less.
- in case of a failure backupserver off site ? HA ?? all ideas al welcome

database size ?
server hardware ?
memory ??
ssd choose
splitting datase server/front end server ?

many thans in advance


Joost.

[Hamardaban]

Here is a description of the system requirements https://www.zabbix.com/documentation...n/requirements
The main focus should be on the database. use the version that you know how to work with. Use partitioning tables.
In advance, no one will ever tell you how much database you will need-it depends on the type of data collected, the survey period and the time of data storage and trends. but if you know how to increase the space for data in the database - there are no problems.
The system itself is modular and components can run on different servers https://www.zabbix.com/documentation...ction/overview
Before using it, I highly recommend reading the documentation.

[pa5nt]

Thanks for you reply.
i know it is to difficult to have a simple answer.
zabbix is just to nice to ignore ;-)

happy holidays.
Joost .

[Hamardaban]

Simple answers end when you move from arithmetic to algebra.

add thing about HA https://blog.zabbix.com/zabbix-ha-cluster-setups/8264/

[Zdenek_OMNISENSUIT]

Hello

About your requirements:

- items 150000+ adding more every day -> do you really need all of them? Number of items and frequency of checks make your performance needs.
- hosts 500+ adding more every week -> not so big deal
- item update rate 60sec some less -> is this really need for every checks? If not use some bigger interval, if needed you can use Preprocessing - discard unchanged with heartbeat - your db will store less data nad will have less performance problems.
- in case of a failure backupserver off site ? HA ?? all ideas al welcome -> it can be done very simple with VIP for you active/stby zabbix app os cluster with Pacemaker and Corosync with HA proxy handling your connection to database - for example active-active 3node MariaDB cluster, HAproxy targeting one node with healthcheck and transfer connection to next node in case of problem. DB should be tuned fine, logs, ram etc. You should use SSD and separate FS for your db logs, data etc. You can make backups with extrabackup or snapshots etc.

HW/etc - for example: vm linux systems with 4vCPU/16GB RAM, centos, mariadb, separate web&app and DB server, cca 1200hosts/50000items/17000triggers - nvps 410 - without proxy server and cpu usage is minimal ... -> proxy server/s can help you with performance/network/security problems


-------------------------
omnisensuit.com

[Herobot]

Here is a description of the system requirements https://www.zabbix.com/documentation...n/requirements
The main focus should be on the database. use the version that you know how to work with. Use partitioning tables.
In advance, no one will ever tell you how much database you will need-it depends on the type of data collected, the survey period and the time of data storage and trends. but if you know how to increase the space for data in the database - there are no problems.
The system itself is modular and components can run on different servers https://www.zabbix.com/documentation...ction/overview
Before using it, I highly recommend reading the documentation.

Thanks for the information keep sharing such informative post keep suggesting such post.


IndigoCard