NVPS is too low with MariaDB 10.11 and Zabbix 5.0.41
Hi,
I have a NVPS of ~200 - 300 which is weird, prior to migrating from MariaDB 10.4 to MariaDB 10.11, our NVPS used to be ~1.2K.
I am currently using Zabbix 5.0.41 to be specific via containers.
I have 6794 Hosts, 311258 Number of Items.
I have 1 Proxy, but the server also receives ~2k of those hosts as part of its passive checks itself.
I have a server with spec of:
40 Cores and 377Gb RAM.
Below is the current configuration that I use:
Also frequently I do get this error message :
My DB MariaDB 10.11 InnoDB parameters:
Any help would be greatly appreciated.
#strugglingsoul
I have a NVPS of ~200 - 300 which is weird, prior to migrating from MariaDB 10.4 to MariaDB 10.11, our NVPS used to be ~1.2K.
I am currently using Zabbix 5.0.41 to be specific via containers.
I have 6794 Hosts, 311258 Number of Items.
I have 1 Proxy, but the server also receives ~2k of those hosts as part of its passive checks itself.
I have a server with spec of:
40 Cores and 377Gb RAM.
Below is the current configuration that I use:
Code:
-e ZBX_STARTPOLLERS=1000 -e ZBX_STARTPREPROCESSORS=300 -e ZBX_STARTPOLLERSUNREACHABLE=300 -e ZBX_MAXHOUSEKEEPERDELETE=100000 -e ZBX_STARTTRAPPERS=20 -e ZBX_STARTPINGERS=100 -e ZBX_STARTDISCOVERERS=100 -e ZBX_STARTHTTPPOLLERS=20 -e ZBX_STARTALERTERS=50 -e ZBX_CACHESIZE=10G -e ZBX_STARTDBSYNCERS=100 -e ZBX_HISTORYCACHESIZE=512M -e ZBX_HISTORYINDEXCACHESIZE=512M -e ZBX_TRENDCACHESIZE=512M -e ZBX_VALUECACHESIZE=1G -e ZBX_STARTPROXYPOLLERS=10 -e ZBX_PROXYCONFIGFREQUENCY=120
Code:
601]: ERROR [file and function: <db.c,DBget_nextid>, revision:c0c2d49, line:814] Something impossible has just happened. 601:20240228:070710.160 === Backtrace: === 601:20240228:070710.160 18: /usr/sbin/zabbix_server: discoverer #11 [processed 0 rules in 0.000000 sec, performing discovery](zbx_backtrace+0x58) [0x5555556d3dd8] 601:20240228:070710.160 17: /usr/sbin/zabbix_server: discoverer #11 [processed 0 rules in 0.000000 sec, performing discovery](DBget_maxid_num+0x256) [0x55555572f966] 601:20240228:070710.160 16: /usr/sbin/zabbix_server: discov
Code:
Name Value innodb_adaptive_flushing ON innodb_adaptive_flushing_lwm 10.000000 innodb_adaptive_hash_index OFF innodb_adaptive_hash_index_parts 8 innodb_autoextend_increment 64 innodb_autoinc_lock_mode 1 innodb_buf_dump_status_frequency 0 innodb_buffer_pool_chunk_size 251658240 innodb_buffer_pool_dump_at_shutdown ON innodb_buffer_pool_dump_now OFF innodb_buffer_pool_dump_pct 25 innodb_buffer_pool_filename ib_buffer_pool innodb_buffer_pool_load_abort OFF innodb_buffer_pool_load_at_startup ON innodb_buffer_pool_load_now OFF innodb_buffer_pool_size 16106127360 innodb_change_buffer_max_size 25 innodb_change_buffering none innodb_checksum_algorithm full_crc32 innodb_cmp_per_index_enabled OFF innodb_compression_algorithm zlib innodb_compression_default OFF innodb_compression_failure_threshold_pct 5 innodb_compression_level 6 innodb_compression_pad_pct_max 50 innodb_data_file_path ibdata1:12M:autoextend innodb_data_home_dir innodb_deadlock_detect ON innodb_deadlock_report full innodb_default_encryption_key_id 1 innodb_default_row_format dynamic innodb_defragment OFF innodb_defragment_fill_factor 0.900000 innodb_defragment_fill_factor_n_recs 20 innodb_defragment_frequency 40 innodb_defragment_n_pages 7 innodb_defragment_stats_accuracy 0 innodb_disable_sort_file_cache OFF innodb_doublewrite ON innodb_encrypt_log OFF innodb_encrypt_tables OFF innodb_encrypt_temporary_tables OFF innodb_encryption_rotate_key_age 1 innodb_encryption_rotation_iops 100 innodb_encryption_threads 0 innodb_fast_shutdown 1 innodb_fatal_semaphore_wait_threshold 600 innodb_file_per_table ON innodb_fill_factor 100 innodb_flush_log_at_timeout 1 innodb_flush_log_at_trx_commit 2 innodb_flush_method O_DIRECT innodb_flush_neighbors 1 innodb_flush_sync ON innodb_flushing_avg_loops 30 innodb_force_primary_key OFF innodb_force_recovery 0 innodb_ft_aux_table innodb_ft_cache_size 8000000 innodb_ft_enable_diag_print OFF innodb_ft_enable_stopword ON innodb_ft_max_token_size 84 innodb_ft_min_token_size 3 innodb_ft_num_word_optimize 2000 innodb_ft_result_cache_limit 2000000000 innodb_ft_server_stopword_table innodb_ft_sort_pll_degree 2 innodb_ft_total_cache_size 640000000 innodb_ft_user_stopword_table innodb_immediate_scrub_data_uncompressed OFF innodb_instant_alter_column_allowed add_drop_reorder innodb_io_capacity 200 innodb_io_capacity_max 2000 innodb_lock_wait_timeout 50 innodb_log_buffer_size 16777216 innodb_log_file_buffering ON innodb_log_file_size 536870912 innodb_log_group_home_dir ./ innodb_lru_flush_size 32 innodb_lru_scan_depth 1536 innodb_max_dirty_pages_pct 90.000000 innodb_max_dirty_pages_pct_lwm 0.000000 innodb_max_purge_lag 0 innodb_max_purge_lag_delay 0 innodb_max_purge_lag_wait 4294967295 innodb_max_undo_log_size 10485760 innodb_monitor_disable innodb_monitor_enable innodb_monitor_reset innodb_monitor_reset_all innodb_old_blocks_pct 37 innodb_old_blocks_time 1000 innodb_online_alter_log_max_size 134217728 innodb_open_files 2000 innodb_optimize_fulltext_only OFF innodb_page_size 16384 innodb_prefix_index_cluster_optimization ON innodb_print_all_deadlocks OFF innodb_purge_batch_size 300 innodb_purge_rseg_truncate_frequency 128 innodb_purge_threads 8 innodb_random_read_ahead OFF innodb_read_ahead_threshold 56 innodb_read_io_threads 64 innodb_read_only OFF innodb_read_only_compressed OFF innodb_rollback_on_timeout OFF innodb_sort_buffer_size 1048576 innodb_spin_wait_delay 4 innodb_stats_auto_recalc ON innodb_stats_include_delete_marked OFF innodb_stats_method nulls_equal innodb_stats_modified_counter 0 innodb_stats_on_metadata OFF innodb_stats_persistent ON innodb_stats_persistent_sample_pages 20 innodb_stats_traditional ON innodb_stats_transient_sample_pages 8 innodb_status_output OFF innodb_status_output_locks OFF innodb_strict_mode ON innodb_sync_spin_loops 30 innodb_table_locks ON innodb_temp_data_file_path ibtmp1:12M:autoextend innodb_tmpdir innodb_undo_directory ./ innodb_undo_log_truncate OFF innodb_undo_tablespaces 0 innodb_use_atomic_writes ON innodb_use_native_aio OFF innodb_write_io_threads 32
#strugglingsoul
Comment