Monitoring Log files

[WagnerEits]

I have several log files generated by nfDump. And I need the best solution to monitor them, and generate graphs with the data, what would be the most effective method to do this collection? Are many data generated. I have four hosts, each one generates a large amount of data in a log file. I am currently using zabbix agent active checks, but I can monitor only one host because I have to put its name in the agent configuration file. Is there a better way to do this collection?

Hostname in zabbix_agent.conf


list of hosts to be monitored

[allexpetrov]

I have several log files generated by nfDump. And I need the best solution to monitor them, and generate graphs with the data, what would be the most effective method to do this collection? Are many data generated. I have four hosts, each one generates a large amount of data in a log file. I am currently using zabbix agent active checks, but I can monitor only one host because I have to put its name in the agent configuration file. Is there a better way to do this collection?

Hostname in zabbix_agent.conf
[ATTACH]10036[/ATTACH]

list of hosts to be monitored
[ATTACH]10037[/ATTACH]

Check this link, please -> http://imgur.com/a/5yG10

You need agent installed on each host!

[WagnerEits]

The hosts are actually routers, I can not install the agent on routers, the data is collected from the routers, and all sent to a main server (which has the agent installed), there is a better way to do this log file monitoring ?

[allexpetrov]

The hosts are actually routers, I can not install the agent on routers, the data is collected from the routers, and all sent to a main server (which has the agent installed), there is a better way to do this log file monitoring ?

Ok then, lets start from another side:

1. Router Models ?
2. The way how you can actually read the log file? Web? SSH?

For example,
the easiest way would be something like using external syslog for the logging and then, using Zabbix Agent, read this log file (search for specific strings) and notify you with a Trigger if the error appears.

Regards,
Alex!

[WagnerEits]

In my case I'm not looking for error messages, but for the whole log. I am using NFDUMP / NFPCAD to control the network flow of each router and write to a log file, these files are all sent to a main server, where I currently read the log, is working perfectly but with only one router , Because I put his name on the hostname

[allexpetrov]

In my case I'm not looking for error messages, but for the whole log. I am using NFDUMP / NFPCAD to control the network flow of each router and write to a log file, these files are all sent to a main server, where I currently read the log, is working perfectly but with only one router , Because I put his name on the hostname

Correct me if I'm wrong - you are monitoring the network performance and statistics?

[WagnerEits]

No, I'm monitoring the network flow. In the log file I have multiple destination IP source IP data and bytes per second. Based on this I have to monitor this log and from regular expressions generate ratios with the top 10 of applications with more flow per minute. This is ready, but only collecting data from a router

[WagnerEits]

Correct me if I'm wrong - you are monitoring the network performance and statistics?

The goal is to capture data from netflow v5 and v9