Why do we need HTTP data collection
Data collection on objects in your system can be used for multiple reasons:

• Internal status monitoring
• Trends analysis & history collection
• Counters and states based event generation

and more... The common uses of the HTTP data collection agent is for advanced correlations on data located on web sites in a format of html pages. This is not such an organized format as the CSV format, however you can use regular expressions to extract data from it. For these files history values as well as change notifications can be very important.

The HTTP data collection agent is built for large scale operations. It can collect information from many HTML pages in distant locations concurrently.

The product allows defining event triggers based on the data collected. The event triggers will launch a user defined command, which for example can be an SNMP trap or any other command.

The agent was built to perform this operation very fast using asynchronous operations and complex algorithms. The agent does not wait for a response from a given node to monitor other nodes.

It contains many flow control parameters that enables it to work in all kinds of networks.
The agent supports on the node level:

• Monitoring frequency
• Monitoring hours

and more...