Monitoring: различия между версиями

Материал из noname.com.ua
Перейти к навигацииПерейти к поиску
Строка 60: Строка 60:
 
Heka is comolex tool so data flow in Heka is described in separate documents and divided on parts
 
Heka is comolex tool so data flow in Heka is described in separate documents and divided on parts
 
* [http://wiki.sirmax.noname.com.ua/index.php/Heka Heka in general]
 
* [http://wiki.sirmax.noname.com.ua/index.php/Heka Heka in general]
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Inputs]
+
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Inputs Heka inputs details]
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Splitters]
+
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Splitters Heka Splitters ]
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Decoders]
+
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Decoders Heka Decoders]
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Debugging]
+
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Debugging Heka debuging review]
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Filter_afd_example]
+
* [http://wiki.sirmax.noname.com.ua/index.php/Heka_Filter_afd_example How to create your own Heka filter, Output and Nagios integration]

Версия 17:27, 9 февраля 2016

Monitorimg

Any complicated system need to be monitored. LMA (Logging Monitoring Alerting) Fuel Plugins provides complex logging, monitoring and alerting system for Mirantis Openstack. LMA use open-source products and can be also integrated with currently existing monitoring systems.
In this manual will be described complex configuration include 4 plugins:

  • ElasticSearch/Kibana – Log Search, Filtration and Analysis
  • LMA Collector – LMA Toolchain Data Aggregation Client
  • InfluxDB/Grafana – Time-Series Event Recording and Analysis
  • LMA Nagios – Alerting for LMA Infrastructure

(more details about MOS fuel plugins: https://www.mirantis.com/products/openstack-drivers-and-plugins/fuel-plugins/)
It is possible to use LMA-related plugins separately but the are designed to be used in complex. In this document all examples are from cloud where all 4 plugins are installed and configured.

LMA DataFlow

LMA is complex system and contains the follwing parts:

+--------------------------------+                                                                                   Grafana dashboard                      Kibana Dashboard
|Node N (compute or controller)  |                                                                                  -------------------                 ----------------------
|                                |                                                                                           ^                                       ^
|* collectd --->---+             |                                                                                           |                                       |          
|                  |             |                     +-<- Some data generated locally is looped to-<+                      |                                       |                
|                  |             |                     |    to be aggregated                          |                      |                                       |                
|*  hekad  <---<---+             |                     |                                              ^                      |                                       |                
|    |                           |       +-------------------------------------------+                |                      ^                                       |                
|    +------------->To Aggregator|------>| Heka on aggregator (Controller with VIP)  |---+------------+                      |                                       |                
|    |                           |       +-------------------------------------------+                                       |                                       |                     
|    |                           |               |to         |to            |to                                              |                                       |                   
|    |                           |               |Influx     |ElasticSearch |Nagios                                          |                                       |           
|    +---------------------------|->-------->--- +-------->--|------->------|--->---------->---------->--------------[ InfuxDB       ]                               ^
|    |                           |                           |              |                                                                                        |
|    |                           |                           |              |                                                                                        |
|    +---------------------------|------------------------>--+------->------|--->---------->---------->--------------[ ElasticSearch ]-------------------------------+
|                                |                                          |                                                                    
+--------------------------------+                                          |
                                                                            +----------------------------------------[ Nagios ]---> Alerts (e.g. email notifications)

Collectd

Collectd is collecting data, all details about collect are in separate document.

http://wiki.sirmax.noname.com.ua/index.php/Collectd

Heka

Heka is comolex tool so data flow in Heka is described in separate documents and divided on parts