Heka Debugging - История изменений

Sirmax: /* If Heka can't start */

2016-02-12T16:51:59Z

If Heka can't start

← Предыдущая		Версия 16:51, 12 февраля 2016
Строка 190:		Строка 190:

	* As you can see in example above error is related to file permissions:		* As you can see in example above error is related to file permissions:
−	{{Root\|<nowiki>## ls -lsa /etc/lma_collector/01_debug_test_decoder_data.toml	+	{{Root\|<nowiki># ls -lsa /etc/lma_collector/01_debug_test_decoder_data.toml
	4 -rwx------ 1 root root 199 Jan 31 17:06 /etc/lma_collector/01_debug_test_decoder_data.toml</nowiki>}}		4 -rwx------ 1 root root 199 Jan 31 17:06 /etc/lma_collector/01_debug_test_decoder_data.toml</nowiki>}}

Sirmax: /* Save data to file */

2016-02-09T16:25:53Z

Save data to file

← Предыдущая		Версия 16:25, 9 февраля 2016
Строка 7:		Строка 7:
	From time to time something went wrong with any software so there are a few words about debugging.		From time to time something went wrong with any software so there are a few words about debugging.
	==Save data to file==		==Save data to file==
−	The easiest way to debug is to configure ~~FileOutput (~~https://hekad.readthedocs.org/en/v0.10.0/config/outputs/file.html) and save all data in debug file.<BR>	+	The easiest way to debug is to configure [https://hekad.readthedocs.org/en/v0.10.0/config/outputs/file.html FileOutput] and save all data in debug file.<BR>
−	To encode output is used ~~RstEncoder~~ (https://hekad.readthedocs.org/en/v0.10.0/config/encoders/rst.html)	+	To encode output is used [https://hekad.readthedocs.org/en/v0.10.0/config/encoders/rst.html RstEncoder]

	To enable such debugging it is necessary to add config file, e.g /etc/lma_collector/00_debug.toml		To enable such debugging it is necessary to add config file, e.g /etc/lma_collector/00_debug.toml
Строка 92:		Строка 92:
	\| name:"openstack_release" type:string value:"2015.1.0-7.0"		\| name:"openstack_release" type:string value:"2015.1.0-7.0"
	</PRE>		</PRE>
		+
	==Debug data filtering==		==Debug data filtering==
	To avoid I/O overload if is possible to filter messages.		To avoid I/O overload if is possible to filter messages.

Sirmax в 13:41, 9 февраля 2016

2016-02-09T13:41:58Z

← Предыдущая		Версия 13:41, 9 февраля 2016
Строка 3:		Строка 3:
	[[Категория:MOS FUEL]]		[[Категория:MOS FUEL]]
	[[Категория:Linux]]		[[Категория:Linux]]
		+	[[Категория:Monitoring]]
	=Heka Debugging=		=Heka Debugging=
	From time to time something went wrong with any software so there are a few words about debugging.		From time to time something went wrong with any software so there are a few words about debugging.

Sirmax в 13:36, 9 февраля 2016

2016-02-09T13:36:19Z

← Предыдущая		Версия 13:36, 9 февраля 2016
Строка 1:		Строка 1:
		+	[[Категория:Heka]]
		+	[[Категория:LMA]]
		+	[[Категория:MOS FUEL]]
		+	[[Категория:Linux]]
	=Heka Debugging=		=Heka Debugging=
	From time to time something went wrong with any software so there are a few words about debugging.		From time to time something went wrong with any software so there are a few words about debugging.

Sirmax: /* If Heka can't start */

2016-01-31T17:35:09Z

If Heka can't start

← Предыдущая		Версия 17:35, 31 января 2016
Строка 174:		Строка 174:
	Now it is safe to run Heka manually.		Now it is safe to run Heka manually.
	* Create screen session:		* Create screen session:
		⚫	{{Root\|<nowiki>#screen</nowiki>}}


−
⚫	{{Root\|<nowiki>#screen</nowiki>}}
	* In screeen section switch into heka user		* In screeen section switch into heka user
	{{Root\|<nowiki>#sudo -H -u heka /bin/bash</nowiki>}}		{{Root\|<nowiki>#sudo -H -u heka /bin/bash</nowiki>}}
	{{Root\|<nowiki>$hekad -config /etc/lma_collector/		{{Root\|<nowiki>$hekad -config /etc/lma_collector/
	2016/01/31 17:23:39 Error reading config: open /etc/lma_collector/01_debug_test_decoder_data.toml: permission denied</nowiki>}}		2016/01/31 17:23:39 Error reading config: open /etc/lma_collector/01_debug_test_decoder_data.toml: permission denied</nowiki>}}
		+
		+
	* As you can see in example above error is related to file permissions:		* As you can see in example above error is related to file permissions:
	{{Root\|<nowiki>## ls -lsa /etc/lma_collector/01_debug_test_decoder_data.toml		{{Root\|<nowiki>## ls -lsa /etc/lma_collector/01_debug_test_decoder_data.toml
Строка 189:		Строка 190:
	{{Root\|<nowiki>#chown heka:heka /etc/lma_collector/01_debug_test_decoder_data.toml</nowiki>}}		{{Root\|<nowiki>#chown heka:heka /etc/lma_collector/01_debug_test_decoder_data.toml</nowiki>}}

−	Start heka again:	+	* Start heka again:
−	* {{Root\|<nowiki>$ hekad -config /etc/lma_collector/	+	{{Root\|<nowiki>$ hekad -config /etc/lma_collector/
	2016/01/31 17:28:13 Pre-loading: [RstEncoder]		2016/01/31 17:28:13 Pre-loading: [RstEncoder]
	2016/01/31 17:28:13 Pre-loading: [output_file]		2016/01/31 17:28:13 Pre-loading: [output_file]
Строка 412:		Строка 413:
	</nowiki>}}		</nowiki>}}

		+	So heka was successfully started and you can see debug messages.<BR>
−	{{Root\|<nowiki>#</nowiki>}}
		+	To detach from screen use ctr-a d shortcut key combination.

Sirmax: /* If Heka can't start */

2016-01-31T17:30:47Z

If Heka can't start

Внесённые изменения

Sirmax: /* If Heka can't start */

2016-01-31T17:21:03Z

If Heka can't start

← Предыдущая		Версия 17:21, 31 января 2016
Строка 153:		Строка 153:
	==If Heka can't start==		==If Heka can't start==
	If Heka is not able to start it is possible to run it manually:		If Heka is not able to start it is possible to run it manually:
		+	* Disable resorce in CRM
		+	# Run crm resource command:
		+	{{Root\|<nowiki>#crm resource
		+	crm(live)resource# list
		+	... <SKIP> ...
		+	Clone Set: clone_lma_collector [lma_collector]
		+	Started: [ node-6.domain.tld ]
		+	</nowiki>}}
		+	# Stop lma_ollector resource:
		+	{{Root\|<nowiki>#crm(live)resource# stop lma_collector
		+	crm(live)resource# stop clone_lma_collector</nowiki>}}
		+
		+	# Check lma_collector resource status. It should be stopped.
		+
		+	{{Root\|<nowiki>#crm(live)resource# list
		+	Clone Set: clone_lma_collector [lma_collector]
		+	Stopped: [ node-6.domain.tld ]
		+	</nowiki>}}

Sirmax: Новая страница: «=Heka Debugging= From time to time something went wrong with any software so there are a few words about debugging. ==Save data to file== The easiest way to debug…»

2016-01-31T17:15:27Z

Новая страница: «=Heka Debugging= From time to time something went wrong with any software so there are a few words about debugging. ==Save data to file== The easiest way to debug…»

Новая страница

=Heka Debugging=
From time to time something went wrong with any software so there are a few words about debugging.
==Save data to file==
The easiest way to debug is to configure FileOutput (https://hekad.readthedocs.org/en/v0.10.0/config/outputs/file.html) and save all data in debug file.<BR>
To encode output is used RstEncoder (https://hekad.readthedocs.org/en/v0.10.0/config/encoders/rst.html)

To enable such debugging it is necessary to add config file, e.g /etc/lma_collector/00_debug.toml
<BR>
<B>Attention: this configuration is dangerous because it will create I/O load. Please be careful with debugging on production!</B>
<PRE>
[RstEncoder]

[output_file]
type = "FileOutput"
message_matcher = "Fields[aggregator] == NIL"
path = "/var/log/heka-debug.log"
perm = "666"
flush_count = 100
flush_operator = "OR"
encoder = "RstEncoder"
</PRE>
Example of output:

<PRE>
tail -100 /var/log/heka-debug.log
... <SKIP> ...
:Timestamp: 2016-01-31 16:58:42.232999936 +0000 UTC
:Type: metric
:Hostname: node-6
:Pid: 5505
:Uuid: 2a73fa6f-21fc-40b0-acf9-7fe96bcb9b80
:Logger: collectd
:Payload: {"type":"gauge","values":[0],"type_instance":"q-agent-notifier-dvr-update_fanout_57e5b132e51840ebb6.messages","meta":{"0":true},"dsnames":["value"],"plugin":"rabbitmq_info","time":1454259522.233,"interval":10,"host":"node-6","dstypes":["gauge"],"plugin_instance":""}
:EnvVersion:
:Severity: 6
:Fields:
| name:"type" type:string value:"gauge"
| name:"source" type:string value:"rabbitmq_info"
| name:"openstack_release" type:string value:"2015.1.0-7.0"
| name:"deployment_mode" type:string value:"ha_compact"
| name:"openstack_roles" type:string value:"primary-controller"
| name:"queue" type:string value:"q-agent-notifier-dvr-update_fanout_57e5b132e51840ebb6"
| name:"tag_fields" type:string value:"queue"
| name:"openstack_region" type:string value:"RegionOne"
| name:"name" type:string value:"rabbitmq_queue_messages"
| name:"hostname" type:string value:"node-6"
| name:"value" type:double value:0
| name:"deployment_id" type:string value:"3"
| name:"environment_label" type:string value:"test2"
| name:"interval" type:double value:10

:Timestamp: 2016-01-31 16:58:42 +0000 UTC
:Type: test_decoder
:Hostname: node-6
:Pid: 0
:Uuid: bbc94442-67c8-4445-acf8-341b14c2d43f
:Logger: test_input
:Payload:
:EnvVersion:
:Severity: 7
:Fields:
| name:"test_decoderData" type:string value:"888999888"
| name:"test_decoderCount" type:double value:1212
| name:"test_decoderDataToNumber" type:double value:8.88999888e+08

:Timestamp: 2016-01-31 16:58:42 +0000 UTC
:Type: log
:Hostname: node-6
:Pid: 11905
:Uuid: 36cfae57-cb3e-4777-a886-60a351fb230c
:Logger: pacemaker
:Payload: cib_process_ping: Reporting our current digest to node-6.domain.tld: 70954c66c71f324b3851af4d92ef93dd for 0.90.152 (0x1c12960 0)

:EnvVersion:
:Severity: 7
:Fields:
| name:"deployment_mode" type:string value:"ha_compact"
| name:"environment_label" type:string value:"test2"
| name:"openstack_region" type:string value:"RegionOne"
| name:"deployment_id" type:string value:"3"
| name:"severity_label" type:string value:"DEBUG"
| name:"programname" type:string value:"cib"
| name:"openstack_roles" type:string value:"primary-controller"
| name:"openstack_release" type:string value:"2015.1.0-7.0"
</PRE>
==Debug data filtering==
To avoid I/O overload if is possible to filter messages.
To filter data only from test_decoder and save it into the /var/log/heka-debug-test-decoder.log file is used the following configuration:
<PRE>
01_debug_test_decoder_data.toml

[output_file]
type = "FileOutput"
message_matcher = "Type == 'test_decoder'"
path = "/var/log/heka-debug-test-decoder.log"
perm = "666"
flush_count = 100
flush_operator = "OR"
encoder = "RstEncoder"
</PRE>
Remark: depends on your current Heka configuration you may need to enable RstEncoder. In this example it is already enabled in 00_debug.toml file.

Example of output:
<PRE>
:Timestamp: 2016-01-31 17:07:16 +0000 UTC
:Type: test_decoder
:Hostname: node-6
:Pid: 0
:Uuid: 38ffa77b-8f5c-4f73-aba5-f5de1f15f0b8
:Logger: test_input
:Payload:
:EnvVersion:
:Severity: 7
:Fields:
| name:"test_decoderData" type:string value:"888999888"
| name:"test_decoderCount" type:double value:29
| name:"test_decoderDataToNumber" type:double value:8.88999888e+08

:Timestamp: 2016-01-31 17:07:17 +0000 UTC
:Type: test_decoder
:Hostname: node-6
:Pid: 0
:Uuid: 1545163c-cc97-46aa-aba8-431ab6ca3338
:Logger: test_input
:Payload:
:EnvVersion:
:Severity: 7
:Fields:
| name:"test_decoderData" type:string value:"888999888"
| name:"test_decoderCount" type:double value:30
| name:"test_decoderDataToNumber" type:double value:8.88999888e+08

:Timestamp: 2016-01-31 17:07:18 +0000 UTC
:Type: test_decoder
:Hostname: node-6
:Pid: 0
:Uuid: 5da75795-63fd-48f8-ac52-44db368f54ed
:Logger: test_input
:Payload:
:EnvVersion:
:Severity: 7
:Fields:
| name:"test_decoderData" type:string value:"888999888"
| name:"test_decoderCount" type:double value:31
| name:"test_decoderDataToNumber" type:double value:8.88999888e+08
</PRE>

==If Heka can't start==
If Heka is not able to start it is possible to run it manually: