Heka Decoders - История изменений

Sirmax: /* Heka Decoders */

2016-02-09T16:22:01Z

Heka Decoders

← Предыдущая		Версия 16:22, 9 февраля 2016
Строка 5:		Строка 5:
	[[Категория:Monitoring]]		[[Категория:Monitoring]]
	=Heka Decoders=		=Heka Decoders=
−	Decoders parse the contents of the inputs to extract data from the text format and map them onto a Heka message schema. List of all available decoders: https://hekad.readthedocs.org/en/v0.10.0/config/decoders/index.html	+	Decoders parse the contents of the inputs to extract data from the text format and map them onto a Heka message schema. List of all available decoders is [https://hekad.readthedocs.org/en/v0.10.0/config/decoders/index.html here]
	<BR> On controller we have the follwing decoders configured:		<BR> On controller we have the follwing decoders configured:
	* decoder-collectd.toml		* decoder-collectd.toml

Sirmax: /* SandboxDecoder simple example */

2016-02-09T16:10:44Z

SandboxDecoder simple example

← Предыдущая		Версия 16:10, 9 февраля 2016
Строка 23:		Строка 23:

	==SandboxDecoder simple example==		==SandboxDecoder simple example==
−	Sandbox ~~documentation:~~ https://hekad.readthedocs.org/en/v0.10.0/sandbox/index.html	+	Sandbox [https://hekad.readthedocs.org/en/v0.10.0/sandbox/index.html documentation]
	<BR> Sandbox decoder is complex part of Heka, so for better understanding there it is possible to create simple input and simple decoder.		<BR> Sandbox decoder is complex part of Heka, so for better understanding there it is possible to create simple input and simple decoder.
	Idea is		Idea is
Строка 93:		Строка 93:
	</PRE>		</PRE>

−	More details related to ~~Lua Sandbox :~~ https://hekad.readthedocs.org/en/v0.10.0/sandbox/index.html~~<BR>~~	+	More details related to [https://hekad.readthedocs.org/en/v0.10.0/sandbox/index.html Lua Sandbox]
		+	<BR>
	Please pay your attention on restrictions: e.g. print and io functions are not available in Lua Sandbox		Please pay your attention on restrictions: e.g. print and io functions are not available in Lua Sandbox

Sirmax в 13:42, 9 февраля 2016

2016-02-09T13:42:58Z

← Предыдущая		Версия 13:42, 9 февраля 2016
Строка 3:		Строка 3:
	[[Категория:MOS FUEL]]		[[Категория:MOS FUEL]]
	[[Категория:Linux]]		[[Категория:Linux]]
		+	[[Категория:Monitoring]]
	=Heka Decoders=		=Heka Decoders=
	Decoders parse the contents of the inputs to extract data from the text format and map them onto a Heka message schema. List of all available decoders: https://hekad.readthedocs.org/en/v0.10.0/config/decoders/index.html		Decoders parse the contents of the inputs to extract data from the text format and map them onto a Heka message schema. List of all available decoders: https://hekad.readthedocs.org/en/v0.10.0/config/decoders/index.html

Sirmax в 13:37, 9 февраля 2016

2016-02-09T13:37:31Z

← Предыдущая		Версия 13:37, 9 февраля 2016
Строка 1:		Строка 1:
		+	[[Категория:Heka]]
		+	[[Категория:LMA]]
		+	[[Категория:MOS FUEL]]
		+	[[Категория:Linux]]
	=Heka Decoders=		=Heka Decoders=
	Decoders parse the contents of the inputs to extract data from the text format and map them onto a Heka message schema. List of all available decoders: https://hekad.readthedocs.org/en/v0.10.0/config/decoders/index.html		Decoders parse the contents of the inputs to extract data from the text format and map them onto a Heka message schema. List of all available decoders: https://hekad.readthedocs.org/en/v0.10.0/config/decoders/index.html

Sirmax: /* Decoder */

2016-01-31T16:44:06Z

Decoder

← Предыдущая		Версия 16:44, 31 января 2016
Строка 44:		Строка 44:
	</PRE>		</PRE>
	Decoder code is not so complex:		Decoder code is not so complex:
−	<syntaxhighlight lang="lua"> require "string"	+	<syntaxhighlight lang="lua">require "string"

	local msg = {		local msg = {

Sirmax: /* Decoder */

2016-01-31T16:43:49Z

Decoder

← Предыдущая		Версия 16:43, 31 января 2016
Строка 43:		Строка 43:
	filename = "/usr/share/lma_collector/decoders/test_decoder.lua"		filename = "/usr/share/lma_collector/decoders/test_decoder.lua"
	</PRE>		</PRE>
−
−
	Decoder code is not so complex:		Decoder code is not so complex:
−	<syntaxhighlight lang="lua">	+	<syntaxhighlight lang="lua"> require "string"
−	require "string"

	local msg = {		local msg = {

Sirmax: /* Decoder */

2016-01-31T16:43:23Z

Decoder

← Предыдущая		Версия 16:43, 31 января 2016
Строка 45:		Строка 45:


−	Decoder code is not so complex	+	Decoder code is not so complex:
	<syntaxhighlight lang="lua">		<syntaxhighlight lang="lua">
	require "string"		require "string"
Строка 62:		Строка 62:
	msg.Fields.test_decoderData = data		msg.Fields.test_decoderData = data
	msg.Fields.test_decoderCount = count		msg.Fields.test_decoderCount = count
		+	msg.Fields.test_decoderDataToNumber = tonumber(data)
	inject_message(msg)		inject_message(msg)
	return 0		return 0
Строка 67:		Строка 68:
	</syntaxhighlight>		</syntaxhighlight>

		+	This decoder reads input data and creates message contains 2 fields:
		+	* test_decoderDataToNumber - data from input message converted from string into number
		+	* test_decoderCount - count of decoded messages since heka start
		+	* test_decoder - data "as is"

		+
		+	Outut example in debug log:
	<PRE>		<PRE>
	:Timestamp: 2016-01-30 22:28:04 +0000 UTC		:Timestamp: 2016-01-30 22:28:04 +0000 UTC
Строка 79:		Строка 86:
	:Severity: 7		:Severity: 7
	:Fields:		:Fields:
		+	\| name:"test_decoderData" type:double value:8.88999888e+08
	\| name:"test_decoderData" type:string value:"888999888"		\| name:"test_decoderData" type:string value:"888999888"
	\| name:"test_decoderCount" type:double value:34		\| name:"test_decoderCount" type:double value:34
	</PRE>		</PRE>
		+
		+	More details related to Lua Sandbox : https://hekad.readthedocs.org/en/v0.10.0/sandbox/index.html<BR>
		+	Please pay your attention on restrictions: e.g. print and io functions are not available in Lua Sandbox

Sirmax: /* Decoder */

2016-01-31T16:33:23Z

Decoder

← Предыдущая		Версия 16:33, 31 января 2016
Строка 44:		Строка 44:
	</PRE>		</PRE>

		+
		+	Decoder code is not so complex
	<syntaxhighlight lang="lua">		<syntaxhighlight lang="lua">
	require "string"		require "string"

Sirmax: /* Decoder */

2016-01-31T16:13:01Z

Decoder

@@ Строка 41: / Строка 41: @@
 [test_decoder]
 type = "SandboxDecoder"
-filename = "/usr/share/lma_collector/decoders/test.lua"
+filename = "/usr/share/lma_collector/decoders/test_decoder.lua"
 </PRE>
 <syntaxhighlight lang="lua">
 require "string"
 local msg = {
-    Type = "test.mm.decoder",
+    Type = "test_decoder",
     Payload = nil,
     Fields = {}
+}
 function process_message ()
     count = count + 1
     local data = read_message("Payload")
-    msg.Fields.mmData  = data
+    msg.Fields.test_decoderData  = data
-    msg.Fields.mmCount = count
+    msg.Fields.test_decoderCount = count
     inject_message(msg)
     return 0
 end

Sirmax: /* Decoder */

2016-01-31T16:05:02Z

Decoder

@@ Строка 39: / Строка 39: @@
 Decoder in general are getting data from input plugins and convert it into Heka internal format.
 <PRE>
 type = "SandboxDecoder"
-filename = "/usr/share/lma_collector/decoders/mm.lua"
+filename = "/usr/share/lma_collector/decoders/test.lua"
 </PRE>