JSON Logging with Elasticsearch Radu Gheorghe search statistics - - PowerPoint PPT Presentation

▶

Nov 13, 2023 6 likes •186 views

JSON Logging with Elasticsearch Radu Gheorghe search statistics Where do your logs end up? Elasticsearch fast Splunk MongoDB file system scalable other logstash Kibana graylog logstash rsyslog graylog fluentd Elasticsearch Head

SLIDE 1

JSON Logging with Elasticsearch

Radu Gheorghe

SLIDE 2

SLIDE 3

search statistics

SLIDE 4

Elasticsearch Splunk MongoDB file system

ther

Where do your logs end up? fast scalable

SLIDE 5

logstash graylog rsyslog fluentd Apache Flume Kibana logstash graylog Elasticsearch Head

SLIDE 6

www

200M

6 minutes @10K/s

SLIDE 7

now later

SLIDE 8

SLIDE 9

SLIDE 10

Kibana

SLIDE 11

Mike 20 mouse 0

time error code userID item

{ "userID": "Mike", "time": 20, "item": "mouse", "errorCode": 0 }

SLIDE 12

Mike 20 mouse 0

filter { grok { type => "unstructured" pattern => "%{WORD:userID} %{NUMBER:time} %{WORD:item} %{NUMBER:errorCode}" } }

{ "userID": "Mike", "time": 20, "item": "mouse", "errorCode": 0 }

SLIDE 13

{ "userID": "Mike", "time": 20, "item": "mouse", "errorCode": 0 }

Mike 20 mouse firefox 0

filter { grok { type => "unstructured" pattern => "%{WORD:user} %{NUMBER:time} %{WORD:item} %{NUMBER:errorCode}" } }

SLIDE 14

{ "userID": "Mike", "time": 20, "item": "mouse", "errorCode": 0 } @cee:

SLIDE 15

SLIDE 16

search statistics

L O G S E N E

SLIDE 17

We're hiring!

Dig Search? Dig Big Data? Dig open–source? We’re hiring world–wide! http://sematext.com/about/jobs.html

SLIDE 18

Thank you!

radu.gheorghe@ .com http://sematext.com @sematext http://blog.sematext.com

BETA: http://sematext.com/logsene/

42% off all MEAPs at http://manning.com/

12mp25