GrayLog for Java developers Track Monitoring & Cloud Jos - - PowerPoint PPT Presentation

▶
graylog for java developers
SMART_READER_LITE
LIVE PREVIEW

GrayLog for Java developers Track Monitoring & Cloud Jos - - PowerPoint PPT Presentation

Feb 18, 2023 352 likes •939 views

GrayLog for Java developers Track Monitoring & Cloud Jos Manuel Ortega @jmortegac Agenda Introduction to graylog Docker image & compose Graylog Architecture Connecting with Java Connecting with other services

slide-1
SLIDE 1

GrayLog for Java developers

Track Monitoring & Cloud

José Manuel Ortega

slide-2
SLIDE 2

@jmortegac

slide-3
SLIDE 3

Agenda

  • Introduction to graylog
  • Docker image & compose
  • Graylog Architecture
  • Connecting with Java
  • Connecting with other services
slide-4
SLIDE 4

GrayLog Open Source Log Management http://www.graylog.org/ http://docs.graylog.org/

slide-5
SLIDE 5

Graylog features

  • Graylog is an open source logs monitor capable
  • f handling messages from different sources:
  • Application servers: IBM Websphere, Weblogic,

Jboss

  • Framework Applications: JAVA EE, NodeJS,

Python, C#

  • Web Servers: Nginx, Apache
slide-6
SLIDE 6

Install

  • Debian / Ubuntu (deb package)
  • RedHat / CentOS (RPM package)
  • Virtual Machine (OVA / Vagrant)
  • Config management (Chef / Puppet / Ansible)
  • Docker image && docker compose
slide-7
SLIDE 7

https://packages.graylog2.org/appliances/ova

slide-8
SLIDE 8

Docker images

slide-9
SLIDE 9
slide-10
SLIDE 10
slide-11
SLIDE 11

Docker compose

slide-12
SLIDE 12
slide-13
SLIDE 13
slide-14
SLIDE 14
slide-15
SLIDE 15

Graylog features

  • Receives messages from multiple input protocols

GELF via HTTP/UDP/TCP, Syslog, Apache Kafka, ....

  • Assigns messages to streams
  • Triggers user-defined alerts per stream
  • Routes messages to different outputs based on streams
  • Stores messages in ElasticSearch for graphing
  • Uses MongoDB to store metadata and alerts
  • Provides search and graphing capabilities for stored

messages

slide-16
SLIDE 16

Graylog features

  • Streams: They are message routing mechanisms in categories.
  • Alerts: Graylog allows to define alerts that are launched when

match with configured conditions.

  • Dashboards: Control panel where you can visualize everything

that happens in the monitored systems.

  • Searches: Graylog provides a search system on the historical from

where to locate the messages that help to react before problems.

  • Security: Allows you to set permissions to users to restrict the

access, display and search for messages.

slide-17
SLIDE 17
slide-18
SLIDE 18

ElasticSearch indexes

slide-19
SLIDE 19

ElasticSearch indexes

slide-20
SLIDE 20

Inputs

slide-21
SLIDE 21

Streams

  • Incoming messages can be grouped
  • Can be used for to assign user permissions
  • Stream alerts can send out notifications
slide-22
SLIDE 22
slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25
slide-26
SLIDE 26
slide-27
SLIDE 27

GrayLog architecture

slide-28
SLIDE 28
slide-29
SLIDE 29
slide-30
SLIDE 30
slide-31
SLIDE 31

Connecting with Java

slide-32
SLIDE 32

Sending log data to graylog

  • Syslog

– TCP, TCP+TLS, UDP, AMQP, Kafka

  • GELF

– TCP, TCP+TLS, UDP, HTTP, AMQP,Kafka

  • Raw / Plain Text

– TCP, TCP+TLS, UDP, AMQP, Kafka

  • Collector

– TCP, TCP+TLS

slide-33
SLIDE 33

GELF

  • Graylog Extended Log Format
  • Logstash, fluentd, nxlog, Docker, …
  • Based in syslog and rsyslog
  • JSON based format for sending structured

data

  • JSON Hash with mandatory fields:

○ host, version, short_message,

full_message, timestamp, level

slide-34
SLIDE 34

GELF document

slide-35
SLIDE 35

Graylog message inspector

slide-36
SLIDE 36
slide-37
SLIDE 37
slide-38
SLIDE 38
slide-39
SLIDE 39

Jars

slide-40
SLIDE 40
slide-41
SLIDE 41
slide-42
SLIDE 42
slide-43
SLIDE 43
slide-44
SLIDE 44
slide-45
SLIDE 45

LogBack

  • https://github.com/pukkaone/logback-gelf
  • JDK >= 1.7
slide-46
SLIDE 46

LogBack

slide-47
SLIDE 47

LogBack appender

slide-48
SLIDE 48

GraylogRestInterface

slide-49
SLIDE 49

GelfMessage

slide-50
SLIDE 50

Connecting with other services

slide-51
SLIDE 51
slide-52
SLIDE 52
slide-53
SLIDE 53
slide-54
SLIDE 54
slide-55
SLIDE 55
slide-56
SLIDE 56

References

  • http://docs.graylog.org/en/2.4/index.html
  • https://github.com/Graylog2/graylog-docker
  • https://hub.docker.com/r/graylog2/graylog/
  • http://docs.graylog.org/en/2.4/pages/installation/

docker.html

  • http://docs.graylog.org/en/2.4/pages/faq.html
slide-57
SLIDE 57

Thanks!

Contact: @jmortegac jmortega.github.io about.me/jmortegac