Monasca Project Update Shanghai Open Infrastructure Summit Witek - - PowerPoint PPT Presentation

▶
monasca
SMART_READER_LITE
LIVE PREVIEW

Monasca Project Update Shanghai Open Infrastructure Summit Witek - - PowerPoint PPT Presentation

Feb 27, 2024 479 likes •680 views

N o v e mb e r 2 0 1 9 Monasca Project Update Shanghai Open Infrastructure Summit Witek Bedyk (irc: witek) What does Monasca do? Monitoring-as-a-Service multi-tenant high-performant HA / fault tolerant scalable

slide-1
SLIDE 1

Monasca

Project Update Shanghai Open Infrastructure Summit

Witek Bedyk (irc: witek) N

  • v

e mb e r 2 1 9

slide-2
SLIDE 2

What does Monasca do?

  • Monitoring-as-a-Service
  • multi-tenant
  • high-performant
  • HA / fault tolerant
  • scalable
  • PUSH model
  • Amazon CloudWatch equivalent
slide-3
SLIDE 3
slide-4
SLIDE 4

C

  • mp

a r i s

  • n

Monasca Prometheus Telemetry model push pull push multi-tenant +

  • +

HA + ○ + scalability + ○ + historical data + ○ + alerting API YAML API delivery guarantee +

  • high-performant

+ +

  • query language

+ ++ + community small large maintanace

https://www.openstack.org/summit/denver-2019/summit-schedule/events/23646/monasca-openstack-monitoring

slide-5
SLIDE 5

M a i n C

  • n

t r i b u t

  • r

s

slide-6
SLIDE 6

T r a i n Wo r k

N

  • v

e mb e r 2 1 9

slide-7
SLIDE 7

Middleware Upgrade

  • InfmuxDB 1.7.6

– Time Series Index introduced to support

millions of unique time series

– security fjxes

  • Apache Kafka 2.0.1
  • Apache Storm 1.2.2

https://storyboard.openstack.org/#!/story/2005624

slide-8
SLIDE 8

M e t r i c s + L

  • g

s + N

  • t

i fj c a t i

  • n

s

  • L
  • g

s / N

  • t

i fj c a t i

  • n

s a n d M e t r i c s a r e c

  • m

p l e m e n t a r y

  • P

r

  • v

i d e S i n g l e P a n e

  • f

G l a s s

  • C
  • r

r e l a t e d i fg e r e n t s

  • u

r c e s

  • f

i n f

  • r

m a t i

  • n
  • D

e r i v e e v e n t

  • b

a s e d m e t r i c s

  • S

y s t e m p e r f

  • r

m a n c e

  • U

t i l i z a t i

  • n
  • S

t a t u s / E r r

  • r

s

M e t r i c s L

  • g

s N

  • t

i fj c a t i

  • n

s

slide-9
SLIDE 9

M e r g e A P I s

  • R

e d u c e t e c h n i c a l d e b t

  • S

a m e u s e r e x p e r i e n c e

  • E

a s i e r d e p l

  • y

m e n t a n d

  • p

e r a t i

  • n

h t t p s : / / s t

  • r

y b

  • a

r d .

  • p

e n s t a c k .

  • r

g / # ! / s t

  • r

y / 2 3 8 8 1

slide-10
SLIDE 10

Apache Kafka client upgrade

  • All components can now use confmuent-kafka-python library
  • Uses asynchronous interface for better performance

– producer

x10 higher throughput

– consumer x6 higher throughput

  • legacy_kafka_client_enabled

has to be set to false

https://storyboard.openstack.org/#!/story/2005624

slide-11
SLIDE 11

Other work

  • Create Docker images in OpenDev CI

– https://storyboard.openstack.org/#!/story/2001694

  • Add time-range scoping for dimension queries

– https://storyboard.openstack.org/#!/story/2006204

  • Add templating support for Slack notifjcations

– https://storyboard.openstack.org/#!/story/2001308

  • Use separate databases for tenants (InfmuxDB)

– https://storyboard.openstack.org/#!/story/2006331 (work in progress)

slide-12
SLIDE 12

Community-wide goals

  • Update Python 3 test runtimes
  • Enabling PDF generation support

– https://storyboard.openstack.org/#!/story/2006097

slide-13
SLIDE 13

U s s u r i p l a n s

N

  • v

e mb e r 2 1 9

slide-14
SLIDE 14

New Thresholding Engine

  • Faust – Python Stream Processing library

– highly-available – distributed – fast and fmexible

  • Works with Apache Kafka

– no Apache Storm dependency

  • Library evaluated and prototype implemented

– https://storyboard.openstack.org/#!/story/2001308

  • Will support threshold and event based alerts
slide-15
SLIDE 15

Planned features & enhancements for Ussuri

  • Monasca Events Agent
  • InfmuxDB HA setup
  • Extended query capabilities
  • Use Keystone’s application credentials in Grafana
  • IPv6 support

http://specs.openstack.org/openstack/monasca-specs/priorities/ussuri-priorities.html

slide-16
SLIDE 16

We w a n t y

  • u

r f e e d b a c k

  • M

a i l i n g l i s t ( p l e a s e a d d [ m

  • n

a s c a ] t a g )

  • p

e n s t a c k

  • d

i s c u s s @l i s t s .

  • p

e n s t a c k .

  • r

g

  • I

R C a t f r e e n

  • d

e #

  • p

e n s t a c k

  • m
  • n

a s c a

  • We

e k l y t e a m m e e t i n g We d n e s d a y s 1 5 U T C #

  • p

e n s t a c k

  • m
  • n

a s c a h t t p : / / e a v e s d r

  • p

.

  • p

e n s t a c k .

  • r

g / # M

  • n

a s c a _ T e a m _ M e e t i n g

slide-17
SLIDE 17

H

  • w

t

  • c
  • n

t r i b u t e

  • K

a n b a n b

  • a

r d ( b a c k l

  • g

, r e v i e w s ) h t t p s : / / s t

  • r

y b

  • a

r d .

  • p

e n s t a c k .

  • r

g / # ! / b

  • a

r d / 1 9

  • B

u g fj x e s

  • C

r

  • s

s

  • P

r

  • j

e c t I n t e g r a t i

  • n

s

  • I

n s t a l l e r s

  • D
  • c

u m e n t a t i

  • n
slide-18
SLIDE 18

M

  • n

a s c a i n D e n v e r

  • E

ffjc i e n t M

  • n

i t

  • r

i n g a n d R

  • t

C a u s e A n a l y s i s i n C

  • mp

l e x S y s t e ms T u e 3 : 2 p m – 6

t h

F l

  • r

, 6 1 9

  • P

T G – M

  • n

a s c a P r

  • j

e c t O n b

  • a

r d i n g We d 1 : 3 p m – M i t a k a

slide-19
SLIDE 19

@OpenStack

THANKS.

Questions?

  • penstack
  • penstack

OpenStackFoundation