FAULT TOLERANCE WITH PROXYSQL, MRM AND CONSUL ABOUT ME NARCS - - PowerPoint PPT Presentation

fault tolerance
SMART_READER_LITE
LIVE PREVIEW

FAULT TOLERANCE WITH PROXYSQL, MRM AND CONSUL ABOUT ME NARCS - - PowerPoint PPT Presentation

FAULT TOLERANCE WITH PROXYSQL, MRM AND CONSUL ABOUT ME NARCS PILLAO Systems Engineer letgo.com | edreams.com | palominodb | emagister.com BEHIND THE SCENES 75M Downloads | 200M listings | 3B chats in 2,5 years ! AGENDA


slide-1
SLIDE 1

FAULT TOLERANCE

WITH PROXYSQL, MRM AND CONSUL

slide-2
SLIDE 2

ABOUT ME

NARCÍS PILLAO

Systems Engineer letgo.com | edreams.com | palominodb | emagister.com

slide-3
SLIDE 3

BEHIND THE SCENES

75M Downloads | 200M listings | 3B chats in 2,5 years !

slide-4
SLIDE 4

AGENDA

  • Motivations
  • Describe the components
  • Architecture
  • Demo
  • Q/A
slide-5
SLIDE 5

MOTIVATIONS

slide-6
SLIDE 6

MOTIVATIONS

  • Automatic and repeatable process to reduce

downtime when the master goes down

  • Query digest
  • Filter unexpected queries as ORM nightmares
  • Auto scalable design thanks to Consul and Puppet
  • Choose open source and emerging solutions
slide-7
SLIDE 7

DESCRIBING THE COMPONENTS

slide-8
SLIDE 8

REPLICATION MANAGER (MRM)

  • Open source solution (MySQL, Percona and MariaDB)
  • Manual or automatic failover options
  • Topology: Master and many slaves (ignore server
  • ption)
  • Multiple MRM nodes managed by arbitrator
  • ProxySQL integration ( just released )
  • GH: https://github.com/signal18/replication-manager
slide-9
SLIDE 9

PROXYSQL

  • Query digest
  • Query filtering
  • Query rewrite
  • Query routing
  • Maintenance operations
  • https://github.com/sysown/proxysql
slide-10
SLIDE 10

CONSUL

  • Service discovery tool
  • Maintenance action feature
  • Introduce new ProxySQL nodes via its DNS
  • Monitoring checks
slide-11
SLIDE 11

ARCHITECTURE

slide-12
SLIDE 12

Replication Manager

slide-13
SLIDE 13

ARCHITECTURE

slide-14
SLIDE 14

ProxySQL and Consul

slide-15
SLIDE 15

ARCHITECTURE

slide-16
SLIDE 16

DEMO

https://github.com/narcisbcn/fault_tolerant_db

slide-17
SLIDE 17

QUESTIONS?

slide-18
SLIDE 18

THANK YOU !

Github: narcisbcn Twitter: @narcisbcn