SLIDE 1
About me
- Chief Architect at PingCAP
- TiDB and TiKV
- Open source projects
○ LedisDB ○ go-mysql ○ go-mysql-elasticsearch ○ rust-prometheus ○ ...
Using Rust to Build a Distributed Transactional Key-Value Database - - PowerPoint PPT Presentation
Using Rust to Build a Distributed Transactional Key-Value Database - - PowerPoint PPT Presentation
Using Rust to Build a Distributed Transactional Key-Value Database LiuTang | tl@pingcap.com About me Chief Architect at PingCAP TiDB and TiKV Open source projects LedisDB go-mysql go-mysql-elasticsearch
SLIDE 2
SLIDE 3
Agenda
- Introduction
- Hierarchy
○ Storage ○ Raft ○ Transaction ○ RPC Framework ○ Monitor ○ Test
- Combine them all
SLIDE 4
When we want to build a distributed transactional key-value database...
SLIDE 5
Performance ACID Scalability Stability Consistency
HA
Others…
SLIDE 6
A High Building, A Low Foundation
SLIDE 7
Language
SLIDE 8
SLIDE 9
Let’s start from scratch!!!
SLIDE 10
SLIDE 11
Memory Table Immutable Memory Table SST SST SST …... SST SST WAL Flush SST …... SST Compaction Memory Disk Level 0 Level 1 Level 2 Info Log Manifest Current
RocksDB
SLIDE 12
https://github.com/pingcap/rust-rocksdb
SLIDE 13
SLIDE 14
Raft
a = 1 b = 2 a = 1 b = 2 State Machine Log Raft Module Client a = 1 b = 2 a = 1 b = 2 State Machine Log Raft Module a = 1 b = 2 a = 1 b = 2 State Machine Log Raft Module
SLIDE 15
Multi-Raft
Region 1 Region 2 Region 3 Region 1 Region 2 Region 3 Region 1 Region 2 Region 3 Raft Group Raft Group Raft Group A - B B - C C - D Key Space
SLIDE 16
Multi-Raft - Scalability
Region 1 Region 2 Region 1 Region 2 Region 1 Region 2 A B C D
SLIDE 17
Multi-Raft - Scalability
Raft ConfChange - AddNode Region 1 Region 2 Region 1 Region 2 Region 1 Region 2 A B C D Region 2
SLIDE 18
Multi-Raft - Scalability
Raft ConfChange - RemoveNode Region 1 Region 2 Region 1 Region 2 Region 1 A B C D Region 2
SLIDE 19
https://github.com/pingcap/raft-rs
SLIDE 20
Transaction
SLIDE 21
Transaction
let mut txn = store.begin() let value1 = txn.get(region1_key) let value2 = txn.get(region2_key) // do something with value txn.set(region1_key, new_value1) txn.set(region2_key, new_value2) txn.commit() // or txn.rollback()
How to keep consistency crossing multi-Raft Groups?
SLIDE 22
Transaction
1. Inspired by Google Percolator 2. Optimized Two Phase Commit (2 PC) 3. Multiversion Concurrency Control (MVCC) 4. Snapshot Isolation 5. Optimistic Transaction
SLIDE 23
SLIDE 24
gRPC
- Mode
○ Unary ○ Client streaming ○ Server streaming ○ Duplex streaming
- Using Futures to wrap the asynchronous C gRPC API
let f = unary(service, method, request); let resp = f.wait();
SLIDE 25
https://github.com/pingcap/grpc-rs
SLIDE 26
SLIDE 27
Prometheus
- Type
○ Counter ○ Gauge ○ Histogram
lazy_static! { static ref HTTP_COUNTER: Counter = register_counter!( "http_request_total", "Total number of HTTP request." ).unwrap(); } HTTP_COUNTER.inc();
SLIDE 28
https://github.com/pingcap/rust-prometheus
SLIDE 29
Testing
SLIDE 30
Testing - Failure Injection
// Ingest a failure fn function_foo() { fail_point!("foo"); } // Run and Trigger the failure FAILPOINTS=foo=panic cargo run
SLIDE 31
https://github.com/pingcap/fail-rs
SLIDE 32
Architecture
SLIDE 33
Architecture
RocksDB Raft MVCC Txn API RocksDB Raft MVCC Txn API RocksDB Raft MVCC Txn API Client gRPC Prometheus
SLIDE 34
https://github.com/pingcap/tikv
SLIDE 35
Beyond TiKV
SLIDE 36
A Distributed Relational Database
SLIDE 37
TiDB
Applications MySQL Drivers(e.g. JDBC) TiDB TiKV
MySQL Protocol RPC
SLIDE 38
A Distributed Analytical Database
SLIDE 39
TiSpark
Worker Spark Driver Job Spark Cluster
TiKV
RPC Worker Worker
SLIDE 40
Hybrid Transactional/Analytical Processing Database
SLIDE 41
TiDB TiDB Worker Spark Driver TiKV Cluster (Storage) Meta data TiKV TiKV TiKV Data location Job TiSpark API TiKV TiDB TSO/Data location Worker Worker Spark Cluster TiDB Cluster TiDB
... ... ...
API
PD PD PD
PD Cluster TiKV TiKV TiDB
SLIDE 42