TiDB: Overview, New Features, Multi-Cloud Shen Li, Kevin Xu - - PowerPoint PPT Presentation

▶

Mar 10, 2024 683 likes •1.05k views

TiDB: Overview, New Features, Multi-Cloud Shen Li, Kevin Xu PingCAP What is Ti(tanium) DB? NewSQL (RDBMS at Scale) MySQL Compatible (5.7) Hybrid OLTP + OLAP Workloads Multi-Cloud 2 Product: the TiDB Platform TiDB

SLIDE 1

TiDB: Overview, New Features, Multi-Cloud

Shen Li, Kevin Xu

PingCAP

SLIDE 2

What is Ti(tanium) DB?

NewSQL (RDBMS at Scale)
MySQL Compatible (5.7)
Hybrid OLTP + OLAP Workloads
Multi-Cloud

SLIDE 3

Product: the TiDB Platform

TiDB Platform:
TiDB (stateless SQL layer)
TiKV (persistent key-value store w/ RocksDB)
TiSpark (Apache Spark plug-in to TiKV)
Open Sourced from Day 1
GA 2.0: April 2018

SLIDE 4

Community

Stars:
TiDB: 15,600+
TiKV: 3,800+
Contributors:
TiDB: 210+
TiKV: 105+

SLIDE 5

Recent News

SLIDE 6

TiDB Overview

SLIDE 7

Platform Architecture

Monitoring & Observability: Prometheus + Grafana

SLIDE 8

TiKV: the Storage Foundation

SLIDE 9

TiDB: the (My)SQL Layer

SLIDE 10

300+ Companies in Production

SLIDE 11

MySQL Compatible Tools and Migration

SLIDE 12

Tools

TiDB-DM (Data Migration)
TiDB-Lightning
TiDB-Binlog

SLIDE 13

TiDB-DM

Why? To support migrating data from MySQL/MariaDB to TiDB
Full data migration + binlog replication
Features:
Data migration job management
Monitoring system
Sharded table merge migration
Data transformation

SLIDE 14

DM Architecture

SLIDE 15

Sharded Table Merge

SLIDE 16

Data Transformation

SLIDE 17

TiDB-Lightning

Why? Enables fast, full import of SQL dump -> TiDB cluster
Fast:
Can import > 100 GB / hour on production grade hardware
Full Import:
Import the entire database once from scratch; not incremental import
Suitable for migrating an existing database to a new TiDB cluster
TiDB Cluster:
Lightning interacts with TiDB’s internal structures
Only works with TiDB cluster

SLIDE 18

TiDB-Lightning Architecture

SLIDE 19

TiDB-Binlog

Why? Provides real-time data synchronization and backup
Synchronizing downstream data platform in real-time to:
Hot backup
MySQL slave
OLAP data warehouses
Writing incremental backup files
Event subscription & trigger

SLIDE 20

TiDB-Binlog Architecture

SLIDE 21

Migration: in and out of TiDB

SLIDE 22

Sneak Peek of TiDB 2.1

SLIDE 23

TiDB 2.1 - SQL Layer

Smarter SQL optimizer

More efficient plan
Dynamic stats update based on

query feedback

Faster aggregation operator

New aggregation framework
Multi-thread hash aggregation
perator

50% faster OLTP point query

Faster online DDL

Run DDL concurrently
Faster “Add Index” operation

Improved debugging & diagnosis

More readable EXPLAIN result
“Explain Analyze” statement
Expose cluster information through

HTTP API

SLIDE 24

TiDB 2.1 - Storage Engine (aka TiKV)

Raft learner

Improve cross-DC data availability

Hotspot scheduling

Automatically distribute hotspots to more idle instances

Batch region-splits

Avoid large region formation under heavy write workloads

2X read performance improvement

SLIDE 25

1.0 vs 2.0 on TPC-H Scale 50

SLIDE 26

2.0 vs 2.1 on TPC-H Scale 50

SLIDE 27

2.1 vs 2.0 on Sysbench Point Select

SLIDE 28

TiDB Cloud

SLIDE 29

TiDB As A Service

Fully Managed by PingCAP
Upgrades, Patching, Online

DDL with No Downtime

Backup and Restore
Multi-Cloud Deployment

https://www.pingcap.com/tidb-cloud/

SLIDE 30

TiDB Operator

SLIDE 31

GCP Marketplace

SLIDE 32

See it to believe it

PingCAP Booth #6
Demo by Greg

Weber TODAY at 1:20PM

SLIDE 33

Oh…one more thing, TiDB Academy

https://www.pingcap.com/tidb-academy/

SLIDE 34