(R) Evolution Philipp Krenn @xeraa Revolution - - PowerPoint PPT Presentation

▶
r evolution
SMART_READER_LITE
LIVE PREVIEW

(R) Evolution Philipp Krenn @xeraa Revolution - - PowerPoint PPT Presentation

Oct 12, 2023 321 likes •919 views

(R) Evolution Philipp Krenn @xeraa Revolution https://db-engines.com/en/ranking https://www.reddit.com/r/SQL/comments/7i828i/ms_sql_query_is_too_complex/ Who uses Elasticsearch? Infrastructure | Developer Advocate

slide-1
SLIDE 1

(R)Evolution

Philipp Krenn@xeraa

slide-2
SLIDE 2

Revolution

slide-3
SLIDE 3

https://db-engines.com/en/ranking

slide-4
SLIDE 4
slide-5
SLIDE 5 https://www.reddit.com/r/SQL/comments/7i828i/ms_sql_query_is_too_complex/
slide-6
SLIDE 6

Who uses Elasticsearch?

slide-7
SLIDE 7

Infrastructure | Developer Advocate

slide-8
SLIDE 8

http://thedudeabides.com/articles/ the_birth_of_compass

slide-9
SLIDE 9
slide-10
SLIDE 10

$ curl http://localhost:9200 { "name": "elasticsearch1", "cluster_name": "docker-cluster", "cluster_uuid": "sW2BcTZRRCSVVH2sDsWF8A", "version": { "number": "5.6.7", "build_hash": "4669214", "build_date": "2018-01-25T21:14:50.776Z", "build_snapshot": false, "lucene_version": "6.6.1" }, "tagline": "You Know, for Search" }

slide-11
SLIDE 11

$ curl http://localhost:9200 { "name": "elasticsearch1", "cluster_name": "docker-cluster", "cluster_uuid": "sW2BcTZRRCSVVH2sDsWF8A", "version": { "number": "5.6.7", "build_hash": "4669214", "build_date": "2018-01-25T21:14:50.776Z", "build_snapshot": false, "lucene_version": "6.6.1" }, "tagline": "You Know, for Search" }

slide-12
SLIDE 12
slide-13
SLIDE 13
slide-14
SLIDE 14
slide-15
SLIDE 15
slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20

Evolution

slide-21
SLIDE 21

Terms

Cluster, Node, Index, Shard, Document

slide-22
SLIDE 22
slide-23
SLIDE 23

Strictness*

5.0

* Demo
slide-24
SLIDE 24
slide-25
SLIDE 25

Parameters & configs

slide-26
SLIDE 26

Bootstrap checks

slide-27
SLIDE 27

Rolling Upgrades*

6.0

* Demo
slide-28
SLIDE 28
slide-29
SLIDE 29

Floodstage Watermark*

6.0

* Demo
slide-30
SLIDE 30
slide-31
SLIDE 31

Low 85% High 90% Floodstage 95%

slide-32
SLIDE 32

Sequence Numbers*

6.0

* Demo
slide-33
SLIDE 33
slide-34
SLIDE 34
slide-35
SLIDE 35

63 bits ought to be enough for anyone.

slide-36
SLIDE 36

Cross datacenter replication

6.x

slide-37
SLIDE 37

Types*

5.6 to 8.0

* Demo
slide-38
SLIDE 38
slide-39
SLIDE 39

Why

Data types Sparsity Scoring

slide-40
SLIDE 40

How

5.6 opt-in single type 6.x single type 7.x type optional in API 8.x no more types

https://www.elastic.co/guide/en/elasticsearch/reference/6.1/ removal-of-types.html#_schedule_for_removal_of_mapping_types
slide-41
SLIDE 41

Automatic Queue Resizing

6.0

slide-42
SLIDE 42

Reject and retry instead of long queues

thread_pool.search.target_response_rate: 2s Serving 50 requests/s Queue size:

slide-43
SLIDE 43

Adaptive Replica Selection

6.1

slide-44
SLIDE 44
slide-45
SLIDE 45

Pick best shard

Exponentially Weighted Moving Average (EWMA) Piggyback on requests

slide-46
SLIDE 46
slide-47
SLIDE 47

Shrink & Split*

5.06.1

* Demo
slide-48
SLIDE 48
slide-49
SLIDE 49

Shrink

Combine shards by a factor

slide-50
SLIDE 50
slide-51
SLIDE 51

Split

Split into a factor of number_of_routing_shards

slide-52
SLIDE 52

Benchmarks

∞

slide-53
SLIDE 53
slide-54
SLIDE 54
slide-55
SLIDE 55

Rally

https://elasticsearch-benchmarks.elastic.co

slide-56
SLIDE 56

Conclusion

slide-57
SLIDE 57

Strictness Rolling Upgrades Floodstage Watermark Sequence Numbers

slide-58
SLIDE 58

Types Automatic Queue Resizing Adaptive Replica Selection Shrink & Split

slide-59
SLIDE 59

Questions?

Philipp Krenn@xeraa