SLIDE 1
Elasticsearch
- T E G
- Elasticsearch
Elasticsearch/Lucene Contributor
- 2
Agenda
ES
Elasticsearch T E G - - PowerPoint PPT Presentation
Elasticsearch T E G - - PowerPoint PPT Presentation
Elasticsearch T E G Elasticsearch Elasticsearch/Lucene Contributor ES
SLIDE 2
SLIDE 3
SLIDE 4
- 4
- PS
- S
Q
SLIDE 5
5
- 600+ PB
- Elasticsearch
- /
SLIDE 6
SLIDE 7
- 7
- 4L2
- P
- 0O9S
L1<P , ,
- BmB
- Om5Mm
- 9m
- A09m
SLIDE 8
SLIDE 9
- 9
- B
Ma
- e
- g
SLIDE 10
4JGC2
E 10
D
- N
- %42
- %
- 50 %
- 522
SLIDE 11
IH
11
- 1
- 2
- 3
SLIDE 12
P/-
12
- r
- +
- P
SLIDE 13
13
- ! = 50 ∗ cos )
5 ∗ * + 50
%
- %
SLIDE 14
- 14
SLIDE 15
+P
0R 15
- ru
ElasticsearchStatusException[Elasticsearch exception [type=search_phase_execution_exception, reason=]]; nested: ElasticsearchException[Elasticsearch exception [type=too_many_buckets_exception, reason=Trying to create too many buckets. Must be less than or equal to: [10000] but was [10001]. This limit can be set by changing the [search.max_buckets] cluster level setting.]];
- Rruc4
- k4h4J
+
1/+
- +0+
- M
+0+u4yu 4Vr t
λ =
1/+
- Vra e
Shard Buckets 1 Shard Buckets 2 Shard Buckets 3
. . . . . . … … … …
+0+ + + dBbru4J 4d2/+0+ 7 . https://github.com/elastic/elasticsearch/pull/46751
SLIDE 16
5
16
Ga im Ja r c MJ
- h
- eus
s c
- pt
70
- seus
65762 3:94817348173413688%/ Vus 65762 3:94817348173413688% s 65762 3:94817348173413688%% S 65762 3:94817348173413688%/
- 0.
.
- Eog
- l
- Cgbl
SLIDE 17
- 17
- 2BS0QP
- 0<1
5
- O0I1
- 9U0Cd
SLIDE 18
z – T
lWM 18
Lw
- fmCwDdS
- sSBmC
SkcmCl lmCMa T1
- T3
T4 T2
- ey
- vnS
sSmCl
- SmC
T5 T1
- T3
T4 T2
- T5
dEry
- y52vt
- hLSP
- hLSlHS
goeydez cPimz
)0ue
- - %-)
uw
) rk T( 4%-)
lfnSie
- SnomC
RTSku
- (-0%-)
201
SLIDE 19
A 19
. – 65
doc field1 field2 1 D 23 2 E 23 3 C 46 4 A 46 5 C 65 6 B 23 7 F 75 field1 field2 A 46 B 23 C 46 field1 field2 C 65 D 23 E 23 field1 field2 F 75
Stream Response key1 Stream Response key2 Stream Response key3 Size: 3
- AfterKey
field1field2
1 2 1 2
SLIDE 20
KIAT 20
– P
field1 field2 A 46 B 23 C 46 field1 field2 C 65 D 23 E 23 field1 field2 F 75
Stream Response key2 Stream Response key3
group key 6.5 GA
doc field1 field2 1 A 46 2 B 23 3 C 46 4 C 65 5 D 23 6 E 23 7 F 75
2.AfterKey 1.
- AfterKey
3.
3+RS
Stream Response key1 https://github.com/elastic/elasticsearch/pull/48399 7.6.0 https://github.com/elastic/elasticsearch/pull/48130
E 7
SLIDE 21
40 21
h
- 0,
u ip 6m f Rip
- ,6
- 76
7
- 5%
K.8 L IIFHIJECB:HI B:HIH:GFJBB()) 9G:DHBEr .8 IIFHIJECB:HI B:HIH:GFJBB IIFHIJECB:HI B:HIH:GFJBB) 5JD( IIFHIJEC:F: BJDHEBGFJBB(( 5JD( IIFHIJEC:F: BJDHEBGFJBB)
- bsn
- eSn
- emgbsn
- gl
- an
- TcOt
- /896:F 9DDI4ED:3-4
13
>
SLIDE 22
1 22
- 4
CPU
8
SLIDE 23
23
–
- ES1000w/s
1000w(QPS) 86400() 180() 50byte(avg doc size) 2(replicas) ≈ 14 PB ≈ 1500
- Rollup
Rollup –
10 →
ü
- ü
- ü
- (COS)
- 1h
5min
- 1d
SLIDE 24
24 CPUIdle
Rollup15
- Rollup – Rollup
Rollup
> 1
Rollup Rollup = Rollup CPU
%+R 3 1
+ –
Routing
- 1
2 3 1 2 3
- 1
- 1
<
30720 5,737 250 13
5000 10000 15000 20000 25000 30000 35000 1 5
- GB
≈
+
0 %
SLIDE 25
25
–
- 5
- 75
- FST %010TB 7 10GB ~ 15GB FST
SLIDE 26
- 2. 26
–
+0
F
+ehCR
- UaehNp
SL +CC CC UafH C +CC Ua OCO CcT
SLIDE 27
+ 27
–
- %
SLIDE 28
P 28
C0 – C
0GQB00
T F
- 9
9M M T iTFTCT LciS
- a12e
2 h K RT 4586.03 TLci 6 4586-6S 2
- M
- %
% K
- %
- %
977 % %
- S
- %
- M
%
- %%
- K
- %
977
- fDU 64B
SLIDE 29
29
C
()-M 35
- ()
- ()
- mf
- ()
- ()
- rDi
- rae
SLIDE 30
30
- 5
- <
SLIDE 31
31
- M
- r
- Elasticsearch
t k l
- E
- a
- p
- id
- e
- eH
Sk t
- s
id
- id
- c
SLIDE 32
SLIDE 33
2 33
P6
1
C
2
5
3
5+)(++
- P
- 6
1
- 2
+(+
3
R
SLIDE 34
Thanks
SLIDE 35