multi mu ti di dimensio mensional nal in gp gpu memor
play

Multi Mu ti-Di Dimensio mensional nal, In-GP GPU-Memor Memory - PowerPoint PPT Presentation

Multi Mu ti-Di Dimensio mensional nal, In-GP GPU-Memor Memory Dat ataba abases ses: St Stre ream aming ing Co Condi dition tional al Ca Calculat culations ions in in Bi Big g Data a Se Sets Peter Strohm | GTC15 | San


  1. Multi Mu ti-Di Dimensio mensional nal, In-GP GPU-Memor Memory Dat ataba abases ses: St Stre ream aming ing Co Condi dition tional al Ca Calculat culations ions in in Bi Big g Data a Se Sets Peter Strohm | GTC15 | San Jos é | 03/17/2015 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  2. 2002 Jedox Founded in Freiburg, Germany SA App Today Offices in Freiburg, Frankfurt, Düsseldorf, Paris, Boston 120 Global Business Partners 125 Countries with Jedox Users 25 Language Versions Bus usiness Driven Intellig lligence, Analytics & Performance Management. 2 www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  3. Big Data in real-time: Twitter Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  4. Big Data in real-time: Twitter Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  5. Twitter: Big Data in Real-time Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  6. In-GPU-Memory OLAP-Database In-Memory OLAP-Database 1 All data in GPU memory All data in main memory All regions Hierarchical structure of Europe 2 consolidated elements France Italy UK North America USA Year Canada Count TweetID Mexico Longitude Q1 Q2 Q3 Q4 May Mar Aug Nov Year Jan Feb Jun Sep Oct Dec Q3 Q4 Q1 Apr Q2 Jul Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  7. In-GPU-Memory OLAP-Database In-Memory OLAP-Database 3 Calculation “on -the- fly” All regions Europe 4 Store only non-zero values France Italy UK North America USA Canada Count TweetID Mexico i In-GPU-Memory & “on -the- fly” Longitude May Mar Aug Nov Year Jan Feb Jun Sep Oct Dec Q3 Q4 Q1 Apr Q2 Jul Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  8. Jedox Social Analytics Workflow Update Streaming Adding trending with via php in Twitter data streaming filtering update . Web in ETL www Web+ETL Public Twitter Stream add Persistent ExcelPLUS Mobile Twitter Data analyzing in OLAP Web SA App Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  9. Jedox Social Analytics with GPU System: 2 x K40 with 12 GB GPURAM 1 CPU with 128GB RAM Data sets with > 500 million entries 2 Calculating “on -the- fly” on al all data entries 3 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  10. Jedox Social Analytics Showcase Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  11. Jedox Social Analytics Showcase Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  12. Social Media Analytics: HeatMap over 250.000 grid points over 500 Million database entries Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  13. Social Media Analytics: Trending 1 Top 100 Trending Factor # current day ________________ # all previous days 2 ~ 28.000 dictionary words > 80 Million DB entries Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  14. Social Media Analytics: Trending Assigning Trending Factor to vi virtual cell cells s (e.g. [TF] = [B] / [C]) 1 Trending Factor is calc lculated on on the fly fly 2 Conditional Calculation: IF IF-Rule le 3 IF IF ([count] >1000) TH THEN [count,currentDay] / [count,previousWeek] ELS ELSE 0 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  15. Conditional Rule with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor > Matching Constant Processor Processor (0) Matching Constant Processor (1000) Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  16. Conditional Rule with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor > Matching Constant 1 1 Processor (0) 0 1 0 … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  17. Conditional Rule with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor T > Constant 1 A,1 A,2 1 (0) A,3 0 A,4 1 A,5 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  18. Conditional Rules with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor T > T 1 A,1 A,2 1 A,3 0 A,4 1 A,5 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  19. Conditional Rules on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 0 FALSE Rule TRUE Processor T > T 1 A,1 A,2 1 A,3 0 A,6 1 A,8 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  20. Conditional Rules on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 0 FALSE Rule TRUE Processor T > T 1 A,1 A,2 1 A,3 0 A,6 1 A,8 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  21. Conditional Rules on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 0 FALSE Rule TRUE Processor T > T 1 A,1 A,2 1 complete A,3 0 A,6 1 set A,8 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  22. Conditional Rules on GPU GPU MEMORY SPACE FOR CALCULATIONS Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  23. Conditional Rule on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 1 Rule Processor Streaming Streaming Streaming > Matching Constant Processor Processor (1) Matching Constant Processor (1000) Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  24. Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] Rule Processor > Matching Matching Part 1 Processor Processor Processor Total Part 2 Part 1 Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  25. Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] FALSE Rule TRUE Processor Part 1 Total Part 1 > Matching Matching Processor Processor Processor Part 2 Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  26. Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] Rule Processor > Matching Matching Processor Processor Processor Part 2 Sub- Part 1 Total Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

  27. Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] Rule Processor > Matching Matching Processor Processor Processor Part 2 1 Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481

Recommend


More recommend