adaptive fpga based database
play

Adaptive FPGA-based Database Accelerators Achievements, - PowerPoint PPT Presentation

Adaptive FPGA-based Database Accelerators Achievements, Possibilities, and Challenges Daniel Ziener and Jrgen Teich Database Acceleration Overview Idea: Translate each SQL query into an FPGA-based accelerator circuit through run-time


  1. Adaptive FPGA-based Database Accelerators – Achievements, Possibilities, and Challenges Daniel Ziener and Jürgen Teich

  2. Database Acceleration – Overview Idea: Translate each SQL query into an FPGA-based accelerator circuit through run-time assembly of dynamically reconfigurable hardware modules Hardware Trades Module Library a: Symbol = USBN SQL query WHERE a SELECT Price, Volume = W S FROM Trades Trades UBSTrades SELECT WHERE Price, Vol. a Symbol=“UBSN“ INTO UBSTrades FPGA UBSTrades DynSoC Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 2

  3. Database Acceleration – Architecture SELECT * FROM table WHERE age > 20 SELECT * FROM table WHERE salary > 10000 AND year < 1990 Host FPGA Reconf. Manager O I A U > N N T D PCIe Reconfigurable Area > < Data Library O I A A U N > < > > < N N T D D Reconfigurable Area Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 3

  4. Database Acceleration – Overview Module Library ● Each partial area consists of 16 slots Module Operator Coverage Number of Throughput Slots Arithmetic (+,-, ) Comparators (<,>,=,≠) Restriction 2 1 Sample/Cycle Bitwise functions (AND, OR, NOT, XOR, ...) Aggregation SUM(), MIN(), MAX(), COUNT() 2 1 Sample/Cycle Reorder Reorder Attributes of a tuple 4 1 Sample/Cycle Join Hash and Merge Join - 1 Sample/Cycle Sort line for sorting 2 KB (64 KB) data 16 1 Sample/Cycle Sort tree merges sorted block - 1 Sample/Cycle ● Each reconfigurable area consists of 16 slots ● 4 reconfigurable areas available on our prototype Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 4

  5. New Architecture: 12.8 GByte/s and 64 Bytes per Database Acceleration – Lessons Learned Clock Cycle ● High processing throughput achievable ● Pipelined modules have a throughput of 2 GByte/s per reconfigurable area (125 MHz x 16 Bytes) ● The throughput is independent of the number of concatenated modules New Architecture: ● I/O turns out to define the bottleneck DDR3 Memory: 12.8 GByte/s ● PCIe Gen2 x4: 1.7 GByte/s ● Only one interface to feed all reconfigurable areas ● Flexibility is the key feature ● For each query different decisions can be taken at run-time Hash Merge Row- Column- Join Join based based ● All processing alternatives can be executed on the same static system Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 5

  6. Database Acceleration – New High-Performance Architecture Incoming queries FPGA Host Conf. Database Tables Manager Reconfigurable Area Align- B Hash ment L > = O Join + Unit O Aggr. M Query analysis + filter configuration Data processing Data processing Host FPGA Data processing Data processing time Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 6

  7. Database Acceleration – Results (FPT’15) ● Comparing Energy/Power consumption of an Intel Core i7 with our approach based on an embedded Xilinx Zynq-SoC ● Analysis of example query based on the TPC-DS benchmark (1 GB scale), including restrictions, aggregations, and joins ARM – MySQL Intel i7 – MySQL Accl@ Zynq Execution time 44.2 ms 6900 ms 420 ms Overall energy 190 mJ 1.47 J 5.33 J Improvment t exe 156 9.5 Improvment Energ. 7.72 27.97 Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 7

  8. Database Acceleration – Results (FPT’15) ● Comparing Energy/Power consumption of an Intel Core i7 with our approach based on an embedded Xilinx Zynq-SoC ● Analysis of example query based on the TPC-DS benchmark (1 GB More Information: scale), including restrictions, aggregations, and joins [1] D. Ziener, F. Bauer, A. Becher, C. Dennl, K. Meyer-Wegener, U. Schürfeld, J. Teich, J. Vogt and H. Weber. FPGA-Based Dynamically Reconfigurable SQL Query Processing. ACM Transactions on Reconfigurable Technology and Systems (TRETS), vol. 9, no. 4, Article 25, July 2016. ARM – MySQL Intel i7 – MySQL Accl@ Zynq [2] A. Becher, D. Ziener, K. Meyer-Wegener and J. Teich. Execution time 44.2 ms 6900 ms 420 ms A Co-Design Approach for Accelerated SQL Query Processing via FPGA-based Data Filtering. In Proceedings of 2015 International Overall energy 190 mJ 1.47 J 5.33 J Conference on Field-Programmable Technology (FPT '15), Queenstown, Improvment t exe 156 9.5 New Zealand, December 7--9, 2015. Improvment Energ. 7.72 27.97 Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 8

  9. Current Database Management Systems ● Database management systems are multi-user systems ● Different queries with different complexity have to be processed on different data at the same time ● Response time is very important ● Bunch of different operations ● Query processing ● Sorting ● Data analytics ● Data update ● Changing load scenarios over time ● E.g., day: query processing; night: data analytics Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 9

  10. HW Accelerators for Big Data Applications ● Current software solutions ● Multi-Core server systems with many nodes ● On each core, data processing is done with data or time slices ● Advantages: OS support (task switching, mapping onto processing places) Easy to extend with new operators or analytic functions Question: How can we achieve such a flexibility for HW-based accelerators? FPGA SSDs Host Library PCIe/ SATA CAPI > < & Ext. Memory Daniel Ziener | 07.03.2017 | Dagstuhl | FPGA-based Database Accelerators – Achievments, Possibilities, and Challenges 10

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend