on FPGA Shuyi Chen Lizi George Kelly Ran Outline Motivation - PowerPoint PPT Presentation

Jan 25, 2024 •399 likes •567 views

Polyphonic Music Transcription on FPGA Shuyi Chen Lizi George Kelly Ran Outline Motivation System Architecture Evaluation Exploration Motivation Speed Polyphonic detection methods are still being investigated

Polyphonic Music Transcription on FPGA Shuyi Chen Lizi George Kelly Ran
Outline • Motivation • System • Architecture • Evaluation • Exploration
Motivation • Speed • Polyphonic detection methods are still being investigated – Using techniques from growing field of speech recognition • Real-time transcription
Background • Research is currently ongoing into best algorithm for polyphonic pitch detection with timbre rejection • A paper in Spring 2012 describes Klapuri algorithm and several others – We chose to implement Klapuri because it had the lowest error rate of 6 algorithms discussed for 1-4 pitches per time-slice
System Block Diagram
Input and Hanning Windows • Negate impact of sharp edges in time slices
FFT and Absolute Value • 4096-pt Streaming FFT – Minimal area requirements – ML605 Virtex-6 FPGA needed …
Spectral Whitening • Smooth out spectrum of computed sub-bands without boosting noise – Uses inverse filtering to flatten spectrum energy distribution to mitigate timbre effects
Spectral Whitening
Salience • Uses variation of binary search to find pitches present during time-slice – Includes harmonic contributions
Test Bench • MATLAB implementation of Klapuri algorithm – Compare to this result for algorithm checking • Lilypond engraving software output compared to known – Shell scripts written to take output file and generate lilypond code and refresh pdf in realtime
Evaluation • FFT output is in bit-reversed order – Implemented a sorter • Cube root implementation in binary – More efficient • SquareRoot and StreamFFT were reused IP blocks • Realtime?
Future Work • Increase FFT resolution in response to smaller differences between pitches as lower frequencies • Decreasing window size • Adding beat detection • Attempt to improve algorithm for 4-part piano harmonies • User-friendly real-time transcription system (front-end GUI, user input)
Synthesis Report • 4096-pt FFT has difficulties synthesizing on FPGA – Using Virtex-6 ML605 • We plan to complete synthesis and run on FPGA in the next few days
Questions?

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

FPGA What is a FPGA? How FPGAs work How do they work? Manufacturers

2/21/2012 Content FPGA What is a FPGA? How FPGAs work How do they work? Manufacturers Distributed RAM History FPGA vs ASIC FPGA and Microprocessors Alternatives to FPGAs ETI135, Advanced Digital IC Design

123 views • 10 slides

WWW.FPGA What is an FPGA? Field Programmable Gate Array Introduction to FPGA designs

WWW.FPGA What is an FPGA? Field Programmable Gate Array Introduction to FPGA designs Generic logic cells + Programmable switches Why do we use it? High performance & Flexible Shorter time to market Joachim Rodrigues

308 views • 8 slides

An introduction to FPGA-based acceleration of neural networks Marco Pagani 1 What is an FPGA?

An introduction to FPGA-based acceleration of neural networks Marco Pagani 1 What is an FPGA? Field-programmable gate array (FPGA) are integrated circuits designed to be con fi gured after manufacturing for implementing arbitrary logic

429 views • 15 slides

FPGA language ( HDL ). Overview 3 4 Component-Based Software Design LMES Component-Based

11/05/2016 Agenda The topics that will be addressed are: Overview on basic characteristics of the FPGA; Scheduling tasks on Reconfigurable FPGA reconfiguration capabilities; FPGA architectures Timing analysis for reconfigurable

299 views • 10 slides

Tips about an FPGA 02/09/2018 J.C. special topic FPGA ( field-programmable gate array ) FPGA :

Tips about an FPGA 02/09/2018 J.C. special topic FPGA ( field-programmable gate array ) FPGA : An integrated circuit (IC) designed to be configured by customer or designer after manufacturing -- Developed in ~80s -- Widely used (customer

303 views • 7 slides

GRVI Phalanx Update: A Massively Parallel RISC-V FPGA Accelerator Framework Jan Gray |

GRVI Phalanx Update: A Massively Parallel RISC-V FPGA Accelerator Framework Jan Gray | jan@fpga.org | http://fpga.org CARRV2017: 2017/10/14 FPGA Datacenter Accelerators Are Almost Mainstream Catapult v2. Intel += Altera. OpenPOWER CAPI. AWS

508 views • 28 slides

Support of Cross Calls between Microprocessor and FPGA in CPU-FPGA Coupling Architecture G.

Support of Cross Calls between Microprocessor and FPGA in CPU-FPGA Coupling Architecture G. NguyenThiHuong and Seon Wook Kim Microarchitecture and Compiler Laboratory School of Electrical Engineering Korea University Motivation

416 views • 19 slides

FPGA vs GPU Performance Comparison on the Implementation of FIR Filters FPGA. While comparing the

FPGA vs GPU Performance Comparison on the Implementation of FIR Filters FPGA. While comparing the performance of them, we Abstract choose different models for each platform to get fairer FIR filters find place in digital signal processing

569 views • 7 slides

The Spartan 3e FPGA The Spartan 3e FPGA Whats inside the chip? How does it implement

The Spartan 3e FPGA The Spartan 3e FPGA Whats inside the chip? How does it implement random logic? What other features can you use? What do all these things mean? LUT, Slice, BRAM, DCM, IOB, CLB... Two important documents

278 views • 11 slides

Public FPGA based DM Public FPGA based DMA Atta A Attacking king UlfFrisk Agenda Background

Public FPGA based DM Public FPGA based DMA Atta A Attacking king UlfFrisk Agenda Background and Previous work Transmit and Receive PCIe TLPs DUMP memory FPGA Design Attack vulnerable vanilla Linux system Attack vulnerable UEFI Windows

359 views • 19 slides

Tsunami simulation on FPGA/GPU Tsunami simulation on FPGA/GPU and its analysis based on Statistical

Tsunami simulation on FPGA/GPU Tsunami simulation on FPGA/GPU and its analysis based on Statistical Model Checking Masahiro Fujita VLSI Design and Education Center (VDEC) University of Tokyo 1 2 Outline What Tsunami simulation means in

1.25k views • 44 slides

Fast FPGA prototyping with Software Development Kit for FPGA (SDK4FPGA) Andrea Suardi

Fast FPGA prototyping with Software Development Kit for FPGA (SDK4FPGA) Andrea Suardi cas.ee.ic.ac.uk/projects/SDK4FPGA This research has been supported by EPSRC Impact Acceleration grant number EP/K503733/1 Outline What is SDK4FPGA ?

287 views • 18 slides

DMA implementations for FPGA- based data acquisition systems Presenter: Wojciech M. Zabootny

DMA implementations for FPGA- based data acquisition systems Presenter: Wojciech M. Zabootny Institute of Electronic Systems Warsaw University of Technology XL-th IEEE-SPIE Joint Symposium Wilga 2017 1/23 FPGA in DAQ FPGA chips are a

656 views • 23 slides

Contents Introduction Pipelined FPGA DNN accelerators Roof-line Model and optimizing

FPGA implementation of Quantized (Deep) Neural Network (QNN) Accelerators Biruk Seyoum Phd Student, Scoula Superiore SantAnna, Pisa Contents Introduction Pipelined FPGA DNN accelerators Roof-line Model and optimizing FPGA DNN

587 views • 23 slides

Processor Architecture Charles Eric LaForest J. Gregory Steffan ECE, University of Toronto FPGA

Octavo: An FPGA-Centric Processor Architecture Charles Eric LaForest J. Gregory Steffan ECE, University of Toronto FPGA 2012, February 24 Easier FPGA Programming We focus on overlay architectures Nios, MicroBlaze, Vector Processors

519 views • 38 slides

FPGA security Nele Mentens nele.mentens@kuleuven.be Design and security of cryptographic

FPGA security Nele Mentens nele.mentens@kuleuven.be Design and security of cryptographic algorithms and devices for real-world applications June 1-6, 2014, ibenik , Croatia Outline Introduction FPGA vs. ASIC FPGA application

443 views • 17 slides

Attorney Generals D Direct ctive 2 2015-1 Police Body W Worn Cameras a and Stored B Body

Attorney Generals D Direct ctive 2 2015-1 Police Body W Worn Cameras a and Stored B Body Worn Camer Cam era R Rec ecordi dings Chief Christopher Wagner President, New Jersey State Association of Chiefs of Police Denville

325 views • 10 slides

Police and Community Engagement Team Presented for Information Edmonton Police Commission

Police and Community Engagement Team Presented for Information Edmonton Police Commission January 16, 2020 Cst. Jacqueline Buchanan Objectives History- Why did we develop PACE? Who we are Evolution Successes and Growth in

536 views • 10 slides

GREATER SUDBURY POLICE SERVICES BOARD Ontario Regulation 58/16 Collection of Identifying

GREATER SUDBURY POLICE SERVICES BOARD Ontario Regulation 58/16 Collection of Identifying Information in Certain Circumstances Prohibition and Duties May 18, 2016 Agenda Background & Overview of the Regulation Board Policy

649 views • 27 slides

Shouldnt teens How Do We Best Equip Police to still know Handle Youth? RIGHT from A

3/24/18 Shouldnt teens How Do We Best Equip Police to still know Handle Youth? RIGHT from A Developmental Approach to Policing WRONG?!? SURE...but thats not the whole story. How Do Gabriella Celeste We Best Equip mgc36@case.edu

435 views • 5 slides

THE RESEARCH PRACTICE GAP: A COMPARATIVE PERSPECTIVE Ileana Steccolini Newcastle University

THE RESEARCH PRACTICE GAP: A COMPARATIVE PERSPECTIVE Ileana Steccolini Newcastle University London XXX CIGAR conference, Porto, 8 th June 2017 The research-practice gap: a taken for granted myth? Anecdotal evidence The usual

308 views • 12 slides

Document Vectors in the Wild: Building a Content Recommendation System for Reuters.com James

Document Vectors in the Wild: Building a Content Recommendation System for Reuters.com James Dreiss, Strata Data NY, 2018-09-12 reuters (lots of data) why document vectors? content -> content recommendations - no user registration,

883 views • 30 slides

Informa(on Retrieval as Sta(s(cal Transla(on Presented by: Lin

Informa(on Retrieval as Sta(s(cal Transla(on Presented by: Lin Gong Introduc(on How do people search a query? Ideal Informa(on

1.02k views • 15 slides

Imagine a language learning platform that helps you remember every new word http://lexicum.net

Imagine a language learning platform that helps you remember every new word http://lexicum.net info@lexicum.net angel.co/lexicum The problem with learning vocabulary OTHER, 8% CONSUMING MEDIA, 5% REPEATING, 8% GAMES, 8% REPETITIVE

814 views • 22 slides