ROBOD: a Real-time Online Beat and Offbeat Drummer ock 1 , Florian - PowerPoint PPT Presentation

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion ROBOD: a Real-time Online Beat and Offbeat Drummer ock 1 , Florian Krebs 1 , 2 , Amaury Durand 3 , Sebastian P¨ oll 1 , Raminta Sebastian B¨ Balsyte 1 1Department of Computational Perception, Johannes Kepler University Linz, Austria 2Joanneum Research, Graz, Austria 3T´ el´ ecom ParisTech, Paris, France 1 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion Beat tracking 2 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion Beat tracking : online problem Limited information : only previous data is available Cannot fix errors afterwards 3 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion ROBOD interaction 4 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion ROBOD interaction 4 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion ROBOD beats Rhythmic companion interaction downbeats rhythmic patterns 4 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion ROBOD : Global description 100fps Signal pre-processing Beat tracking Semitone Positive Audio STFT RNN DBN filterbank differences Beats Pattern Beat / Features GMMs DBN ROBOD synchronisation Position inside bar Downbeat & pattern tracking every beat 5 / 12

Beat tracking ROBOD RNN Beat tracking DBN Pattern tracking Conclusion Beat tracking : RNN 6 / 12

Beat tracking ROBOD RNN Beat tracking DBN Pattern tracking Conclusion Beat tracking : DBN Before beat 7 / 12

Beat tracking ROBOD RNN Beat tracking DBN Pattern tracking Conclusion Beat tracking : DBN On beat 8 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion ROBOD : Global description 100fps Signal pre-processing Beat tracking Semitone Positive Audio STFT RNN DBN filterbank differences Beats Pattern Beat / Features GMMs DBN ROBOD synchronisation Position inside bar Downbeat & pattern tracking every beat 9 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion Pattern tracking 10 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion Conclusion ROBOD is more than just a beat tracker The online beat tracking algorithm is open source and available at : https://github.com/CPJKU/madmom or pip install madmom Special thanks to : Martin Preinfalk, Rainer Kelz, Harald Frostel, Filip Korzeniowski. 11 / 12

Beat tracking ROBOD Beat tracking Pattern tracking Conclusion Question Questions ? 12 / 12