6/23/09 J-DSP: An Online DSP Laboratory Overview J-DSP J-DSP Editor Editor J-DSP blocks to generate, process and understand analog signals. Application of J-DSP to courses in Arts, Media and Engineering Department at Arizona State University. Sponsored by NSF Awards 0817596, NSF-DUE-CCLI-080975 NSF Program CCLI Phase 3 Award Started Apr. 2008 – Apr. 2013 involves 8 universities Also core software used in an NSF CRCD 2004-2006 FIE WORK IN Mohit Shah 1 FIE WORK IN Mohit Shah 2 PROGRESS 2005 PROGRESS 2005 Analog Signal Generator Analog Signal Processing J-DSP J-DSP Editor Editor Parameters Linear combination of signals ◦ Signal Type – Sine, Square, Triangular, Exp. ◦ Amplitude ◦ Analog Frequency ◦ Phase Output: A string symbolic representation of the chosen signal. ◦ For e.g. - 4sin(50t + 60) or 16exp(-20t) FIE WORK IN Mohit Shah 3 FIE WORK IN Mohit Shah 4 PROGRESS 2005 PROGRESS 2005 1
6/23/09 Analog Signal Processing (Contd.) Future Work J-DSP J-DSP Editor Editor Sampling and Quantization Extend the algorithm to allow the user to enter any expression mathematically, automatically parse the expression and generate the corresponding signal. Expand the current library of blocks to include more blocks that help understand the behavior of analog signals. FIE WORK IN Mohit Shah 5 FIE WORK IN Mohit Shah 6 PROGRESS 2005 PROGRESS 2005 Arts, Media and Engineering Pitch Estimation J-DSP J-DSP Editor Editor Track the fundamental frequency or pitch of a given Sound Sensing and Analysis frame. ◦ Algorithms to extract important features from audio, speech signals or environmental sounds based on their content. ◦ Some examples of common features - • Pitch • Temporal Energy • Harmonicity • Spectral Centroid • Mel Frequency Cepstral Coefficients. • Tonality Index FIE WORK IN Mohit Shah 7 FIE WORK IN Mohit Shah 8 PROGRESS 2005 PROGRESS 2005 2
6/23/09 Harmonicity Spectral Centroid J-DSP J-DSP Editor Editor Probabilistically measure whether the given frame Indicates the location of the ‘center of mass’ of the exhibits a harmonic frequency structure or not. spectrum. Harmonicity averaged over a number of frames is an Perceptually gives an impression regarding the important feature to study environmental sounds. ‘brightness’ a given sound. FIE WORK IN Mohit Shah 9 FIE WORK IN Mohit Shah 10 PROGRESS 2005 PROGRESS 2005 Tonality Index Temporal Energy J-DSP J-DSP Editor Editor Used in psychoacoustic models to determine whether a Calculate the average energy of a given frame. Use given sound exhibits a tone-like or noise-like threshold to mark the frame as voiced or unvoiced. characteristic. FIE WORK IN Mohit Shah 11 FIE WORK IN Mohit Shah 12 PROGRESS 2005 PROGRESS 2005 3
6/23/09 Future Work Acknowledgements J-DSP J-DSP Editor Editor Professor Andreas Spanias, ASU. Integrate J-DSP with Processing to create interactive simulations and programs to aid interdisciplinary Professor Michael Stiber, UWB. students in AME. Assistant Professor Harvey Thornburg, AME, ASU. National Science Foundation. Thank You FIE WORK IN Mohit Shah 13 FIE WORK IN Mohit Shah 14 PROGRESS 2005 PROGRESS 2005 4
Recommend
More recommend
