Development of an adaptive optical music recognition system within - - PowerPoint PPT Presentation

development of an adaptive optical music recognition
SMART_READER_LITE
LIVE PREVIEW

Development of an adaptive optical music recognition system within - - PowerPoint PPT Presentation

Development of an adaptive optical music recognition system within a large-scale digitization project Michael Droettboom and Ichiro Fujinaga Peabody Conservatory of Music Johns Hopkins University Outline Lester S. Levy Collection


slide-1
SLIDE 1

Development of an adaptive optical music recognition system within a large-scale digitization project

Michael Droettboom and Ichiro Fujinaga

Peabody Conservatory of Music Johns Hopkins University

slide-2
SLIDE 2

Outline

  • Lester S. Levy Collection
  • Digital Workflow Management
  • Adaptive Optical Music Recognition
  • Current Development
slide-3
SLIDE 3

Lester S. Levy Collection

  • American Sheet Music (1780–1960)
  • Digitized 29,000 pieces (including “The Star-Spangled

Banner” and “Yankee Doodle”)

  • Database of text index records, images of the music and

lyrics and colour images of the cover sheets: http://levysheetmusic.mse.jhu.edu

slide-4
SLIDE 4

Digital Workflow Management

  • Reduce the manual intervention for large-scale

digitization projects

  • Creation of data repository (text, image, sound)
  • XML-based metadata

composer, lyricist, arranger, performer, artist, engraver, lithographer, dedicatee, and publisher cross-references for various forms of names, pseudonyms authoritative versions of names and subject terms

  • Search engines
  • Analysis toolkit
slide-5
SLIDE 5

Adaptive Optical Music Recognition

  • Staff recognition and removal

Run-length coding Projections

  • Lyric removal
  • Exemplar-based learning system
  • Score reconstruction
slide-6
SLIDE 6

Exemplar-based learning system

  • Connected-component analysis
  • Feature extraction
  • k-nearest neighbour classifier
  • Weighted-Euclidean distance measure
  • Genetic algorithm
slide-7
SLIDE 7

Current Development

  • Interactive graphic score editor
  • Prolog-based score reconstruction
  • Optical Character Recognition
  • GUIDO output (MIDI)
  • XML database
  • Fuzzy lyric/melody search
slide-8
SLIDE 8

Best Weight Vector Output Symbol Name Image File Staff removed Segmentation Connected Component Analysis Recognition k-NN Classifier Knowledge Base Feature vectors Optimization Genetic Algorithm k-NN Classifier

Exemplar-based learning system

Offline