Adaptive method for the digitization of mathematical journals - PowerPoint PPT Presentation

Adaptive method for the digitization of mathematical journals IMU-WDML Workshop June 2, 2012, Washington DC Masakazu Suzuki Kyushu University, Professor emeritus Kyushu Institute of Systems, Informatics and Nanotechnologies (ISIT) InftyProject ((http://www/inftyproject.org) Science Accessibility Net (http://www.sciaccess.net) http://www.inftyproject.org/

Plan of the talk  About InftyProject  Making Rich Digital Mathematical Libraries  Process Flow and Technical Components  Current State of the Art with Demonstration  Adaptive Method  Character and Symbol Recognition  Logical Structure Analysis  Future Problems 2 http://www.inftyproject.org/

Se c tio n 1 About Infty Pr oje c t 3 http://www.inftyproject.org/

ＩｎｆｔｙＰｒｏｊｅｃｔ  R&D on Math Information Systems  Main system development InftyReader : Math OCR software InftyEditor : Editor of math documents Data conversion （ XML, LaTeX, MathML, PDF, etc.) ChattyInfty : InftyEditor + speech output, Authoring of DAISY  URL ： Project site: http://www.inftyproject.org/en// Release & user support of Infty products: Science Accessibility Net http://www.sciaccess.net/ 4 http://www.inftyproject.org/

ＩｎｆｔｙＰｒｏｊｅｃｔ  R&D on Math Information Systems  Main system development InftyReader : Math OCR software InftyEditor : Editor of math documents Data conversion （ XML, LaTeX, MathML, PDF, etc.) ChattyInfty : InftyEditor + speech output, Authoring of DAISY  URL ： Project site: http://www.inftyproject.org/en// Release & user support of Infty products: Science Accessibility Net http://www.sciaccess.net/ 5 http://www.inftyproject.org/

“ InftyReader” OCR software for math documents  Demonstration. Recognition result samples (YMJ, AJM). 6 http://www.inftyproject.org/

Se c tio n 2 T owar d Ric h DML 7 http://www.inftyproject.org/

Different levels in digitization  Level 1: Bitmap images of printed materials e.g. GIF, TIFF  Level 2: Searchable digitized document e.g. PDF with hidden text, Bib Link  Level 3: Structured accessible document e.g. XML, HTML(+MathML), LATEX, …  Level 4: (partially) Executable document e.g. Mathematica, Maple  Level 5: Formally presented document e.g. Mizar, OMDoc 8 http://www.inftyproject.org/

Different levels in digitization  Level 1: Bitmap images of printed materials WDML achieved this level. e.g. GIF, TIFF  Level 2: Searchable digitized document e.g. PDF with hidden text, Bib Link  Level 3: Structured accessible document e.g. XML, HTML(+MathML), LATEX, …  Level 4: (partially) Executable document e.g. Mathematica, Maple  Level 5: Formally presented document e.g. Mizar, OMDoc 9 http://www.inftyproject.org/

Different levels in digitization  Level 1: Bitmap images of printed materials e.g. GIF, TIFF  Level 2: Searchable digitized document Infty : Level 1 → Level 3 e.g. PDF with hidden text  Level 3: Structured accessible document e.g. XML, HTML(+MathML), LATEX, …  Level 4: (partially) Executable document e.g. Mathematica, Maple  Level 5: Formally presented document e.g. Mizar, OMDoc 10 http://www.inftyproject.org/

Process Flow of Digitization PDF Image File (TIF) Texts & Math symbols Layout Analysis : Segmentation of Areas (Text, Table, Figure) Recognition per line (Character recognition, Math/Text segmentation, Math. Structure analysis) Document Structure analysis (Chapter, Section, Itemize, Theorem description, References, etc.) Outputs LaTeX, XHTML+MathML, XML PDF, Braille codes, etc. 11 http://www.inftyproject.org/

Layout Analysis PDF Image File (TIF) (Pre processing) Segmentation of Areas (Text, Table, Figure) Recognition per line (Character recognition, Math. Structure analysis) Document Structure analysis (Title, Chapter, Section, Itemize, Theorem, Bib, etc.) Outputs LaTeX. HTML, XML Human readable TeX Braille codes, Speak data, etc. 12 http://www.inftyproject.org/

Layout Analysis PDF Image File (TIF) Segmentation of Areas Table Analysis Recognition per line (Character recognition, Math. Structure analysis) Document Structure analysis (Title, Chapter, Section, Itemize, Theorem, Bib, etc.) Outputs LaTeX. HTML, XML Human readable TeX Braille codes, Speak data, etc. 13 http://www.inftyproject.org/

Document Structure Analysis  Detection of : Title, Autor, Section, Subsection, Itemization, BibItem, Theorem, Lemma, etc. - Currently, naïve methods are used: Line classification using the combination features such as: Character size, Font Information (Bold, Italic, Small Capital), Keywords, Indentation, Starting with Numbers or Special pattern (e.g. “[Num]”), etc. - Stronger method is required in actual digitization.  Hyperlink inside document. 17 http://www.inftyproject.org/

Se c tio n 3 Cur r e nt state of the ar t with de monstr ation 18 http://www.inftyproject.org/

“ InftyReader” OCR software for math documents  Demonstration…  Math recognition (Already shown)  Multi lingual recognition ← FineReader OCR plug-in Czech paper result sample  Matrices  Layout analysis, Table recognition  Logical structure analysis 19 http://www.inftyproject.org/

Se c tio n 4 L ar ge Volume Re c ognition 25 http://www.inftyproject.org/

Large Volume Digitization  Adaptive method is efficient: Get information from the target document: - Character features, - Math formula parameters, - Layout parameters, etc. or After manual checking (Directly) (Semi-automatic) Recognition 26 http://www.inftyproject.org/

Large Volume Digitization  Process Flow using BatchInfty & InftyReader pro 1. Noise reduction, centering, etc. 2. Trial recognition 3. Extraction features: - Document style → Logical structure analysis - Character cluster images → OCR engine 4. Recognition & verification 5. PDF output 27 http://www.inftyproject.org/

Large Volume Digitization  Generation of UserDictionary adapting OCR engine to the target documents. Trial recognition Clustering of the character images CharDataA: Centroides of the CharDataB: Centroides of the clusters of text characters with clusters of math symbols and reliable score text characters with low score (automatic) (manual correction) Show User Dictionary of Character Features CharImageManager 28 http://www.inftyproject.org/

Adaptive method for the digitization of mathematical journals - PowerPoint PPT Presentation

Adaptive method for the digitization of mathematical journals IMU-WDML Workshop June 2, 2012, Washington DC Masakazu Suzuki Kyushu University, Professor emeritus Kyushu Institute of Systems, Informatics and Nanotechnologies (ISIT)

Mathematical analysis of an Adaptive Biasing Potential method for diffusions Charles-Edouard

An Adaptive Covariance Estimation Method Yicun Zhen (joined work with John Harlim) Group

Development of an adaptive optical music recognition system within a large-scale digitization

Adaptive primal-dual stochastic gradient methods Yangyang Xu Mathematical Sciences, Rensselaer

APFM Conference Lisbon 19. Oktober 2018 DFMs digitization Project 1. How does digitization

DIGITIZATION POSSIBLE Investor Relations Presentation 3rd quarter 2018 We make digitization

Image Analysis for cultural Heritage Digitization INTRODUCTION Naomi Langer - Digitization

An optimal adaptive wavelet method discrete problems Linear operator equations for strongly

Adaptive wavelet algorithms with truncated residuals Tsogtgerel Gantumur IHP Breaking Complexity

An h -adaptive asynchronous spacetime discontinuous Galerkin method for TD analysis of complex

Adaptive Ray Tracing Jeong-Gyu Kim (Princeton) Mar 18, 2019 Characteristics Method for Point

Stochastic Simulation The Bootstrap method Bo Friis Nielsen Institute of Mathematical Modelling

Adaptive mesh refinement method : numerical density of entropy production and automatic

Integrable discretization and self-adaptive moving mesh method for a class of nonlinear wave

A novel method to describe and share complex mathematical models of cellular physiology David

The Riemannian Potato: an Automatic and Adaptive Artifact Detection Method for Online Experiments

Developing and Implementing Quality Improvement Systems and Performance Measures for State

Language and Computers Relation to language Encoding written Prologue: Encoding Language

Language and Computers Relation to language Encoding written language Prologue: Encoding

SB 929: How to engage what it means for Audio Settings: to set speaker preferences. California

My homework ! Correlation does not imply causality Visualization for the Blind ! Or,

Recent developments in WeBWorK an online homework system EAMS 2020 Michael Gage University of

OpenOffice.org can speak using odt2daisy ! Vincent SPIEWAK Agenda Accessible document

2nd SPEAK! workshop: Speech Generation in Multimodal Information Systems and Practical