[PPT] - Advanced Technology M 3 L T EX workshop A Write like a PowerPoint Presentation

SLIDE 1

Advanced Technology M3 L

A

T EX workshop

Write like a programmer! Martin Klein Schaarsberg

University of T wente

September 11 and 12, 2014

SLIDE 2

Write like a programmer?

Why?

Consistency and clarity by separation of content and style Flexibility and shareability from paper to book, poster and slides Scalability and stability from a 4 page paper to a 400 page book

SLIDE 3

Write like a programmer?

How?

Conceptualization define purpose, suitable medium and structure Implementation choose the right tool for the job Programming usually in plain text using language specific syntax Compilation translate code to result (pdf, web page or figure) (Publishing) to the web, print, e-mail, presentation

SLIDE 4

Write like a programmer?

Example 1: Matlab

Conceptualization show what sin(x) with x from 0 to 2π looks like Implementation Matlab code Programming x = linspace(0,2*pi,100); plot(x,sin(x)) Compilation running the code with Matlab creates a figure (Publishing) to the web, print, e-mail, presentation

SLIDE 5

Write like a programmer?

Example 2: HTML

Conceptualization create a website with one heading Implementation HTML code Programming <html> <h1>Hello world!</h1> </html> Compilation open the code with a web browser (Publishing) to the web

SLIDE 6

Write like a programmer?

Example 2: Latex

Conceptualization create a PDF document that says ‘Hello world’ Implementation Latex Programming \documentclass{article} \begin{document} Hello world! \end{document} Compilation use pdflatex to create a pdf document from the code (Publishing) do whatever you want with the PDF

SLIDE 7

How does it work?

◮ You write your document in plain text with commands that

describe its structure and meaning

◮ The latex program processes your text and commands to

produce a beautifully formatted pdf document. De \emph{hoogste} vereniging van de UT! latex

↓

De hoogste vereniging van de UT!

SLIDE 8

Workflow

Text editor

TeXworks TeXnicCenter Texmaker Notepad

LaTeX distribution

MiKTeX MacTeX TeX Live

Graphics program

Gimp Illustrator Paint

Source document LaTeX packages

.tex .pdf .eps .png .jpg

Included graphics Reference manager

JabRef

r text editor

Citation database LaTeX programs

.bib .sty .cls .dtx

Output document Processing files

.aux .bbl .log .toc .out .pdf .dvi pdflatex latex bibtex makeindex

SLIDE 9

An example L

AT

EX document

\documentclass[10pt]{article} \title{Sample document} \author{My name} \date{\today} \begin{document} \maketitle \end{document}

Sample document

My name November 12, 2012

SLIDE 10

An example L

AT

EX document

\documentclass[10pt]{article} \title{Sample document} \author{My name} \date{\today} \begin{document} \maketitle \section{Introduction} \subsection{Food} \end{document}

Sample document

My name November 12, 2012

1 Introduction

1.1 Food

SLIDE 11

An example L

AT

EX document

\documentclass[10pt]{article} \title{Sample document} \author{My name} \date{\today} \begin{document} \maketitle \section{Introduction} This is my \emph{first} document, created on \today. \subsection{Food} I like cookies, Pizza, and chocolate. \end{document}

Sample document

My name November 12, 2012

1 Introduction

This is my first document, cre- ated on November 12, 2012.

1.1 Food

I like cookies, Pizza, and chocolate.

SLIDE 12

An example L

AT

EX document

\documentclass[10pt]{article} \title{Sample document} \author{My name} \date{\today} \begin{document} \maketitle \section{Introduction} This is my \emph{first} document, created on \today. \subsection{Food} I like cookies, Pizza, and chocolate. \end{document}

Sample document

My name November 12, 2012

1 Introduction

This is my first document, cre- ated on November 12, 2012.

1.1 Food

I like cookies, Pizza, and chocolate.

SLIDE 13

Commands and environments

◮ Commands add extra functions to your text

◮ Format: \command[optional_args]{required_args}

Example

\today September 10, 2014 Use \emph{emphasis} Use emphasis Make it \textit{italic} Make it italic Make it \textbf{bold} Make it bold I love my \texttt{typewriter} I love my typewriter \textit{Emphasis is Emphasis is smart \emph{smart}}

SLIDE 14

Commands and environments

◮ Environments are used to treat sections specially

◮ Format:

\begin{environment}[optional_args] ... \end{environment}

Example

\begin{enumerate} \item First \item Second \item Third \end{enumerate}

1. First
2. Second
3. Third

SLIDE 15

Document outline

◮ \title{} ◮ \author{} ◮ \date{} ◮ \maketitle{} ◮ \begin{abstract} ... \end{abstract} ◮ \part{} ◮ \chapter{} ◮ \section{} ◮ \subsection{} ◮ \subsubsection{} ◮ \paragraph{} ◮ \footnote{} ◮ \bibliography{}

SLIDE 16

Simple lists

\begin{itemize} \item First item \item Second item \end{itemize} ◮ First item ◮ Second item \begin{enumerate} \item First item \item Second item \end{enumerate}

1. First item
2. Second item

\begin{description} \item[the ITco] does not fix your computer \item[the board] Best\'u\'u\'u\'u\'u\'ur! \end{description}

the ITco does not fix your computer the board Bestúúúúúúr!

SLIDE 17

Simple lists

Lists can also be nested

Example

My favourite committee is \begin{enumerate} \item ITco \item BOSS \item Other \begin{itemize} \item NICAT \item INCA \item \dots \end{itemize} \end{enumerate}

My favourite committee is

1. ITco
2. BOSS
3. Other

◮ NICAT ◮ INCA ◮ . . .

SLIDE 18

Paragraphs and whitespace

One, two, three spaces

r even a linebreak make

no difference for \LaTeX. You can create a new paragraph with a whiteline, as you can see. If necessary, you can break \dots \\ a \dots \\ line!

One, two, three spaces or even a linebreak make no difference for L

AT

EX. You can create a new paragraph with a white- line, as you can see. If necessary, you can break . . . a . . . line!

SLIDE 19

Special characters

Some characters have special meaning in L

AT

EX, if you need them they have to be entered as L

AT

EX-commands: \ \textbackslash note: \\ = newline $ \$ & \& % \% # \# ~ \textasciitilde _ \_ ˜ \~{} { } \{ \} <> \textless \textgreater (not in math)

SLIDE 20

Breaks and spaces

hard space ~ normal space \ line break \\ continue on new page \clearpage continue on new odd numbered page \cleardoublepage horizontal space \quad , \hspace{2cm} vertical space \medskip , \bigskip, \vspace{2cm}

SLIDE 21

Dashes, quotation marks and dots

Hyphens socio-economic

En-dash

2011–2012

Em-dash

Make no mistake—dashes

are important

Quotation marks ‘Awesome’! ` and ' “Awesome”! `` and '' Dots “In the beginning . . . ” ~\dots

SLIDE 22

Gotcha’s

◮ Most errors come from not matching { with a }, a \begin{}

with an \end{} or $ with $ or using a symbol that has a special meaning to L

AT

EX.

◮ Undefined control sequence means you misspelled a

command or you did not load the package necessary for that command.

◮ Putting parts of equations on separate lines in the code will

make reading the code easier. Avoid blank lines, they will give errors .

SLIDE 23

Exercise 1

◮ Exercise 1: see handout ◮ Practice with the following concepts:

◮ Creating PDFs ◮ Document structure ◮ White space, paragraphs and special characters ◮ Lists

◮ Presentation slides are available on

http://martinkleinschaarsberg.nl/latex

SLIDE 24

Document class

\documentclass[options]{class}

◮ Document classes:

article journal papers, short reports report longer text with several chapters, e.g. thesis book books letter letters beamer slide presentations beamerposter conference posters

◮ Style packages such as Koma-Script and memoir provide

alternative classes. Also several publishers have their own classes.

Example

\documentclass[10pt,a4paper,twoside]{article}

SLIDE 25

Document class

\documentclass[options]{class}

◮ Options:

Font size 10pt | 11pt | 12pt... Paper size a4paper | legalpaper... equations fleqn, leqno title titlepage | notitlepage columns onecolumn | twocolumn printing oneside | twoside

Example

\documentclass[10pt,a4paper,twoside]{article}

SLIDE 26

Packages

◮ Packages add functions to L

AT

EX

◮ In the preamble, before \begin{document}

◮ Format: \usepackage[options]{package}

Example

mathpazo loads the font Palatino amsmath provides useful math environments and characters xcolor colored text graphicx include pictures and diagrams hyperref cross-referencing in pdf

SLIDE 27

International support

◮ Use the babel package

◮ (e.g. \usepackage[dutch]{babel}) ◮ Use \texteuro 30 to get €30 (requires the textcomp

package) ◮ Use the icomma package if you want to use a comma as

decimal separator

◮ Create accents like \'e, \`e, \^e (é, è, ê) ◮ Or directly input accented characters:

1. Set the input encoding, e.g. \usepackage[utf8]{inputenc}
2. Set the font encoding, e.g. \usepackage[T1]{fontenc} (with

\usepackage{lmodern} or an other suitable font)

SLIDE 28

Inline and display equations

◮ Use $...$ for inline mathematics ◮ Use \begin{equation}...\end{equation} for displayed

mathematics with numbering

◮ Use \begin{equation*} ... \begin{equation*} for

displayed mathematics without numbering

◮ Use the amsmath package for more symbols and

environments

◮ A good reference guide: AMS Short Math Guide

SLIDE 29

Symbols and operators

Greek letters \alpha, \gamma, \Gamma

α, γ, Γ

Infinity \infty

∞

Superscripts x^2+x^{a+b} x2 + xa+b Subscripts x_n+x_{n-1} xn + xn−1 Square root \sqrt{2}+\sqrt[3]{2}

√

2 +

3

√

2 Fractions \frac{1}{2}

1 2

Integrals \int_a^b

b

a

Summation \sum_{i=1}^n

∑n

i=1

Products \prod_{\ell=1}^\infty

∏∞

ℓ=1

Hats \hat{y}

ˆ

y Tilde \tilde{y}

˜

y Bar \bar{x}

¯

x

SLIDE 30

Delimiters

\left( \frac{3}{9} \right)

3

9

\left[ \frac{3}{9} \right]
3

9

\left\{ \frac{3}{9} \right\}
3

9

\left( \frac{3}{9} \right.
3

9

SLIDE 31

Relations

\le

≤

\ge

≥

\ll

≪

\gg

≫

\ne

=

\sim

∼

\equiv

≡

\propto

∝

\approx

≈

\to

→

\pm 1

±1

a\cdot b a · b a\times b a × b

SLIDE 32

Matrices and vectors (with the amsmath package)

\begin{bmatrix} 3 & 4 \\ 5 & 2 \end{bmatrix}

3

4 5 2

\mathsf{A} = \begin{pmatrix}

A_{11} & A_{12} \\ A_{21} & A_{22} \end{pmatrix} A =

A11

A12 A21 A22

\mathbf{x} = \begin{bmatrix}

x_1 \\ x_2 \end{bmatrix} x =

b1

b2

SLIDE 33

Spacing in equations

◮ Normal space disappears when used in equations: a

b becomes ab

◮ You can use \quad or \qquad or \hspace{}

Example

\begin{equation} k_x=\frac{2\pi n_x}{L}, \quad k_y=\frac{2\pi n_y}{L}, \quad k_z=\frac{2\pi n_z}{L}. \end{equation} kx = 2πnx L

,

ky = 2πny L

,

kz = 2πnz L

.

(1)

SLIDE 34

Dots in equations

Different operators require different dots for proper alignment. The amsmath package provides suitable commands.

Example

A_1,A_2,\dotsc A1, A2, . . . A_1+A_2+\dotsb A1 + A2 + · · · A_1A_2\dotsm A1A2 · · · \int_{A_1}\int_{A_2}\dotsi

A1
A2· · ·

SLIDE 35

Text in equations

◮ Add text in equations with \text{} ◮ Common functions are predefined, such as \sin, \cos, \log,

\ln, \exp. log(x) looks better than log(x)

Example

\begin{equation} N=\alpha \sin x,\quad \text{with } x=\frac{\gamma T}{\beta} \end{equation} N = α sin x, with x = γT

β

(2)

SLIDE 36

Aligned and multiline equations

Use the align or align* environment from the amsmath package (instead of the equation environment)

Example

\begin{align} \alpha &= \beta +2 \\ \gamma -2 &= \zeta^3 \end{align}

α = β γ − 2 = ζ3

SLIDE 37

Aligned and multiline equations

Use the multline or multline* environment from the amsmath package for splitting long equations (instead of the equation environment)

Example

\begin{multline} v_{n+h|n} = \sigma^2\bigg[1 + \alpha^2(h-1) + \frac{\beta\phi h}{(1-\phi)^2} \left\{2\alpha(1-\phi) + \beta\phi \right\} \\

\frac{\beta\phi(1-\phi^h)}{1-\phi^2}

\left\{ 2\alpha(1-\phi^2) + \beta\phi(1-\phi^h)\right\} \\ + \gamma h_m(2\alpha+\gamma) + \left\{\phi^m(1-\phi^{m h_m})\right\}\bigg]. \end{multline}

SLIDE 38

Aligned and multiline equations

Use the multline or multline* environment from the amsmath package for splitting long equations (instead of the equation environment)

Example

vn+h|n = σ2

1 + α2(h − 1) +

βφh (1 − φ)2 {2α(1 − φ) + βφ} − βφ(1 − φh)

1 − φ2

2α(1 − φ2) + βφ(1 − φh)
+ γhm(2α + γ) +
φm(1 − φmhm)

.

SLIDE 39

Cases

\begin{equation} y = \begin{cases} \frac{x^\lambda - 1}{\lambda} & \text{if $\lambda > 0$;} \\ \log(x) & \text{if $\lambda=0$.} \end{cases} \end{equation} y =

xλ−1

λ

if λ > 0; log(x) if λ = 0.

SLIDE 40

Exercise 2

◮ Exercise 2: see handout ◮ Practice with the following concepts:

◮ Document class ◮ Packages ◮ Mathematics

◮ Presentation slides are available on

http://martinkleinschaarsberg.nl/latex

SLIDE 41

Graphics

◮ You need the graphicx package ◮ If you use pdfLaTeX, the image should be a jpg, pdf or png

Example

\includegraphics[width=4cm]{troll.jpg}

SLIDE 42

Tables

◮ The booktabs package is recommended ◮ There exist tools to convert from Excel

SLIDE 43

Example (using the booktabs package)

\begin{tabular}{llcr} Fruit & Color & Quality & Price (\$/kg) \\ Apple & Green & A & 2.40 \\ Banana & Yellow & B & 3.55 \\ Orange & Orange & A & 2.44 \\ \end{tabular} Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 44

Example (using the booktabs package)

\begin{tabular}{llcr} Fruit & Color & Quality & Price (\$/kg) \\ Apple & Green & A & 2.40 \\ Banana & Yellow & B & 3.55 \\ Orange & Orange & A & 2.44 \\ \end{tabular} Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 45

Example (using the booktabs package)

\begin{tabular}{llcr} Fruit & Color & Quality & Price (\$/kg) \\ Apple & Green & A & 2.40 \\ Banana & Yellow & B & 3.55 \\ Orange & Orange & A & 2.44 \\ \end{tabular} Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 46

Example (using the booktabs package)

\begin{tabular}{llcr} \toprule Fruit & Color & Quality & Price (\$/kg) \\ \midrule Apple & Green & A & 2.40 \\ Banana & Yellow & B & 3.55 \\ Orange & Orange & A & 2.44 \\ \bottomrule \end{tabular} Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 47

Code listings

◮ Display code without formatting with

\begin{verbatim}...\end{verbatim}

function z = computefactorial(N) z = 1; for k = 1 : N z = z * k; end end ◮ Advanced formatting is possible with the listings package

1

function z = computefactorial(N)

2

z = 1;

3

for k = 1 : N

4

z = z * k;

5

end

6

end

SLIDE 48

Floats

◮ Floats are figures, tables, etc. with a caption ◮ L

AT

EX determines the placement

◮ You can specify placement options (here if possible, top of

the page, bottom of the page or a separate page)

SLIDE 49

Floating figures

\begin{figure} \includegraphics{...} \end{figure}

Figure 1: Nice picture!

SLIDE 50

Floating figures

\begin{figure} \includegraphics{...} \caption{Nice picture!} \label{fig:nicepic} \end{figure}

Figure 1: Nice picture!

SLIDE 51

Floating figures

\begin{figure} \centering \includegraphics{...} \caption{Nice picture!} \label{fig:nicepic} \end{figure}

Figure 1: Nice picture!

SLIDE 52

Floating tables

\begin{table} \begin{tabular}{...} ... \end{tabular} \end{table}

Table 1: Nice table! Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 53

Floating tables

\begin{table} \caption{Nice table!} \label{tab:nicetable} \begin{tabular}{...} ... \end{tabular} \end{table}

Table 1: Nice table! Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 54

Floating tables

\begin{table} \centering \caption{Nice table!} \label{tab:nicetable} \begin{tabular}{...} ... \end{tabular} \end{table}

Table 1: Nice table! Fruit Color Quality Price ($/kg) Apple Green A 2.40 Banana Yellow B 3.55 Orange Orange A 2.44

SLIDE 55

Float placement

◮ \begin{table}[htb] means put it ‘here’, or ‘top of page’ or

‘bottom of page’, trying positions in the order stated

◮ Other possibilities are p for ‘whole page’ and ! meaning

‘ignore the constraints on where to place figures’

◮ Always put the label after the caption!

SLIDE 56

Cross-references

◮ Cross-references allow you to refer to figures, tables,

sections, pages etc. in your text

◮ Always a pair of a \label{} and a reference ◮ Put a \label{xx} immediately when a number would have

been created, e.g. after \section{...}, \caption{...}, \begin{equation}, etc.

◮ Add a reference in the text (imagine it is for Figure 3 on page

2)

◮ \ref{xx} becomes ‘3’ ◮ \autoref{xx} becomes ‘Figure 3’ (with the hyperref package) ◮ \eqref{xx} becomes ‘(3)’ (for equations) ◮ \pageref{xx} becomes ‘2’

SLIDE 57

Table of contents and other lists

◮ L

AT

EX can generated lists of numbered environments

◮ Sections: \tableofcontents

◮ Use \setlength{tocdepth}{2} in the preamble to control

how many levels of sections appear ◮ Figures: \listoffigures ◮ Tables: \listoftables

SLIDE 58

Exercise 3

◮ Exercise 3: see handout ◮ Practice with the following concepts:

◮ Figures ◮ Tables ◮ Floats ◮ Cross-references ◮ Table of contents and other automatic lists

◮ Presentation slides are available on

http://martinkleinschaarsberg.nl/latex

SLIDE 59

Bibliographies with BibTeX

◮ BibTeX is a plain text citation database format ◮ You can import references from publishers websites, Scopus,

ScienceDirect and programs like Endnote

◮ You can use the program JabRef to manage the database ◮ You can use numbered citations or author-year (with the

natbib package)

◮ With a bibliography style, the citation list is formatted

automatically. You can easily use the references style from

Science, Nature or another journal.

◮ Use pdfLaTeX+MakeIndex+BibTeX in TeXworks to compile

SLIDE 60

Bibliographies with BibTeX

In the BibTeX file (references.bib for example)

@ARTICLE{Aran2011, author = {H.C. Aran and S. Pacheco Benito and M.W.J. Luiten-Olieman and S. Er and

M. Wessling and L. Lefferts and N.E. Benes

and R.G.H. Lammertink}, title = {Carbon nanofibers in catalytic membrane microreactors}, journal = {Journal of Membrane Science}, year = {2011}, volume = {381}, pages = {244--250}, number = {1--2}, } @BOOK{Shah1979, title = {Gas--liquid--solid reactor design}, author = {Y. T. Shah}, publisher = {McGraw-Hill}, year = {1979}, }

SLIDE 61

Bibliographies with BibTeX

In the L

AT

EX file (with the natbib package) \documentclass{article} \usepackage{natbib} \bibliographystyle{chicago} \begin{document} \citet{Aran2011} propose a multiphase new reactor

design. Multiphase reactor engineering is very

challenging \citep{Shah1979}. \citet[p247]{Aran2011} show an interesting discussion. \bibliography{references} \end{document}

SLIDE 62

Bibliographies with BibTeX

Aran et al. (2011) propose a multiphase new reactor de- sign. Multiphase reactor engineering is very challenging (Shah, 1979). Aran et al. (2011, p247) show an interesting discussion.

References

Aran, H.,

S. P. Benito,
M. Luiten-Olieman,
S. Er,
M. Wessling, L. Lefferts, N. Benes, and R. Lammertink

(2011). Carbon nanofibers in catalytic membrane mi- croreactors. Journal of Membrane Science 381(1–2), 244–250. Shah, Y. T. (1979). Gas–liquid–solid reactor design. McGraw-Hill.

SLIDE 63

Typesetting numbers and physical units with the siunitx package

12 345 \num{12345} 3.45 × 10−4 \num{3.45e-4} 10, 30, 50 and 70 \numlist{10;30;50;70} 12.3° \ang{12.3} kg m/s2 \si{kg.m/s^2} g cm−3 \si{\gram\per\cubic\centi\metre} 1.23 J mol−1 K−1 \SI{1.23}{J.mol^{-1}.K^{-1}}

SLIDE 64

Typesetting chemical formulas with the mhchem package

H2O \ce{H2O}

227 90Th+

\ce{^{227}_{90}Th+} KCr(SO4)2 · 12 H2O \ce{KCr(SO4)2.12H2O} H+ + OH– −

→ H2O

\ce{H+ + OH- -> H2O} CO2 + C −

⇀ ↽ − 2 CO

\ce{CO2 + C <=> 2CO}

SLIDE 65

Conference posters with the beamerposter package

Speech Recognition Techniques for a Sign Language Recognition System

Philippe Dreuw, David Rybach, Thomas Deselaers, Morteza Zahedi, and Hermann Ney Human Language Technology and Pattern Recognition, RWTH Aachen University, Aachen, Germany

Introduction

◮automatic sign language recognition system ◮necessary for communication between deaf and hearing people ◮continuous sign language recognition, several speakers, vision-based

approach, no special hardware

◮large vocabulary speech recognition (LVSR) system to obtain a textual

representation of the signed sentences

◮evaluation of speech recognition techniques on publicly available sign language

corpus Automatic Sign Language Recognition (ASLR)

◮similar to speech recognition:

temporal sequences of images

◮important features ◮hand-shapes, facial expressions,

lip-patterns

◮orientation and movement of the

hands, arms or body

◮HMMs are used to compensate time

and amplitude variations of the signers

◮goal: find the model which best

expresses the observation sequence

Video Input Feature Analysis Global Search: argmax wN 1

Pr(wN

1 ) · Pr(xT 1 |wN 1 )

Recognized Word Sequence

Word Model Inventory Language Model XT 1 xT 1 ˆ wN 1 Pr(xT 1 |wN 1 ) Pr(wN 1 )

Experimental Setup Database

◮system evaluation on the RWTH-BOSTON-104 database ◮201 sentences (161 training and 40 test sequences) ◮vocabulary size of 104 words ◮3 speakers (2 female, 1 male) ◮corpus is annotated in glosses

Problems

◮26% of the training data are singletons ◮simple sentence structure ◮one out-of-vocabulary (OOV) words with whole-word

models Differences in Comparison to ASR

◮simultaneousness ◮signing space ◮environment ◮speakers and dialects ◮coarticulation and movement epenthesis ◮silence ◮whole-word models and sub-word units

System Overview Visual Modeling (VM)

◮related to the acoustic model in ASR ◮HMM based, with separate GMMs, globally pooled diag. covariance matrix ◮monophone whole-word models ◮pronunciation handling

Language Modeling (LM)

◮according to ASR: LM should have a greater weight than the VM ◮trigram LM using the SRILM toolkit, with modified Kneser-Ney discounting with

interpolation Features

◮appearance-based image features: for

baseline system

◮thumbnails of video sequence frames

(intensity images scaled to 32x32 pixels)

◮give a global description of all (manual

and non-manual) features proposed in linguistic research

◮manual features: ◮dominant hand tracking: hand

position, hand velocity, and hand trajectory features

40 60 80 100 120 140 20 40 60 80 100 hand positions ut eigenvectors vi 60 70 80 90 100 11050 60 70 80 90 100 hand positions ut eigenvectors vi

Feature Selection and Model Combination Feature Selection

◮concatenation of

appearance-based and manual features

◮sliding window for context

modeling

◮dimensionality reduction by

PCA and/or LDA

manual features head tracking scaling PCA / LDA hand tracking feature nation combi− non−manual features ut ut−2 ut−1

Model Combination

◮log-linear combination of

independently trained models

◮profit from independent

alignments (e.g. performing well for long and short words)

◮profit from different feature

extraction approaches

. . . . . . extraction feature Recognition appearance−based spatio−temporal patch−based body−parts model combination ut ut−2 ut−1

Experimental Results

20 25 30 35 40 50 100 150 200 250 300 WER [\%] LDA feature dimensionality window size = 3 window size = 5 window size = 7 20 25 30 35 40 50 100 150 200 250 300 WER [\%] PCA feature dimensionality window size = 3 window size = 5 window size = 7 10 20 30 40 50 60 70 80 100 200 300 400 500 WER [%] LM scale zerogram unigram bigram trigram

Features

Dim. [%WER]

frame intensity (w/o pronunciations) 1024 54.0 frame intensity (w/ pronunciations) 1024 37.0 frame intensity (w/ pronunciations + tangent distance) 1024 33.7 PCA-frame 110 27.5 PCA-frame, hand-position 112 25.3 PCA-frame, hand-velocity 112 24.2 PCA-frame, hand-trajectory 112 23.6 model-combination 2x100 17.9 Example Results Correct Examples IX-1P FIND SOMETHING-ONE BOOK IX-1P FIND SOMETHING-ONE BOOK JOHN FISH WONT EAT BUT CAN EAT CHICKEN JOHN FISH WONT EAT BUT CAN EAT CHICKEN LOVE JOHN WHO LOVE JOHN WHO JOHN BUY YESTERDAY WHAT BOOK JOHN BUY YESTERDAY WHAT BOOK Incorrect Examples MARY VEGETABLE KNOW IX LIKE CORN MARY VEGETABLE KNOW IX LIKE MARY JOHN IX GIVE MAN IX NEW COAT JOHN IX WOMAN NEW COAT LIKE CHOCOLATE WHO JOHN LIKE CHOCOLATE WHO JOHN [UNKNOWN] BUY HOUSE JOHN FUTURE NOT BUY HOUSE RWTH-BOSTON-104 Database Corpus Statistics Training Test sentences 161 40 running words 710 178 frames 12422 3324 vocabulary 103 65 singletons 27 9 OOV

1

LM Perplexities LM type PP zerogram 106.0 unigram 36.8 bigram 6.7 trigram 4.7 Database is publicly available Conclusion

◮LVSR system is suitable for vision-based continuous sign language recognition ◮many of the principles known from ASR can directly be transfered ◮important for ASLR: temporal contexts, pronunciation handling, language

modelling, and model combination

◮outlook: connection of recognizer output to a statistical machine translation

system achieved promising translation results Lehrstuhl f¨ ur Informatik 6 - Computer Science Department - RWTH Aachen University - Aachen, Germany Mail: dreuw@cs.rwth-aachen.de WWW: http://www-i6.informatik.rwth-aachen.de

SLIDE 66

Importing Matlab figures with matlabfrag

ln(I/nA) Peaks ln(I/nA) z/Å −2 2 −2 2 −5 5

SLIDE 67

Typesetting your CV

Example: http://nitens.org/taraborelli/cvtex

Dario Taraborelli

Senior Research Analyst, Strategy W F  New Montgomery Street San Francisco, CA  

+1-415-839-6885 x6753



+1-415-882-0495

✉ dtaraborelli@wikimedia.org  hp://nitens.org/taraborelli

Areas of specialization

Cognitive science • Perceptual psychology • Philosophy of science

Areas of competence

Social computing • Human-computer interaction

Education



PhD in Cognitive Science (highest honours) École des Hautes Études en Sciences Sociales, France

 : Roberto Casati, CNRS.



MSc in Cognitive Science École des Hautes Études en Sciences Sociales, France

: Pierre Jacob, CNRS; Kevin O’Regan, Université Paris .



MA in Philosophy of Science (highest honours) Università di Pisa, Italy

: Guglielmo Tamburrini, Università di Pisa; Adriana Fiorentini, CNR.



Licenza in Philosophy (highest honours) Scuola Normale Superiore di Pisa, Italy.

Appointments held

. Research

-present

Wikimedia Foundation Senior Research Analyst Strategic Development Team.

-present

University of Surrey Research Associate (-) Research Fellow (-) Centre for Research in Social Simulation, Department of Sociology.

-

University College London Marie Curie Fellow Chater Lab, Department of Psychology.

-

École des Hautes Études en Sciences Sociales Research Assistant Institut Jean-Nicod (CNRS-ENS-EHESS). 

SLIDE 68

Tips

◮ Compile often ◮ Write neatly: indent code inside environments ◮ The Not So Short Introduction to L

AT

EX 2ε is a good starting point

◮ For math, see this Short Math Guide for LaTeX ◮ Read package documentation (e.g. Windows Start - Run -

texdoc graphicx

◮ Detexify is a nice website (also available as app) to find the

commands for symbols

◮ For questions: http://tex.stackexchange.com ◮ No L

AT

EX editor available? http://writelatex.com

SLIDE 69

References

◮ Typographic comparison L

AT

EX vs. Word vs. Writer by Eyolf Østrem

◮ The Not So Short Introduction to L

AT

EX 2ε by Tobias Oetiker et al.

◮ wikibook on L

AT

EX

◮ John Lees-Miller’s L

AT

EX workshop

◮ Engelbert Buxbaum’s L

AT

EX workshop

◮ Rob J. Hyndman’s L

AT

EX workshop

◮ Daviid Reid’s L

AT

EX workshop

◮ Peter de Waal’s L

AT

EX workshop

◮ The Elements of Typographic Style by Robert Bringhurst