Technologies for Reusing Text from the Web The Oral Exam of Martin - PowerPoint PPT Presentation

Technologies for Reusing Text from the Web The Oral Exam of Martin Potthast To Obtain the Academic Degree of Dr. rer. nat. Web Technology & Information Systems Group Bauhaus-Universität Weimar www.uni-weimar.de www.webis.de www.potthast.net

Technologies for Reusing Text from the Web c 2 [ ∧ ] � www.webis.de 2011

Technologies for Reusing Text from the Web ;5tttt3Ctttttttttttk /tttttttt3JEttttttttt3. , ,EtttttttttF VtttttttttZ7 `*cttttt3F \tttttttt/ "Vz5L _,EttttttF =zzzzzzzz. ` `````````` ,xc /tttttt3. ,cEttt1 /tttttttt3. :t5ttttttt1 /tttttttt3"=L \ttttttttt1 Ettttttty \tttttttt5 c5ztttty ,L \ttttt3Z. Vtzcccc========s ;5zcczzzzzzzzSF \ttttttttttttt3 /5ttttttttttttF \tttttttttttt3 /tttttttttttttF "ttttttttttt3 "Etttttttttt5' `*cjjjjjjjJ Ct[jjti>*` \L c 3 [ ∧ ] � www.webis.de 2011

Technologies for Reusing Text from the Web Quotation Boilerplate Translation Summarization Metaphrase Paraphrase c 4 [ ∧ ] � www.webis.de 2011

Technologies for Reusing Text from the Web Plagiarism Quotation Boilerplate Translation Summarization Metaphrase Paraphrase c 5 [ ∧ ] � www.webis.de 2011

Contributions of Technologies for Reusing Text from the Web 1. Models & Algorithms 2. Surveys ❑ Unifying fingerprinting framework ❑ Fingerprinting ❑ Cross-language ESA ❑ Plagiarism detection ❑ Comment cross-media similarity ❑ Web comment retrieval ❑ Query segmentation algorithms ❑ Query segmentation 3. Evaluation Resources 4. Comparative Evaluations ❑ Wikipedia as near-duplicate corpus ❑ 5 fingerprint algorithms ❑ Wikipedia as cross-language corpus ❑ 3 cross-language models ❑ 3 measures for plagiarism detection ❑ 32 plagiarism detectors within 3 PAN evaluation competitions ❑ 3 plagiarism corpora ❑ 8 query segmentation algorithms ❑ Query segmentation corpus 5. Tools ❑ Netspeak ❑ Picapica ❑ OpinionCloud ❑ AItools lib c 6 [ ∧ ] � www.webis.de 2011

Detecting Cross-Language Text Reuse c 7 [ ∧ ] � www.webis.de 2011

Measuring Cross-language Similarity Alan Turing was conceived at Cha- Alan Mathison Turing was born on trapur, Orissa, India. His father was 23 June 1912. His father was Julius a member of the Indian Civil Ser- Mathison Turing, member of the vice. He and his wife wanted Alan civil service in India, and his to be brought up in England, so mother Ethel Sara Turing, the they returned to Maida Vale, daughter of Edward Waller Stoney. London, where Alan Turing was Alan's childhood was spent with his born on 23 June 1912. He had an elder brother John, living with a elder brother, John. His father's retired Army couple near Hastings, civil service commission was still England. His parents returned to active, and during Turing's child- India until the end of his father‘s hood years his parents travelled civil service commission, and visi- between Hastings, England and ted when they could. Signs of India, leaving their two sons to stay Turing‘s genius showed early in his with a retired Army couple. Very life. It is reported that he taught early in life, Turing showed signs of himself reading in less than three the genius he was to later promi- weeks. nently display. c 8 [ ∧ ] � www.webis.de 2011

Measuring Cross-language Similarity Alan Turing was conceived at Cha- Alan Mathison Turing was born on trapur, Orissa, India. His father was 23 June 1912. His father was Julius a member of the Indian Civil Ser- Mathison Turing, member of the vice. He and his wife wanted Alan civil service in India, and his to be brought up in England, so mother Ethel Sara Turing, the they returned to Maida Vale, daughter of Edward Waller Stoney. London, where Alan Turing was Alan's childhood was spent with his born on 23 June 1912. He had an elder brother John, living with a elder brother, John. His father's retired Army couple near Hastings, civil service commission was still England. His parents returned to active, and during Turing's child- India until the end of his father‘s hood years his parents travelled civil service commission, and visi- between Hastings, England and ted when they could. Signs of India, leaving their two sons to stay Turing‘s genius showed early in his with a retired Army couple. Very life. It is reported that he taught early in life, Turing showed signs of himself reading in less than three the genius he was to later promi- weeks. nently display. c 9 [ ∧ ] � www.webis.de 2011

Measuring Cross-language Similarity Alan Turing was conceived at Cha- Alan Mathison Turing was born on trapur, Orissa, India. His father was 23 June 1912. His father was Julius a member of the Indian Civil Ser- Mathison Turing, member of the vice. He and his wife wanted Alan civil service in India, and his turing 4 5 to be brought up in England, so mother Ethel Sara Turing, the they returned to Maida Vale, daughter of Edward Waller Stoney. travel 1 0 London, where Alan Turing was Alan's childhood was spent with his teach born on 23 June 1912. He had an 0 elder brother John, living with a 1 elder brother, John. His father's retired Army couple near Hastings, ... ... ... civil service commission was still England. His parents returned to active, and during Turing's child- India until the end of his father‘s army 1 1 hood years his parents travelled civil service commission, and visi- alan 3 2 between Hastings, England and ted when they could. Signs of India, leaving their two sons to stay Turing‘s genius showed early in his active 1 0 with a retired Army couple. Very life. It is reported that he taught early in life, Turing showed signs of himself reading in less than three the genius he was to later promi- weeks. nently display. c 10 [ ∧ ] � www.webis.de 2011

Measuring Cross-language Similarity Alan Turing was conceived at Cha- Alan Mathison Turing was born on trapur, Orissa, India. His father was 23 June 1912. His father was Julius a member of the Indian Civil Ser- Mathison Turing, member of the vice. He and his wife wanted Alan civil service in India, and his turing 4 5 to be brought up in England, so mother Ethel Sara Turing, the they returned to Maida Vale, daughter of Edward Waller Stoney. travel ϕ 1 0 London, where Alan Turing was Alan's childhood was spent with his teach born on 23 June 1912. He had an 0 elder brother John, living with a 1 elder brother, John. His father's retired Army couple near Hastings, ... ... ... civil service commission was still England. His parents returned to - Euclidean distance active, and during Turing's child- India until the end of his father‘s army 1 1 - scalar product hood years his parents travelled civil service commission, and visi- alan 3 2 between Hastings, England and ted when they could. Signs of - cosine similarity India, leaving their two sons to stay Turing‘s genius showed early in his active 1 0 with a retired Army couple. Very life. It is reported that he taught early in life, Turing showed signs of himself reading in less than three the genius he was to later promi- weeks. nently display. c 11 [ ∧ ] � www.webis.de 2011

Measuring Cross-language Similarity Alan Turing was conceived at Cha- Turings Vater Julius Mathison trapur, Orissa, India. His father was Turing, ein britischer Staatsdiener a member of the Indian Civil Ser- in Chatrapur, Indien, und dessen vice. He and his wife wanted Alan Frau Ethel Sara wollten, dass ihr to be brought up in England, so Kind in Großbritannien geboren they returned to Maida Vale, wird. Deshalb kehrten sie nach London, where Alan Turing was London-Paddington zurück, wo born on 23 June 1912. He had an Alan Turing am 23. Juni 1912 zur elder brother, John. His father's Welt kam. Da der Staatsdienst civil service commission was still seines Vaters noch nicht beendet active, and during Turing's child- war, pendelte dieser während hood years his parents travelled Turings Kindheit zwischen England between Hastings, England and und Indien. Seine Familie ließ er India, leaving their two sons to stay aus Furcht vor Gefahren in der with a retired Army couple. Very britischen Kolonie bei Freunden in early in life, Turing showed signs of England zurück. Schon in frühester the genius he was to later promi- Kindheit zeigte sich die hohe Bega- nently display. bung und Intelligenz Turings. c 12 [ ∧ ] � www.webis.de 2011