L2L L2L Live Live to e to e-Lea Learning rning Bridging - - PowerPoint PPT Presentation

L2L L2L

Live Live to e to e-Lea Learning rning

Matteo Bertazzo - CINECA InterUniversity Consortium 3rd TF-Media Task Force meeting, Trondheim, October 2010 Bridging physical and virtual classrooms using an integrated lecture capture and delivery service

L2L L2L

the L2L service performs a semi-automatic transformation of live lectures into e-learning activities ready for the publication and delivery through an e- Learning platform

Main objectives

• Productivity

“e-learning lessons-hours” / “man-hours to produce them”

• Lesson’s “Time-To-Market”

low latency for publication

• Modularity of the service and investments

let’s start now with a flexible service and a plug-in model

• Content reuse by multiple services

a L2L lesson (or part of it) delivered or used by WebTV or DTT, web portals, other services

The co The context ntext

Cineca is a non profit Consortium, made up of 43 Italian universities, the The National Institute

• f Oceanography and Experimental Geophysics -

OGS, the CNR (National Research Council), and the Ministry of Education, University and Research (MIUR)

• founded in 1967
• 350+ employees
• acts like a trait-d'union between

the academic world, the sphere of pure research and the world of industry and Public Administration

• supercomputing center, currently

#70 in top500.org list (currently SP6 and BG/P, BG/Q in 2012)

Ref efer erences ences

• Ministries of
• University and Research,
• Foreign Affairs,
• Justice
• Health
• Universities
• Italian National Drug

Agency (AIFA)

• National Health Institute

(ISS)

• Ferrari
• Luna Rossa (America’s Cup

challenger)

• ENI (Italian National Oil &

Gas Company)

• ESA (European Space

Agency)

• British Library
• ...

ICT & HPC services for

• Member & non-member

universities

• MIUR - Ministry of Education,

University and Research

• Public research institutions

Technology Transfer to:

• P

.A. & L.A.

• private companies
• E.U.

Cineca is currently involved in a number of EU Research Projects in many fields: supercomputing, economic, physics, bioengeneering, pharmaceutical, cultural heritage…

Activities

• Design & management of computing

infrastructure

• High Performance Computing &

Scientific Visualization

• Data Center outsourcing
• e-Learning and multimedia services
• LMS (Moodle, BB): integration,

management, customization of large-scale platforms (ASP model)

• 3D Virtual environment based on

SL/Opensimulator

• EU Projects
• e-Learning consulting
• Streaming services
• and now… Lecture recording

and delivery services

• Information System design,

development & analysis

• Network management
• Multimedia Communications
• DataWareHouse Services
• Portals design and development
• Digital Libraries

Main Main Activities Activities & Resour esources ces

Resources

• HPC Systems: High Performance

Computing platforms for technical and scientific computing

• IT Systems: "Mission Critical" platforms

used to host the IT services offered by CINECA

• Data Storage environment: a high-end

Storage Area Network connected via fiber channel and serving all the computing systems

• Graphics and Virtual Reality: a collection
• f instruments and expertise for scientific

visualization

• Multi videoconference and Access Grid

(AGnode): point of access to advanced systems of multivideoconference

Specific Specific inputs/reqs inputs/reqs vs. vs. cons consortium

• rtium approac

approach

• L2L service designed to match specific

requirements and the consortium nature:

• rationalizing resources
• putting in place “economies of scale”
• supporting different service models
• providing good services containing costs
• Currently reqs are coming from 5 universities (2

distance learning univs.)

L2L L2L service service components components

DAM Player Recorder Recorder Recorder Modules

I N T E G R A T E D D I Y

• R

E M O T E O F F

• L

I N E

MEDIAMOSA – MOODLE INTEGRATION

STORE - MNGMT

Unique centralized DAM (CINECA ASP) Multiple Univs Multiple Moodles (CINECA ASP or Univs in-house)

DEPOSIT UPLOAD L2L RECORDER

RECORDING

L2L PLAYER

DELIVERY

On-line|Off-line Different usage scenarios

Modules UNIV-B (In-house) UNIV-A (CINECA)

BB

HTML5 PLY

(not yet)

Adobe Flash Media Player Multiformat delivery and podcasting

Mosaic Podcasting

L2L L2L – Architecture Architecture

• Designed following the SOA model used by MM
• REST interactions

L2L Recorder

MD

Streaming Servers QT WM RN FM Moodle LMS Moodle Block Moodle Module L2L Player Other Services Concept Mapper Speech-to-text Transcoding Server Mediamosa DAM L2L Ingester module

FS

Still Server Download Server WebDav FTP Upload HTTP Rest HTTP Rest HTTP Rest NFS

Streaming protocols

• Ingester module in order to
• support L2L lessons’ structure
• unpack and ingest L2L packages coming form stations
• plug-in additional services (internal | external services using)

L2L L2L – re reco cord rding ing st stat ation ion

• L2L station: we provide our univs. with HW and SW
• L2L Full: designed to be integrated in a lecture hall – classroom with

A/V facilities (PC, video capture card, PTZ Camera, VGA2USB adapter, Mic, secondary 7” display) + L2L Recorder SW

• L2L Light: laptop (i5+ class CPU) + Mic + WebCam + L2L Recorder

SW

• Functionalities
• Performs the Recording (up to 2 video sources)
• Supports the recording description
• automatically: retrieves user profile, Moodle platforms, Moodle

courses using an optional SAML auth (Shib) and WSs;

• manually: title, description, tags
• Performs Sync and MD/Content extraction from MS PPT

presentations (titles, text, JPEGs for thumbs, slide change events)

• Scheduled/On-demand upload to the DAM using FTP/WebDAV
• Features
• 5 recording modes (A, A+Scr, AV, AV+Scr, AV+Ext)
• Supports off-line recording
• HQ (1Mbps each video) recording in MS WM format
• XML descriptors (technical MD, descriptive MD, structural MD, sync

MD)

• Content packaging (custom)

L2 L2L Rec L Recor

• rde

der r - wor workflow kflow

Manual/scheduled upload Quality control Recording (sync) Attachments selection Lesson type selection Manual description Automatic metadata (WS) Authentication (SAML)

O P T I O N A L

DAM DAM - Mediamosa Mediamosa

• the well-known Open Source Digital

Asset Management Platform by SurfNet…

• production env. based on a clusters

installation of the 1.7 version

• MM Functionalities in L2L:
• Mngmt: assets creation, MD mngmt,

collections (faculties),…

• Analysis/Transcodig: mediafiles

analysis, transcoding profiles for FLV- x264-mp3/Ogg-theora-vorbis/MP4- x264-aac conversions

• Multi-format delivery services:

web publication (emb., pod.) and streaming (existing streaming farm for QT, WM, Flash and RM)

• Storing all lessons’ files (videos, XML,

JPEGs, Attachemnts, PPTs, …) in MM

• L2L lessons’ representation:
• extended DC MD schema in order to

define relationships between MM assets: L2L lesson = main asset (containing 1 main XML descriptor) and related assets (containing all

• ther files) sharing commons set of

descriptive MD

Main Asset

Asset Asset Asset

Concepts XML

FLV transc. Mediafile

WM Original Mediafile

L2L Lesson

L2L Package Ingestion Module L2L Recorder

Asset

XML Desc Mediafile

Asset

JPEG Slide

L2L L2L and DAM and DAM – functional functional schema schema

Streaming

Ingest Publish Manage Store

Mediafiles Mediafiles Mediafiles Mediafiles

Assets Assets Assets Assets

Analyze Transcode Metatag Still Streaming Download WebPub View Access Workflow Metadata

Producers Editors Audience

L2L Portals WebApps Modules Portals e-Learning WebTV Uploads

External services

L2L L2L – Moo Moodle dle mod module ule

• A standard Moodle module (v1.9+)
• L2L activity usable among other

activities inside a course

• Following the Moodle model, the same

module for mngmt and viewing

• Fully compliant (backup, restore)
• Functionalities:
• browsing/searching/selecting lessons

using structural and descriptive metadata

• Managing visibility of content

(presentation, attachments) in the course context

DEMO

• L2L Player visualization
• Currently flash based
• Getting all the content from

Mediamosa (Mediafiles, JPEGs, Attachments, Presentations, XML descriptors)

• A/V visualization and sync
• Lesson “navigation” by:
• Direct access to the timeline
• Slides thumbs
• Table of contents (slides’ titles)
• Full-text search results
• Concepts

DEMO

Teacher view Student view

Moo Moodle dle blo block ck – assets assets mng mngmt mt

Moodle module for “course context” Moodle block for “Mediamosa context”

• Providing studentes with the ability to browse the lesson using a list of concepts

pointing them to the specific slide where the concept is being discussed

• L2L integrates ConceptMapper using a REST-API, a tool developed by Cineca in the

context of the European project Papyrus (news items’ annotation)

• ConceptMapper (built on top of WikipediaMiner) exploits Wikipedia information to

automatically identify and disambiguate relevant concepts in texts (it, en, de, fr).

• utputs consists in a list of concepts

identified by the titles of the Wikipedia pages that describe them

• For each concept a relatedness

measure to the document or to a domain is provided

• L2L applies two filters:
• a threshold on the relatedness

measure

• selecting concepts of a slide
• nly if they are also identified
• n the entire presentation

Con Conce cett tta a – Co Conc ncep ept t br brows

• wsing

ing

http:/ http://www.ict .ict-pa papyrus us.eu .eu

Sync (SLide) Concepts Slide Text

Publish

Co Conc ncet etta ta – wor workflow kflow

Concept Mapper

DAM

Slide Text Slide TextSlide Text L2L Package Ingestion Module L2L Recorder

Concepts

• SCORM-compliant player (mandatory for distance

learning universities)

• L2L Mosaic
• Automated post-processing based on the

GStreamer Framework

• Getting an unique A/V file from a L2L lesson

according to the lesson type and a skin

• DEMO
• New HTML5 – open video player
• Web-editing of lessons

Cur Curre rent nt work works/de s/deve velopme lopment nts s

Fu Futu ture re work works/de s/deve velopme lopment nts s

• Mediamosa 2 (Drupal 7) and Moodle 2
• Evaluate the opportunity to integrate new lecture recording software (Matterhorn)
• L2L lessons inheriting MD from Moodle courses where they are actually used
• Joining “Lecture Capturing” & “Digital Library” worlds
• digital library software integration (Fedora Commons)
• adoption of standard/specifications and models for born digital content preservation

(i.e. METS for import/export ?, OAIS model for preservation)

• Definition of preservation policies
• Integration of Speech-to-text

services

• Currently the Ingestion module

extracts the HQ audio from videos

• Testing IBM VoiceTaylor (was IBM

Attila research prj) and PerVoice

• 2 levels: concepts identification

and subtitling for accessibility (manual correction)

• Use an external service and

develop language models for specific domains (i.e. medicine, law, history)

• New techniques for A/V

segmentation (currently L2L relies on PPT)

• ePub delivery (does it make sense in

this context? Maybe for some scientific domain)

• DEMO

“Preserving digital content for future generations”

not only y backups s and dis isast ster recovery y plans lans

Sync Concepts Sync Text

Publish

speech2t speech2text, ext, conc concepts epts, subtitli subtitling ng

Audio Corrections Sync Text

« Lorem ipsum dolor sit amet, consectetur adipisici elit, sed eiusmod tempor incidunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquid ex ea commodi consequat. Quis aute iure reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint obcaecat cupiditat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. »

ConceptMapper

DAM

Speech2Text Service

Cineca

Language models

WebTV bTV Bac ack-of

• ffice

fice

GESTIONE

Ser Servi vizi zi Di Di E-lea learning ing Modulo lo L2L

Docente - Gestione Lezione Studenti

Digit Digital al Media Media Ass Asset et Mana Management gement Ser Service vice PUBBLICAZIONE

WebTV bTV

Delivery Storage Transcoding Metadata

App ppli lica cazione zione Por

• rtale

tale L2L L2L Stazion Stazione e di di registr gistrazion azione

OAI-PMH

DAM DAM integration integration scen scenarios arios

Thanks Thanks!

Matteo Bertazzo - IKMS Department infogad@cineca.it

CINECA – InterUniversity Consortium

Via Magnanelli 6/3 40033 Casalecchio di Reno (Bologna), Italy http://www.cineca.it