SURFmedia & SURFmedia Core Platform, Architecture and Features - - PowerPoint PPT Presentation

surfmedia surfmedia core
SMART_READER_LITE
LIVE PREVIEW

SURFmedia & SURFmedia Core Platform, Architecture and Features - - PowerPoint PPT Presentation

1 SURFmedia & SURFmedia Core Platform, Architecture and Features A full featured video platform for students, teachers and educational institutions to use in everyday educational environments Alexander Blanc Frans Ward


slide-1
SLIDE 1

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

SURFmedia & SURFmedia Core

Platform, Architecture and Features

Frans Ward

Frans.Ward@surfnet.nl

1

A full featured video platform for students, teachers and educational institutions to use in everyday educational environments

Alexander Blanc

Alexander.Blanc@surfnet.nl

Friday, January 30, 2009

slide-2
SLIDE 2

Agenda

About SURFnet

  • Organization & Services

SURFmedia

  • History
  • Architecture
  • Services & Features

SURFmedia Core

  • Introduction
  • Rest & Webservices
  • Main Features

Questions

2

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-3
SLIDE 3

SURFnet

Dutch National Research and Educational Network Connects over 180 educational and research institutions over IP (1 & 10 GB/s dark fiber lightpaths) Connects internationally with Geant2, GLIF, GLORIAD Approximately 1 million users (scientists, teachers and students)

3

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-4
SLIDE 4

Services

4

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Network infrastructure

Friday, January 30, 2009

slide-5
SLIDE 5

Services

4

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Help & Support Network infrastructure Authentication & Authorization Security Group Communication

Document Sharing, VideoConferencing, maillists

Multimedia Distribution

On demand & Live A/V

Friday, January 30, 2009

slide-6
SLIDE 6

5

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

1998 Audio & Video hosting service 2003 SURFnet Video Portal SURFnet-TV Live Netcasting 2007 Start of design new generation video services Existing platform ‘end of life’ Demand for new features Integration of services

MultiMedia Distribution

Friday, January 30, 2009

slide-7
SLIDE 7

5

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

1998 Audio & Video hosting service 2003 SURFnet Video Portal SURFnet-TV Live Netcasting 2007 Start of design new generation video services Existing platform ‘end of life’ Demand for new features Integration of services

MultiMedia Distribution

Friday, January 30, 2009

slide-8
SLIDE 8

6

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

SURFmedia & SURFmedia Core

GUI: end user interface Business logic: interface offered functionality Services: connects business logic with components Components: implementation of the services Data: stored data

Friday, January 30, 2009

slide-9
SLIDE 9

6

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

SURFmedia & SURFmedia Core

GUI: end user interface Business logic: interface offered functionality Services: connects business logic with components Components: implementation of the services Data: stored data SURFmedia SURFmediaCore

Friday, January 30, 2009

slide-10
SLIDE 10

SURFmedia

7

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-11
SLIDE 11

SURFmedia

7

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Features Federated Authentication, SURFnet guest idp 1GB free storage Advanced Authorization (domain and user based) Tagging, reviewing, rating Screenshots & preview videos WindowsMedia, MP4 (H.264) & Flash Streaming & download (+RSS = VodCast) Integration on-demand & live services

Friday, January 30, 2009

slide-12
SLIDE 12

Interface

8

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-13
SLIDE 13

Interface

8

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-14
SLIDE 14

Federated authentication

9

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-15
SLIDE 15

Web 2.0

10

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-16
SLIDE 16

Virtual Cutter

11

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-17
SLIDE 17

Personal environment

12

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-18
SLIDE 18

Facts and Figures

13

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

+/- 8.000 accounts +/- 42.000 assets +/- 500.000 requested streams per month Content suppliers

Friday, January 30, 2009

slide-19
SLIDE 19

Roadmap

14

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Regular release management (now working on SURFmedia 2.0) Adding functionality Integration Group Communication Services Integration Rich Media functionality Adding live streaming workflow

Friday, January 30, 2009

slide-20
SLIDE 20

Why use SURFmedia?

15

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Federation based authentication & authorization Focus on Research and Education Advanced search and find functionality High quality and multi format video Combination and integration with other end-user services Optimal ease of use Connecting via webservices (back-end)

Friday, January 30, 2009

slide-21
SLIDE 21

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

SURFmedia Core

Architecture and Features

16

A webservice oriented platform for third party content delivery A.k.a VP-X and VP-Core

Friday, January 30, 2009

slide-22
SLIDE 22

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 17

SURFmedia Core Overview

  • SMC is a Middleware Media Platform which allows

institutions to connect to with their own applications.

  • SMC facilitates access to, and usage of (shared) storage

capacity, metadata databases, transcoding- and streaming servers of SURFnet.

  • SMC offers functionality for searching, playing,

uploading, transcoding, as well as a fine granularity media access control system towards its users.

Friday, January 30, 2009

slide-23
SLIDE 23

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 17

SURFmedia Core Overview

  • SMC is a Middleware Media Platform which allows

institutions to connect to with their own applications.

  • SMC facilitates access to, and usage of (shared) storage

capacity, metadata databases, transcoding- and streaming servers of SURFnet.

  • SMC offers functionality for searching, playing,

uploading, transcoding, as well as a fine granularity media access control system towards its users.

Friday, January 30, 2009

slide-24
SLIDE 24

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 18

SURFmedia Core

  • A

s s e t M e t a d a t a S c h e m e i s e x p a n d a b l e a n d c u s t

  • m

i z a b l e . I n c l u d e d i s D C , Q D C , L O M & C Z P

  • A

u t

  • m

a t e d T r a n s c

  • d

i n g s e r v i c e s u s i n g O p e n S

  • u

r c e F F m p e g : f

  • r

c

  • m

m

  • n

f

  • r

m a t s ( F l a s h / W M V / H . 2 6 4 )

  • I

n d e x p u b l i s h i n g / h a r v e s t i n g w i t h O A I / P M H

  • S

e a r c h s e r v i c e s : f r

  • m

s i m p l e t e x t s e a r c h t

  • c
  • m

p l e x s e a r c h q u e r i e s u s i n g C Q L l e v e l 2

  • A

u t

  • m

a t e d S t i l l s g e n e r a t i

  • n
  • O

p e n S

  • u

r c e L i c e n s i n g U s i n g O p e n S

  • u

r c e T

  • l

s e t

Highlights

Friday, January 30, 2009

slide-25
SLIDE 25

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 19

SURFmedia Core

Status

Today: Release 1.4

C u r r e n t d e v e l

  • p

m e n t s

  • P

r e p a r i n g f

  • r

O p e n S

  • u

r c e ( R e a l S

  • n

N

  • w

™ ) . h t t p : / / w w w . v p c

  • r

e . n l /

  • P

i l

  • t

w i t h S U R F n e t c u s t

  • m

e r s F u t u r e d e v e l

  • p

m e n t s :

  • I

n t e g r a t i

  • n
  • f

L i v e S t r e a m i n g

  • S

u p p

  • r

t f

  • r

m u l t i p l e s t

  • r

a g e s

  • l

u t i

  • n

s

  • R

i c h M e d i a s u p p

  • r

t

Friday, January 30, 2009

slide-26
SLIDE 26

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 19

SURFmedia Core

Status

Today: Release 1.4

C u r r e n t d e v e l

  • p

m e n t s

  • P

r e p a r i n g f

  • r

O p e n S

  • u

r c e ( R e a l S

  • n

N

  • w

™ ) . h t t p : / / w w w . v p c

  • r

e . n l /

  • P

i l

  • t

w i t h S U R F n e t c u s t

  • m

e r s F u t u r e d e v e l

  • p

m e n t s :

  • I

n t e g r a t i

  • n
  • f

L i v e S t r e a m i n g

  • S

u p p

  • r

t f

  • r

m u l t i p l e s t

  • r

a g e s

  • l

u t i

  • n

s

  • R

i c h M e d i a s u p p

  • r

t

But still work in Progress!

Friday, January 30, 2009

slide-27
SLIDE 27

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 20

Architecture

  • Service Oriented Architecture

(SOA)

  • REST on the outside, REST on

the inside

  • Scalability, Redundancy, High

Availability

  • Drupal based SMC Management

Applications:

✓ SMC Administration Tool ✓ Provider Application ✓ White Label EGA

Friday, January 30, 2009

slide-28
SLIDE 28

REST

Representational State Transfer

  • All interactions (messages) with the

SURFmedia Core platform are done with REST

  • calls.
  • REST strictly refers to a collection of

network architecture principles which

  • utline how resources are defined and

addressed.

  • REST is a Client-server, Stateless,

Cacheable and Layered protocol.

  • Reduction of complexity,

improvement of performance and scalability.

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 21

SOAP was yesterday. Today is REST

Friday, January 30, 2009

slide-29
SLIDE 29

REST

Representational State Transfer

  • All interactions (messages) with the

SURFmedia Core platform are done with REST

  • calls.
  • REST strictly refers to a collection of

network architecture principles which

  • utline how resources are defined and

addressed.

  • REST is a Client-server, Stateless,

Cacheable and Layered protocol.

  • Reduction of complexity,

improvement of performance and scalability.

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 21

SOAP was yesterday. Today is REST [GET] .../asset?limit=10

<response> <header> <item_count>10</item_count> <item_count_total>31930</item_count_total> <item_offset/> <request_process_time>1.6566</request_process_time> <request_query_count>15</request_query_count> <request_result>success</request_result> <request_result_description></request_result_description> <request_result_id>601</request_result_id> <request_uri>[GET] /asset?limit=10</request_uri> <vpx_version>1.0.1-6</vpx_version> </header> <items> <item id="1"> <asset_id>1</asset_id> <app_id>1</app_id> <provider_id></provider_id> <owner_id>av-user-zfontys</owner_id> <group_id>fontys</group_id> <videotimestamp>2004-09-10 19:59:26</videotimestamp> .........

Friday, January 30, 2009

slide-30
SLIDE 30

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 22

Webservices

Webservices, over 100, divided in services for:

  • Play Video (PlayProxy HTML wrapper)
  • Authentication (DBUS for EUA)
  • Authorization (Domain, REALM, Group or

mixed)

  • Upload (PUT, POST, FTP)
  • Transcoding
  • Media Management
  • Search: Contextual Query Language (CQL)

Level 2

  • OAI/PMH: DC, QDC, LOM, CZP
  • Logging and Statistics

Friday, January 30, 2009

slide-31
SLIDE 31

SURFmedia Core Features

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 23

  • Flexible Metadata Element Sets
  • Search Services
  • Access Management
  • Streaming, Transcoding & Stills
  • Upload Services

Friday, January 30, 2009

slide-32
SLIDE 32

Flexible Metadata Element Sets

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 24

CRUD REST

  • calls on all objects possible. i.e.:
  • POST /asset/create?user=John
  • GET /asset/id
  • POST /asset/id/update?title=”New Title”
  • POST /collection/delete?user=Asset

Metadata Element Sets Provided:

  • Standard Dublin Core (DC)
  • Qualified Dublin Core (QDC)
  • Learning Object Metadata (LOM)
  • ‘Content Zoek Profiel’ (CZP)

Plus support for own (custom) Metadata Element Sets

Friday, January 30, 2009

slide-33
SLIDE 33

Search Services

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 25

Simple Search:

  • GET /asset?owner=John
  • GET /asset?collection=7

Advanced Search using CQL level 2 :

  • “(dc.title = foo OR qdc.title_alternative = bar)”
  • “NOT (dc.title = foo AND dc.title = bar)”
  • “^cat ^dog tree^”

http://www.loc.gov/standards/sru/specs/cql.html

Friday, January 30, 2009

slide-34
SLIDE 34

Access Management

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 26

Default: Mediafile is accessible for everyone. Option to set access restrictions for playing media on the following properties:

  • Domain, i.e only accessible from surfnet.nl
  • Domain Groups, i.e.: Academia group (all universities)
  • Realm, i.e. Federated Authentication using SURFfederation

infrastructure.

  • Realm Groups, i.e.: '@teleblik' realm
  • User: only give rights to user=john
  • User Groups, i.e.: only give rights to users of group

"class-24". Combinations of the above are possible! De end-user portal designer decides how and what to use.

Friday, January 30, 2009

slide-35
SLIDE 35

Streaming, Transcoding & Stills

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 27

  • S

t r e a m i n g s e r v e r s : F l a s h , M P E G 4 ( H . 2 6 4 ) , W M V

  • A

l l t r a n s c

  • d

i n g h a n d l e d b y F F m p e g , e x p a n d e d w i t h V C

  • 1

t

  • l

s e t ( W M V

  • 9

)

  • T

r a n s c

  • d

i n g s e t t i n g s s t

  • r

e d i n P r

  • fi

l e s

  • A

u t

  • H

i n t i n g f

  • r

M P E G 4

  • A

u t

  • m

a t i c S t i l l s E x t r a c t i

  • n

Friday, January 30, 2009

slide-36
SLIDE 36

Streaming, Transcoding & Stills

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 27

  • S

t r e a m i n g s e r v e r s : F l a s h , M P E G 4 ( H . 2 6 4 ) , W M V

  • A

l l t r a n s c

  • d

i n g h a n d l e d b y F F m p e g , e x p a n d e d w i t h V C

  • 1

t

  • l

s e t ( W M V

  • 9

)

  • T

r a n s c

  • d

i n g s e t t i n g s s t

  • r

e d i n P r

  • fi

l e s

  • A

u t

  • H

i n t i n g f

  • r

M P E G 4

  • A

u t

  • m

a t i c S t i l l s E x t r a c t i

  • n

Friday, January 30, 2009

slide-37
SLIDE 37

Upload Services

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research 28

  • POST upload using End User Application

(limited to 2 GB)

  • POST upload directly to SURFmedia Core

Platform using ticket system (limited to 2 GB)

  • HTTP PUT upload using End User Application

(i.e. Java Upload Applet)

  • FTP batch upload (“no” limits) including

metadata in XML file

  • Quota per End User Application
  • Support for Master / Slave content sharing

(Provider Application)

Friday, January 30, 2009

slide-38
SLIDE 38

Questions?

29

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009

slide-39
SLIDE 39

Questions?

29

Media Management and Distribution Workshop - Zurich, January 29, 2009

SURFnet, Pioneering Network for Higher Education and Research

Friday, January 30, 2009