USER-CENTRIC SOCIAL MULTIMEDIA COMPUTING FROM USERS,ON USERS,FOR USERS Jitao Sang Institute of Automation， Chinese Academy of Sciences. jtsang@nlpr.ia.ac.cn MMM 2015 Tutorial
Goal of this tutorial Taxonomy of problems and literature: from the user- centric perspective. Literature overview: examples from both our group and others. Discussion: the instantiation in new scenarios, the challenges and future directions. MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social media is boosting. MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social Media Social media is the social interaction among people in which they create, share or exchange information and ideas in virtual communities and networks. -------- Wikipedia MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social Media multimedia SNS Photo RSS Sharing Virtual Video World Sharing Social Media Social Check- Game In Micro IM Blog Blog social media panorama 5 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Multimedia is dominant in social media. actively contribute, obtain and propagate rich multimedia data actively obtain textual Micro-blogging, multimedia and little visual data sharing websites, SNS ； passively receive Search engine, forums ； User-contributed becomes textual data Users mainly contribute the main mechanism for Portal websites ； data generation; to textual data; Information is edited by Constrained by the Development in capturing professional editors, and network conditions and devices and network for passive users. capturing devices, textual transmission, huge Constrained by the information dominates. multimedia data are network conditions and produced and consumed. capturing devices, textual Mobile Internet information dominates. Portal Era Search Era Social Media Era 社交媒体时代 2009 2011 1996 1999 2005 2007 WEB 1.0 WEB 2.0 Internet media roadmap 6 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Multimedia is dominant in social media. actively contribute, obtain and propagate rich multimedia data actively obtain textual Micro-blogging, multimedia and visual data sharing websites, SNS ； passively receive Twitter increases its support on Search engine, forums ； WeChat has attracted more User-contributed becomes multimedia content, and releases textual data than 300 million users in two the 6-second video sharing app: Vine. Users mainly contribute the main mechanism for Portal websites ； years, which is tending to data generation; to textual data; replace SMS. Information is edited by Constrained by the Development in capturing professional editors, and network conditions and devices and network People are getting used to get access to for passive users. capturing devices, textual transmission, huge Constrained by the information in the form of multimedia data. information dominates. multimedia data are network conditions and produced and consumed. capturing devices, textual Mobile Internet information dominates. Portal Era Search Era Social Media Era 社交媒体时代 2009 2011 1996 1999 2005 2007 WEB 1.0 WEB 2.0 Internet media roadmap 7 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
“Social” trend in multimedia 350 million photos are uploaded daily in November 2013 on image tweet 1.4 million minutes of chats are produced every minute on audio photo 100 hour videos are uploaded every minute , resulting in 2 billion videos totally by the end of 2013 on geo-tagged video 8 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social Multimedia Definition: “An online source of multimedia resources that fosters an environment of significant individual participation and that promotes community curation, discussion and re-use of content.” --- -- Mor Naaman efficient information Social Media access and propagation Social Multimedia rich sensor simulation Multimedia 9 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social Multimedia Social Media User Social Social Social Interact- Multimedia Media -ion Media Content Social Social Multimedia Multimedia Multimedia Multimedia Multimedia 10 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social Multimedia Computing Interact- -ion User User Social Multimedia Interact- Interact- User Content Computing -ion -ion Content Content Search Entertainment Security Healthcare Communication 11 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Social Multimedia Computing Signal Computer processing vision Visual/quditory Information Multimedia physiology retrieval Social Multimedia Computing Data mining Human-computer Social interaction Media Sociology Organizational theory Psychology 12 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Content-centric V.S. User-centric The focus is multimedia CONTENT understanding and application Typical tasks include media content analysis, semantic classification, Heavily related to WEB1.0. structured media authoring, etc. Dominated by BROADCAST Traditional Multimedia media developed by professional designers for PASSIVE users. Computing Web Multimedia Computing Social Multimedia Computing semantic gap From User : User is the basic data collection unit. For User : User is the ultimate information service target. intent gap 13 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the basic data collection unit. 视频语义特征提取 14 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
15
UGC is dominant UGC videos make up 4/5 of total Consumers rely more on UGC for video views. info about medications. ( source: AccuStream.com ) 2012-2013 witnesses a boosting rise of MOOC in online education. ( MOOC: Massive Open Online Courses ) ( source: Infographics ) 16 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
the Role of User in Social Multimedia User serves as bridges between social network and multimedia network: Social Network user content Multimedia Network interaction 17 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the basic data collection unit Each user is analog to a data sensor EMC 2 estimates that each person see speak contributes to 45GB social media data on listen feel average. think User collaboration leads to crowded knowledge/intelligence [ESP games] [WAZE] Image label Image segmentation 18 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the ultimate information service target. 视频语义特征提取 视频事件检测和 个性化检索 19 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the information service target. Social multimedia tends to be consumerized : Information Service 20 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the information service target. Information explosion: Opportunity V.S. Challenge to information services. Get lost in front of information overload. 21 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the information service target. Personalization stands out for solution: Rank results considering web Douban FM: personalized music history and +1 statistics listening channel. 22 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User is the information service target. Understanding user intents and preferences is key to personalized services. User Information Overload Personalized Service Modeling 23 MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User-centric Social Multimedia Computing User-centric Social Multimedia Computing From Users : On Users : For Users : User Modeling User-aware User-perceptive based on Social Multimedia Services Multimedia Analysis Multimedia Activity General Challenges & Social -> Multimedia Multimedia -> Social End Applications MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
User-centric Social Multimedia Computing User-centric Social Multimedia Computing ① ② From Users : On Users : For Users : User Modeling User-aware User-perceptive based on Social Multimedia Services Multimedia Analysis Multimedia Activity General Challenges & Social -> Multimedia Multimedia -> Social End Applications ③ User-centric Cross-network Social Multimedia Computing More background & context: Springer book: “User-centric Social Multimedia Computing”. MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Outline Introduction (15’) Part I – From Users : User-perceptive Multimedia Analysis (1h) Break (15’) Part II - On Users : User Modeling based on Social Multimedia Activity (35’) Part III : User-centric Cross-network Social Multimedia Computing (35’) Conclusion & QA (20’) MMM 2015 Tutorial (Introduction) – Jitao Sang Jan.5, 2015
Recommend
More recommend
