Kinect@Home: Crowdsourced RGB-D data Rasmus Gransson, Alper Aydemir - PowerPoint PPT Presentation

Jul 04, 2023 •760 likes •1.01k views

Kinect@Home: Crowdsourced RGB-D data Rasmus Gransson, Alper Aydemir and Patric Jensfelt Overview What? Why? How? Where? When? What? Kinect@Home have collected nearly 1000 RGB-D video recordings from users

Kinect@Home: Crowdsourced RGB-D data Rasmus Göransson, Alper Aydemir and Patric Jensfelt
Overview What? ● Why? ● How? ● Where? ● When? ●
What? Kinect@Home have collected nearly 1000 RGB-D video ● recordings from users all around the world We have selected 54 of these recordings to be released ● as the first dataset
Why? Algorithms are getting better ● It is time to give them better challenges ● Recordings made in-house are biased ● Crowdsourcing provides real world data with less bias ●
Why?
Why?
How? Data collection needs to be simple for the users ● Users need a reason to collect data = motivation ●
How? Data collection needs to be simple for the users ● Users need a reason to collect data = motivation ● Upload recordings with web browser ●
How? Data collection needs to be simple for the users ● Users need a reason to collect data = motivation ● Upload recordings with web browser ● Perform 3D reconstruction in the cloud ●
How? Data collection needs to be simple for the users ● Users need a reason to collect data = motivation ● Upload recordings with web browser ● Perform 3D reconstruction in the cloud ● Present the results within minutes ●
How?
How?
How?
What about ground truth? There is no ground truth ●
What about ground truth? There is no ground truth ● ...but the dataset is still useful! ●
How can it be used? By comparing different algorithms ● Kinfu vs. key point based (SURF) pose estimation ●
How can it be used? Kinfu
How can it be used? SURF
How can it be used? Kinfu
How can it be used? SURF
How can it be used?
Where? Download the dataset with the 54 recordings from: ● www.kinectathome.com/datasets
When? NOW! :) ● This dataset and future releases will be available from ● www.kinectathome.com/datasets
What about ...? Questions please! ●

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

2 At Home: Kinect IR Camera RGB Camera There are some problems with cameras 3 Illumination

2 At Home: Kinect IR Camera RGB Camera There are some problems with cameras 3 Illumination 4 Occlusion 5 Bandwidth 6 Power Consumtion 7 Cost 8 Privacy? 9 Other Sensing Methods? Vision is one of our main senses What else

706 views • 55 slides

Kinect Device How the Kinect Works T2 Subhransu Maji Slides credit: Derek Hoiem, University of

4/27/16 Kinect Device How the Kinect Works T2 Subhransu Maji Slides credit: Derek Hoiem, University of Illinois Photo frame-grabbed from: http://www.blisteredthumbs.net/2010/11/dance-central-angry-review Kinect Device What the Kinect does

490 views • 11 slides

Human Body Recogni6on and Tracking: Kinect RGB-D Camera How the Kinect RGB-D Camera Works

Human Body Recogni6on and Tracking: Kinect RGB-D Camera How the Kinect RGB-D Camera Works MicrosoC Kinect for Xbox 360 aka Kinect 1 (2010) Color video camera + laser- projected IR dot paUern + IR camera IR laser projector

389 views • 11 slides

Acquisition of a three- dimensional model through Microsoft Kinect The Microsoft Kinect RGB

Acquisition of a three- dimensional model through Microsoft Kinect The Microsoft Kinect RGB camera sensor IR projector and sensor Microphones array Three axis accelerometer The Microsoft Kinect 30 fps: RGB: 640 x 480 pixels;

396 views • 25 slides

GESTURE SENSORS Microsoft Kinect V1 24M - 2013 Microsoft Kinect V2 20M - 2016 + VR + GESTURE

GESTURE SENSORS Microsoft Kinect V1 24M - 2013 Microsoft Kinect V2 20M - 2016 + VR + GESTURE SENSING 3 AR + GESTURE SENSING 4 GESTURE SENSORS ALL SORTS AND SIZES Asus Xtion Pro Live Microsoft Kinect V2 Microsoft Kinect V1 Creative

664 views • 39 slides

Using sparse optical flow for multiple Kinect applications 27.6.2013 Stefan Guthe 1 Microsoft

Using sparse optical flow for multiple Kinect applications 27.6.2013 Stefan Guthe 1 Microsoft Kinect Recap and Impact Launched October 2010 Consumer-Grade RGB-D Sensor Over 3000 papers in the last 3 years related to the Kinect

638 views • 20 slides

RaceMob: Crowdsourced Data Race Detec,on Baris Kasikci, Cris,an

RaceMob: Crowdsourced Data Race Detec,on Baris Kasikci, Cris,an Zamfir, and George Candea School of Computer & Communica3on Sciences Tuesday 12 November 13 Data Races

767 views • 25 slides

Recognises your face and voice Kinect Adventures What the Kinect Sees top view side view

D EPTH , H UMAN P OSE , AND C AMERA P OSE JAMIE SHOTTON Depth sensing camera Tracks 20 body joints in real time Recognises your face and voice Kinect Adventures What the Kinect Sees top view side view depth image (camera view)

1.01k views • 79 slides

Using Openstreetmap crowdsourced data and La Landsat im imagery for la land cover mapping in

Using Openstreetmap crowdsourced data and La Landsat im imagery for la land cover mapping in in th the La Laguna de Bay area of f th the Philippines Brian A. Johnson*, Kotaro lizuka, lsao Endo, Damasa B. Magcale-Macandog, Milben Bragais

389 views • 13 slides

Point Cloud based Gesture Recognition with Kinect 2 Anton Klarn, Jonathan Karlsson Kinect v2

Point Cloud based Gesture Recognition with Kinect 2 Anton Klarn, Jonathan Karlsson Kinect v2 2.5D Sensor (Depth) Time-of-flight sensor Full HD color camera 4-microphone array 30+ frame rate (Demo of Point Cloud)

640 views • 16 slides

Using Crowdsourced Data and Open Source Tools in Government Michael Schnuerle, Chief Data Officer

Using Crowdsourced Data and Open Source Tools in Government Michael Schnuerle, Chief Data Officer Office of Civic Innovation and Technology Louisville, Kentucky, USA NOCoE - Adventures in Crowdsourcing January 28, 2020 Office of Civic

498 views • 35 slides

Crowdsourced IoT Data Modeling Friederike Groschupp Final Talk for Bachelors Thesis Advisors:

Chair of Network Architectures and Services Department of Informatics Technical University of Munich Crowdsourced IoT Data Modeling Friederike Groschupp Final Talk for Bachelors Thesis Advisors: Marc-Oliver Pahl, Stefan Liebald March 19,

555 views • 40 slides

Integration of Crowdsourced Data into Automated Traffic Signal Performance Measures (ATSPMs)

Integration of Crowdsourced Data into Automated Traffic Signal Performance Measures (ATSPMs) Adventures in Crowdsourcing: Traffic Signal Applications February 27, 2020 Justin R. Effinger, P.E. Lake County PASSAGE ATMS Platform

461 views • 18 slides

3D RECONSTRUCTION Reconstruction method Reconstruction from images Reconstruction from video

3D RECONSTRUCTION Reconstruction method Reconstruction from images Reconstruction from video Using Kinect Raw Depth Image Infrared laser projector Monochrome CMOS sensor Demo Kinect Raw data Real-time Reconstruction Pipeline Measurement

508 views • 34 slides

Truth Discovery for Spatio-Temporal Events from Crowdsourced Data Daniel Garca Ulloa, Li

Truth Discovery for Spatio-Temporal Events from Crowdsourced Data Daniel Garca Ulloa, Li Xiong, Vaidy Sunderam Emory University Logo Image Here Author (Institution) Short Title Date or Conference Content Introduction Truth

664 views • 25 slides

Crowdsourced Classification with XOR Queries: An Algorithm with Optimal Sample Complexity

Crowdsourced Classification with XOR Queries: An Algorithm with Optimal Sample Complexity Daesung Kim and Hye Won Chung School of Electrical Engineering, KAIST ISIT, 2020 Introduction Crowdsourcing A method to label data with very small

502 views • 21 slides

Large-Scale Network Topology Emulation and Inference Erik Rye Naval Postgraduate School

Large-Scale Network Topology Emulation and Inference Erik Rye Naval Postgraduate School Monterey, CA 31 March 2015 1 / 22 Outline 1 Motivation and Methodology Motivation Emulated Router Inference Kit 2 Results An example topology Example

726 views • 24 slides

Surrogate Scoring Rules Juntao Wang, Harvard University Yiling Chen, Harvard University

Yang Liu, UCSC Surrogate Scoring Rules Juntao Wang, Harvard University Yiling Chen, Harvard University Research Question: Can we incentivize high-quality prediction when the ground truth is unavailable? Incentivize truthful reporting (P1)

262 views • 4 slides

for Session Segmentation Vernika Peralta, Willeme Verdeaux, Yann Raimont, Patrick Marcel LIFAT

Qualitative Analysis of the SQLShare Workload for Session Segmentation Vernika Peralta, Willeme Verdeaux, Yann Raimont, Patrick Marcel LIFAT University of Tours France DOLAP Lisboa March 2019 Interactive Data Exploration In

529 views • 19 slides

and Conditional Random Field Peng Wang, UCLA Why it is important to fuse multi-tasks in vision

Multi Visual Task Fusion with Deep CNN and Conditional Random Field Peng Wang, UCLA Why it is important to fuse multi-tasks in vision Human are performing multi-tasks simultaneously and register them well. Only by understanding fully and

481 views • 26 slides

Introduction to Machine Learning and Tensorflow Manu Mathew Thomas Creative Coding Lab What is

Introduction to Machine Learning and Tensorflow Manu Mathew Thomas Creative Coding Lab What is Machine Learning ? A class of algorithms which learns to performs a specific task based on sample data and without any explicit instruction

1.45k views • 48 slides

Slide 1 _ _ Understanding

Slide 1 ___________________________________ ___________________________________ Understanding Research Results ___________________________________ Chapter 12 ___________________________________ ___________________________________

295 views • 8 slides

Highways and byways in group-theoretic genome space Attila Egri-Nagy, joint work with Andrew

Highways and byways in group-theoretic genome space Attila Egri-Nagy, joint work with Andrew Francis and Volker Gebhardt Centre for Mathematics Research, School of Computing, Engineering and Mathematics University of Western Sydney Phylomania

511 views • 34 slides

Irrational slope Thompsons groups Brita Nucinkis joint with J. Burillo and L. Reeves Brita

Irrational slope Thompsons groups Brita Nucinkis joint with J. Burillo and L. Reeves Brita Nucinkis Irrational slope Thompsons groups The Bieri-Strebel Groups Definition (Bieri-Strebel 1980s) Let I R be an interval, A a subring of R

445 views • 22 slides