GAZE ESTIMATOR Tsahi Saporta Advisor: Prof. Andrei Sharf - PowerPoint PPT Presentation

Jan 22, 2023 •227 likes •342 views

GAZE ESTIMATOR Tsahi Saporta Advisor: Prof. Andrei Sharf Requirements: Stage 1: Finding rectangles Stage 2: Finding 68 facial-landmarks by using dlib shape predictor dlib landmarks meaning Stage 3 (simultaneously): Head-pose estimation

GAZE ESTIMATOR Tsahi Saporta Advisor: Prof. Andrei Sharf
Requirements:
Stage 1: Finding rectangles
Stage 2: Finding 68 facial-landmarks by using ”dlib shape predictor”
dlib landmarks meaning
Stage 3 (simultaneously): Head-pose estimation
Stage 3 (simultaneously): Finding pupils
Stage 4: Accomplishing gaze estimation
Difficulties: • To find the best model for head-pose estimation (Cylinder model + scaling-factors). • Automatic calibration (Too many scaling-factors).
Thank you for listening!

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

gaze-following and recognizing intentions from gaze Outline infant gaze following studies

gaze-following and recognizing intentions from gaze Outline infant gaze following studies and intentionality gaze following and object processing Do infants gaze-follow? Infants turn in the direction that an adult has turned.

415 views • 25 slides

Gaze Tracking -Shashank Shekhar Aim To estimate a person's gaze using a webcam. Gaze

Gaze Tracking -Shashank Shekhar Aim To estimate a person's gaze using a webcam. Gaze tracking can be used in interactive applications as a means to take inputs. Possible Approaches 3-D gaze tracking 2-D gaze tracking

514 views • 7 slides

a story telling robot: modelling and evaluation of human-like gaze behaviour 1 motivations

a story telling robot: modelling and evaluation of human-like gaze behaviour 1 motivations social functions of gaze behaviour gaze and task performance previous work on simulating gaze behaviour in agents and robots How are

245 views • 11 slides

Outline Gaze-Based Interaction in Cinematic 360 VR Cinematic 360 VR Gaze-Based

Outline Gaze-Based Interaction in Cinematic 360 VR Cinematic 360 VR Gaze-Based Interaction Non-Linear Storytelling Media Authoring Luiz Velho VISGRAF Lab - IMPA Case Study Omnidirectional Video Equirectangular Format -

446 views • 10 slides

Learning to Predict Gaze in Egocentric Videos Yin Li, Alireza Fathi, James M. Rehg Outline: -

Learning to Predict Gaze in Egocentric Videos Yin Li, Alireza Fathi, James M. Rehg Outline: - What is visual saliency (through Itti Koch & Torralba methods) - Gaze distributions for GTEA Gaze + dataset (per user and per task) - Local

580 views • 21 slides

Testing proportions BIO5312 FALL2017 STEPHANIE J. SPIELMAN, PHD Estimation An estimator is a

Testing proportions BIO5312 FALL2017 STEPHANIE J. SPIELMAN, PHD Estimation An estimator is a statistic (~formula) for estimating a parameter A good estimator is unbiased The expected value (expectation) of the estimator should equal the

1.1k views • 55 slides

Learning video saliency from human gaze using candidate selection Rudoy,Goldman, Schechtman,

Learning video saliency from human gaze using candidate selection Rudoy,Goldman, Schechtman, Manor Akanksha Saran CS381V: Experiment Presentation Outline Description of Gaze Datasets -DIEM -CRCNS Analysis of Human Gaze Datasets

593 views • 47 slides

Learning to Anticipate Gaze: Top-Down Approach Mentor: Dr. Amitabha Mukerjee Presented by

Learning to Anticipate Gaze: Top-Down Approach Mentor: Dr. Amitabha Mukerjee Presented by Vempati Anurag Sai SE367 Cognitive Science Introduction Humans deploy anticipatory gaze in many situations. While moving around, driving

346 views • 13 slides

Implementation Strategies for Eye Gaze Users Katelyn Oeser SLP Brenda Del Monte SLP They are

Implementation Strategies for Eye Gaze Users Katelyn Oeser SLP Brenda Del Monte SLP They are doing it with their eyes! Why do we put kiddos on eye gaze? Vision is a relative strength Direct Select with a pointer finger is not reliable

721 views • 28 slides

Saccade Tasks Visual Search Saccades Micro-Fixation Saccades Reading Gaze Shifts Reading Gaze

Derivation of Saccade Saccade Tasks Visual Search Saccades Micro-Fixation Saccades Reading Gaze Shifts Reading Gaze Shifts Catch-up Saccades Saccadic Fast Phase Ballistic nature of saccades. Pulse and step are pre-programmed Latency

4.22k views • 45 slides

The experiments for You -Do, I- Learn Presenter: Wenguang Mao Instructor: Kristen Grauman

The experiments for You -Do, I- Learn Presenter: Wenguang Mao Instructor: Kristen Grauman Author for the paper: Dima Damen Recap of the Paper Gaze attention Gaze point Clustering position Clustering TRO MOI Gaze area appearance

597 views • 41 slides

Three classes of eye movements: Gaze Stabilization with body movement Optokinetic Nystagmus (OKN)

Three classes of eye movements: Gaze Stabilization with body movement Optokinetic Nystagmus (OKN) Vestibulo-ocular reflex (VOR) Foveal gaze shifts with attention shifts Saccades Asymmetric vergence Foveal Maintenance of stationary &

477 views • 20 slides

Multimodal Interaction Eye Gaze and Head Movement Tracking Iris Recognition Dr Pradipta Biswas,

Multimodal Interaction Eye Gaze and Head Movement Tracking Iris Recognition Dr Pradipta Biswas, PhD (Cantab) Assistant Professor Indian Institute of Science http://cpdm.iisc.ernet.in/PBiswas.htm What is Eye Tracking & Gaze Control Eye

665 views • 18 slides

Gaze-Assisted Remote Communication Between Teacher And Students Kari-Jouko Rih, Oleg pakov,

Gaze-Assisted Remote Communication Between Teacher And Students Kari-Jouko Rih, Oleg pakov, Howell Istance Diederick C. Niehorster University of Tampere Lund University Previous Work on Shared Gaze Offline (experts pre-recorded

817 views • 22 slides

DEEP UNCONSTRAINED GAZE ESTIMATION WITH SYNTHETIC DATA Shalini De Mello, Rajeev Ranjan, Jan Kautz

DEEP UNCONSTRAINED GAZE ESTIMATION WITH SYNTHETIC DATA Shalini De Mello, Rajeev Ranjan, Jan Kautz NVIDIA AI CO-PILOT 2 APPLICATIONS INTERFACE DESIGN AR/VR ACCESSIBILITY 3 TRADITIONAL GAZE TRACKERS Fovea Cornea C E Sclera Pupil C c ,

665 views • 47 slides

Realtime Gaze Estimation with Online Calibration Li Sun, Mingli Song, Zicheng Liu, Ming-Ting Sun

Realtime Gaze Estimation with Online Calibration Li Sun, Mingli Song, Zicheng Liu, Ming-Ting Sun Outline Introduction Limitations & goals Proposed method Results Demo Gaze Estimation Dia iagnostic applications:

520 views • 24 slides

What is Mul-modal Interac-on? Using two or more modes of

Orko: Facilita-ng Mul-modal Interac-on for Visual Explora-on and Analysis of Networks CPSC 547 Networks Presenta-on Peyvand Forouzandeh 1 What is

568 views • 26 slides

Boundary Conditions for Information Visualization with respect to the Users Gaze Marcus

Technische Universitt Mnchen Boundary Conditions for Information Visualization with respect to the Users Gaze Marcus Tnnis, Gudrun Klinker {toennis,klinker}@in.tum.de Tnnis, Klinker - Boundary Conditions for Information

499 views • 24 slides

Where are they looking? But why? Goal Perform

Where are they looking? But why? Goal Perform gaze-following in natural se:ngs. Only a single view available. Without restric@ve assump@ons.

209 views • 20 slides

Long-run saving Peter Praet and monetary policy Member of the Executive Board of the ECB

Long-run saving Peter Praet and monetary policy Member of the Executive Board of the ECB Parliamentary evening on "Challenges for long-term savings products in the context of the zero- interest policy" Brussels, 14 November 2016

337 views • 5 slides

Dynamics of Economic Growth and Poverty Reduction The Divergent Paths of Tanzania and Zambia

Dynamics of Economic Growth and Poverty Reduction The Divergent Paths of Tanzania and Zambia Ingo Pitterle and Micha Podolski United Nations, Department of Economic and Social Affairs Economic Analysis and Policy Division UN-WIDER &

406 views • 29 slides

Ch.1-2. Introduction to Globalization A P D M 4 7 1 I N T E R N A T I O N A L A P P A R E L T

Ch.1-2. Introduction to Globalization A P D M 4 7 1 I N T E R N A T I O N A L A P P A R E L T R A D E I S S U E S Y O U N G J I N B A H N G , P H . D . U N I V E R S I T Y O F H A W A I I A T M A N O A Measuring Levels of Development

442 views • 14 slides

Comments on Modelling the business cycle in a multivariate structural time series model for

Comments on Modelling the business cycle in a multivariate structural time series model for the G7 and the Netherlands Gabriel Perez Quiros The usual disclaimer applies Brief summary. Specification Structural time series model that

511 views • 24 slides

Impacts of Monetary Stimulus on Credit Allocation and Macroeconomy: Evidence from China 1 Kaiji

Impacts of Monetary Stimulus on Credit Allocation and Macroeconomy: Evidence from China 1 Kaiji Chen a Patrick Higgins b Daniel F. Waggoner c Tao Zha d a Emory University b FRB Atlanta c FRB Atlanta d FRB Atlanta and NBER Workshop on Nonlinear

888 views • 34 slides