the dynamic image segmentation for sign language training
play

The Dynamic Image Segmentation for Sign Language Training Simulator - PowerPoint PPT Presentation

Sep 15, 2023 •299 likes •426 views

The Dynamic Image Segmentation for Sign Language Training Simulator Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 1 Gesture (a) Start of the gesture (b) Intermediate frame (c) Intermediate frame (d)

  1. The Dynamic Image Segmentation for Sign Language Training Simulator Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 1

  2. Gesture (a) Start of the gesture (b) Intermediate frame (c) Intermediate frame (d) Final frame Figure 1: Gesture “What for” Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 2

  3. Dactyl (a) Starting dactyl (b) Final dactyl Figure 2: Dactyls describing gesture “What for” Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 3

  4. Dactyl Matching Figure 3: Recognition of Fingertips Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 4

  5. Colour Space in Image Clustering with SOM (a) Original (b) RGB (c) HSL (d) CIELab Figure 4: Clustering of an image represented in different colour spaces Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 5

  6. Training Data Composition   ( L 1 1 , a 1 1 , b 1 1 ) T ( L 1 2 , a 1 2 , b 1 2 ) T ( L 1 3 , a 1 3 , b 1 3 ) T ( L 1 4 , a 1 4 , b 1 4 ) T     ( L 2 1 , a 2 1 , b 2 1 ) T ( L 2 2 , a 2 2 , b 2 2 ) T ( L 2 3 , a 2 3 , b 2 3 ) T ( L 2 4 , a 2 4 , b 2 4 ) T   A =     ( L 3 1 , a 3 1 , b 3 1 ) T ( L 3 2 , a 3 2 , b 3 2 ) T ( L 3 3 , a 3 3 , b 3 3 ) T ( L 3 4 , a 3 4 , b 3 4 ) T       ( L 4 1 , a 4 1 , b 4 1 ) T ( L 4 2 , a 4 2 , b 4 2 ) T ( L 4 3 , a 4 3 , b 4 3 ) T ( L 4 4 , a 4 4 , b 4 4 ) T   ( L 1 1 , a 1 1 , b 1 1 ) T ( L 1 2 , a 1 2 , b 1 2 ) T S 1 =     1 ) T 2 ) T ( L 2 1 , a 2 1 , b 2 ( L 2 2 , a 2 2 , b 2 Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 6

  7. Cluster Interpretation • Image pixels represented by topologically close neurons should be- long to the same cluster and therefore segment. • The colour or marker used for a segment representation is irrelevant as long as each segment is associated with a different one. R j ← x j + y j × λ ; G j ← x j + y j × λ ; B j ← x j + y j × λ ; (1) Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 7

  8. Application Results (a) Frame 25 original (b) Frame 25 segmented (c) Frame 35 original (d) Frame 35 segmented Figure 5: Frames 25 and 35 Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 8

  9. Application Results (a) Frame 45 original (b) Frame 45 segmented (c) Frame 65 original (d) Frame 65 segmented Figure 6: Frames 45 and 65 Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 9

  10. Other Applications (a) Original (b) Segmented (c) Original (d) Segmented Figure 7: Cloth Segmentation for Image Search Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 10

  11. Alternative Approach (a) Sample 1 (b) Sample 2 Figure 8: Cloth Segmentation for Image Search Oles Hodych, Kostiantyn Hushchyn, Iouri Nikolski, Volodymyr Pasichnyk, Yuri Shcherbyna 11

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a Segmentation is the process of partitioning an digital image correspond to the objects to be image into semantically interpretable

766 views • 24 slides
1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

1 Method Outline Fragment Matching Fragment Extraction Individual Correspondence

Overview (1) The major goal of image segmentation is to identify structures in the image that are likely to Class-Specific, Top-Down correspond to scene objects Classic image-based segmentation methods use Segmentation continuity of

523 views • 3 slides
Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set

Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set

Segmentation H. Papasaika, E. Baltsavias Image Segmentation Partitioning of an image into a set of regions Regions representing meaningful areas of the image, such as crops, urban areas, forests. Various applications in Computer

781 views • 61 slides
Image Segmentation Segmentation is the process of partitioning an image into regions

Image Segmentation Segmentation is the process of partitioning an image into regions

Image Segmentation Segmentation is the process of partitioning an image into regions region: group of connected pixels with similar properties properties properties: gray levels, colors, textures, motion characteristics (motion

546 views • 19 slides
Segmentation from Natural Language Expressions Ronghang Hu, Marcus Rohrbach, Trevor Darrell

Segmentation from Natural Language Expressions Ronghang Hu, Marcus Rohrbach, Trevor Darrell

Segmentation from Natural Language Expressions Ronghang Hu, Marcus Rohrbach, Trevor Darrell Presenter: Tianyi Jin Comparisons between different semantic image segmentation problems (f) Natural Language Object Retrieval: bounding box

304 views • 16 slides
Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University

Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University

Lecture 6: Segmentation 2014-11-14 Robin Strand Centre for Image Analysis Dept. of IT Uppsala University Today What is image segmentation? A smrgsbord of methods for image segmentation: Thresholding Edge-based segmentation

830 views • 51 slides
Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation Hengshuang Zhao The Chinese University of Hong Kong May 29, 2019 Part I: I: Semantic Segmentation Semantic Segmentation background car person

510 views • 39 slides
Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Day 4 Lecture 2 Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image Segmentation: Datasets Pascal Visual Object Classes Microsoft COCO 20 Classes 80 Classes ~ 5.000 images ~ 300.000 images

995 views • 26 slides
Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics. Contours are the lines separating

676 views • 32 slides
Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV Tools Layers Viewers Final Segmenting Original Scan Segmentation using Seg3D 2 3 Tools Menu Interactive tools for operating on volume

448 views • 10 slides
Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Accel : A Corrective Fusion Network for Efficient Semantic Segmentation on Video Samvit Jain , Xin Wang , Joseph Gonzalez RISE Lab, UC Berkeley Semantic segmentation Image classification Object detection Semantic segmentation Evolution

857 views • 13 slides
Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017

Lecture 8: Image Segmentation Peng Chao Face++ Researcher pengchao@megvii.com Nov. 2017 Image Segmentation Semantic Segmentation Instance Segmentation Scene Parsing Human Parsing Stuff Segmentation New Track in COCO 2017

1.04k views • 103 slides
YIN XU 1. Image Segmentaion & Retrieval What is image segmentation? Whats the

YIN XU 1. Image Segmentaion & Retrieval What is image segmentation? Whats the

CS688: Large-Scale Image & Video Retrieval (Spring 2020) YIN XU 1. Image Segmentaion & Retrieval What is image segmentation? Whats the relationship to image retrieval? 2. Current challenges & solutions: Challenges: Intra-class

239 views • 23 slides
Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline Overview Three Levels of Segmentation Basic Segmentation Semantic Segmentation (FCN, DeepLab) Instance Segmentation (Mask-RCNN)

449 views • 28 slides
FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION

FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION

FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION TO ROBOT VISION J. Chamorro-Martnez D. Snchez B. Prados-Surez Department of Computer Science and Artificial Intelligence. University of

164 views • 15 slides
VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a fundamental low level operation on Segmentation is a fundamental low-level operation on images. If an image is already partitioned into segments

639 views • 51 slides
What is poetry? Poetry is a type of literature in which the ideas or emotions expressed in the

What is poetry? Poetry is a type of literature in which the ideas or emotions expressed in the

Poetry What is poetry? Poetry is a type of literature in which the ideas or emotions expressed in the piece are expressed in some sort of form, usually with line breaks, rhythm, meter, and/ or rhyme. Important aspects of poetry Structure

189 views • 14 slides
Battle of the Chatbots & Conversational Interfaces in 2017 Presented by Clara de Soto,

Battle of the Chatbots & Conversational Interfaces in 2017 Presented by Clara de Soto,

1 Battle of the Chatbots & Conversational Interfaces in 2017 Presented by Clara de Soto, Founding Team at Reply.ai 2 I N T R O D U C T I O N S Hi, Im Clara de Soto @claradactyl Co-Founder of Reply.ai @claradactyl 3 @claradactyl

468 views • 24 slides
Prosody ( PRAH-suh-dee ) : the study of meter and form in poetry Exercise #1 Example: 1a. One

Prosody ( PRAH-suh-dee ) : the study of meter and form in poetry Exercise #1 Example: 1a. One

Prosody ( PRAH-suh-dee ) : the study of meter and form in poetry Exercise #1 Example: 1a. One of these sentences sounds COR rect. 1b. One of these sentences sounds cor RECT . 1a. Keep your answers short and CON cise. 6a. Poetry and music are

230 views • 6 slides
Welcome to Hawkshead Esthwaite Primary School We went to Haws End on This is the view a

Welcome to Hawkshead Esthwaite Primary School We went to Haws End on This is the view a

Welcome to Hawkshead Esthwaite Primary School We went to Haws End on This is the view a residential trip in year from Edinburgh 5/6, it was fun because castle. We have a we got to go and do a trip there in Year range of activities such

584 views • 24 slides
Outline Enabling the automated identification and analysis of meter Assumptions What we

Outline Enabling the automated identification and analysis of meter Assumptions What we

5/20/16 Outline Enabling the automated identification and analysis of meter Assumptions What we study and why and rhyme in Russian verse How we use computation tools to do it Elise Thorsen (enthorsen@gmail.com) David J. Birnbaum

429 views • 5 slides
A SEMANTIC UNSUPERVISED LEARNING APPROACH TO WORD SENSE DISAMBIGUATION Dissertation Presentation

A SEMANTIC UNSUPERVISED LEARNING APPROACH TO WORD SENSE DISAMBIGUATION Dissertation Presentation

A SEMANTIC UNSUPERVISED LEARNING APPROACH TO WORD SENSE DISAMBIGUATION Dissertation Presentation April 4, 2018 Dian I. Martin Presenta tati tion Overview Background LSA-WSD Approach Word Importance in a Sentence

785 views • 53 slides
The Next Digital Platform A Virtual Future Patrick Curry : Director, Unity Austin Hi, Im

The Next Digital Platform A Virtual Future Patrick Curry : Director, Unity Austin Hi, Im

The Next Digital Platform A Virtual Future Patrick Curry : Director, Unity Austin Hi, Im Patrick Curry Entrepreneur, Game Developer, Educator, Father Unity Technologies The worlds most popular game engine Monument Valley Crossy Road

734 views • 50 slides
H omers life is a shadow in the mists of ancient history. All that we know

H omers life is a shadow in the mists of ancient history. All that we know

H omers life is a shadow in the mists of ancient history. All that we know for certain about him is that he composed two of the greatest epics in world literature, The Iliad and The Odyssey , as well as several

434 views • 24 slides

More recommend