Rethinking HCI with Neural Interfaces @CTRLlabsco Adam Berenzweig, - PowerPoint PPT Presentation

Aug 20, 2023 •373 likes •814 views

Rethinking HCI with Neural Interfaces @CTRLlabsco Adam Berenzweig, Director of R&D, CTRL-labs @madadam | adam@ctrl-labs.com 1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural

Rethinking HCI with Neural Interfaces @CTRLlabsco Adam Berenzweig, Director of R&D, CTRL-labs @madadam | adam@ctrl-labs.com
1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural Interfaces
1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural Interfaces
Human Human input output 10,000,000 bits/s 30 bits/s
Cortical BMI is hard
Surface EMG neural interface. Biophysical signal to control signal. Neural activity EMG Control
In the future you will connect your nervous system to everything.
1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural Interfaces
Neural Interaction Design Challenges 1. Robustness & Reliability 2. Novel Interactions 3. Ergonomics a. Touchless Control vs. Spatial Computing 4. Learnability & Customization a. Fun to learn, and it learns you. 5. Fit to Environment 6. Props
Neural Interaction Design Challenges 1. 3- and 6-DOF navigation 2. Activation, “wake-word” & mode switching 3. Simultaneous continuous & discrete control 4. Hand-object interaction in XR. 5. Text Input!!
Ergonomics & Comfort 1. Smaller is better -- motionless is best? 2. Anatomically informed 3. Variation is essential for comfort. 4. Force: brief or light.
Hand-Object Interaction in XR 1. Grasping, manipulating. 2. Spatial Computing vs. Touchless Control, i.e. direct vs indirect. 3. Haptics & feedback. Use your arm, or use The Force?
Novel Interactions Co-evolution of software and controllers. Control these with an xbox controller… or your hand?
Novel Interactions Co-evolution of software and controllers. Control these with an xbox controller… or your hand?
Text Input!! 1. One-handed vs two 2. QWERTY-or-not 3. Visual, audio feedback 4. Swipe, chords, …? We can do better than this...
Props 1. Constrain hand shape & muscle activation 2. Something to push against 3. Feels cool 4. Optional scaffolding?
https://www.reddit.com/r/gaming/comments/84wjsk/inverted_mouse/
… 2019 2020
CTRL-kit developer platform. Hardware SDK & API @CTRLlabsco ctrl-labs.com
Questions? adam@ctrl-labs.com @CTRLlabsco @madadam ctrl-labs.com
[Extra slides]
Neurocontrol: EMG → motor neuron activity
The richest signals are at the forearm. Tool / object control Spoken language

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Characterization of Parylene-C Thin Films as an Encapsulation for Neural Interfaces Hsu, Jui-Mei

Characterization of Parylene-C Thin Films as an Encapsulation for Neural Interfaces Hsu, Jui-Mei 1 ; Kammer, Sascha 2 ; Jung, Erik 3 ; Rieth, Loren 4 ; Normann, Richard 5 ; Solzbacher, Florian 1,4,5 1 Materials Science and Engineering - University

361 views • 20 slides

CSSE 220 Interfaces and Polymorphism Check out Interfaces from SVN Interfaces What, When,

CSSE 220 Interfaces and Polymorphism Check out Interfaces from SVN Interfaces What, When, Why, How? What: Code Structure used to express operations that multiple class have in common No method implementations No fields

611 views • 12 slides

Miniaturized Energy-Efficient Integrated Neural Interfaces Chul Kim Department of Bio and Brain

Miniaturized Energy-Efficient Integrated Neural Interfaces Chul Kim Department of Bio and Brain Engineering KAIST Microelectrocorticography ( ECoG) Flexible Modular Array Emerging ECoG technologies - High spatiotemporal resolution

332 views • 9 slides

T Topic 7 i 7 Interfaces and Abstract Interfaces and Abstract Classes Interfaces Interfaces

T Topic 7 i 7 Interfaces and Abstract Interfaces and Abstract Classes Interfaces Interfaces I prefer Agassiz in the abstract, rather than in the concrete. CS 307 Fundamentals of CS 307 Fundamentals of 1 2 Computer Science

325 views • 10 slides

Rethinking of the Rethinking of the debian/watch debian/watch With thought experiments about

Rethinking of the Rethinking of the debian/watch debian/watch With thought experiments about uscan Kentaro Hayashi DebConf18 in T aiwan 2018-08-03 ClearCode Inc. Digest of this talk Current d/watch fi le is sometimes complicated Update

800 views • 77 slides

Rethinking W aste Rethinking Waste W aste w hat is it? Websters 1913 Dictionary

Rethinking W aste Rethinking Waste W aste w hat is it? Websters 1913 Dictionary definition: lying unused; unproductive; w orthless; valueless; refuse; rejected Oxford 2017 English Dictionary definition: elim inated or

582 views • 28 slides

Interfaces Interfaces interface : A list of methods that a class promises to implement.

Interfaces Interfaces interface : A list of methods that a class promises to implement. Interfaces give you an is-a relationship without code sharing. Only method stubs in the interface Allows object with no common ancestor to act

268 views • 13 slides

Interfaces Interfaces n interface : A list of methods that a class promises to implement. q

10/21/12 Interfaces Interfaces n interface : A list of methods that a class promises to implement. q Interfaces give you an is-a relationship without code sharing. Only method stubs in the interface n Allows object with no common

420 views • 7 slides

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural IR tasks Neural IR architecture Feature Representations Neural IR query auto completion Neural IR query suggestion Neural IR document

1.48k views • 18 slides

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including underlying UI architecture and algorithms, practice implementing UIs using frameworks, and theories and methods relevant to interface design.

378 views • 23 slides

CS 349: User Interfaces This course focuses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focuses on creating user interfaces (UIs), including underlying UI architecture and algorithms, practice implementing UIs using frameworks, and theories and methods relevant to interface design.

600 views • 20 slides

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including

603 views • 24 slides

RETHINKING THE TOOLS OF ENGAGEMENT FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT /

RETHINKING THE TOOLS OF ENGAGEMENT FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT / FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT / FLIPPING THE OUTCOMES 1. THE limitations of current outreach methods RETHINKING THE TOOLS

436 views • 43 slides

SVG for Automotive User SVG for Automotive User Interfaces Interfaces S. Boisgrault, Mines

SVG for Automotive User SVG for Automotive User Interfaces Interfaces S. Boisgrault, Mines ParisTech M. Othman Abdallah, Mines ParisTech J.-M. Temmos, Visteon Introduction HMI: human-machine interfaces Design of HMI displays for car

427 views • 24 slides

Neural Decoding of Cursor Motion using Kalman Filter W. Wu, M. J. Black, Y. Gao, E. Bienenstock,

Neural Decoding of Cursor Motion using Kalman Filter W. Wu, M. J. Black, Y. Gao, E. Bienenstock, M. Serruya, A. Shaikhouni, J. P. Donoghue NIPS 15, 2003 CSE 599E: Brain-Computer Interfaces Presented by: Jean Wu 19 April 2006 Overview [

306 views • 12 slides

SAASOA Rethinking the Ports Regulatos Core Methodology Rethinking the Ports Regulators Core

SAASOA Rethinking the Ports Regulatos Core Methodology Rethinking the Ports Regulators Core Methodology The key objective in regulating a monopoly Problems with the present approach The benefits of a price capping approach SAASOA

650 views • 31 slides

March 2018 Forward-Looking / Cautionary Statements This presentation, including any oral

Corporate Presentation March 2018 Forward-Looking / Cautionary Statements This presentation, including any oral statements made regarding the contents of this presentation, contains forward-looking statements within the meaning of Section 27A of

735 views • 31 slides

Welcome to UF! Introduction to UF Neurology Residency Christina Wilson, MD, PhD Assistant

Welcome to UF! Introduction to UF Neurology Residency Christina Wilson, MD, PhD Assistant Professor, Vascular Neurology Division Residency Program Director Why University of Florida? Why Gainesville? Shands UF 850 beds Level-1 trauma

752 views • 38 slides

Investor Presentation October 2018 Disclaimer IMPORTANT: Please read the following before

Investor Presentation October 2018 Disclaimer IMPORTANT: Please read the following before continuing. This Presentation has been prepared by Jupiter Mines Limited ACN 105 991 740 (Jupiter or the Company) solely for information purposes. This

575 views • 26 slides

About Screentec Oy Founded in 1989, in Oulu ISO 13485 certified Turnover : 2,1

About Screentec Oy Founded in 1989, in Oulu ISO 13485 certified Turnover : 2,1 Million (2018) Roll 2 Roll Production Facilities Employees: 30+ Our Partners/Network Our services User Interfaces Medical Electrodes

288 views • 6 slides

Facilities Update (as required by Policy 4:150 Facility Management and Building Programs) May

Facilities Update (as required by Policy 4:150 Facility Management and Building Programs) May 13, 2019 Presentation Overview Deferred Maintenance Plan (9/4/18) Our Buildings Another Year Older FY19 Construction Timeline

617 views • 16 slides

MCPS Budget Presentation Thank You! 2017-18 Highlights Dr. Robb Killen awarded the South

6.6.18 MCPS Budget Presentation Thank You! 2017-18 Highlights Dr. Robb Killen awarded the South Central Regional Suicide Prevention Award by the Tennessee Suicide Prevention Network, awarded the Ken and Madge Tullis, MD, Suicide

387 views • 27 slides

Facility Condition Assessment Findings: New Hope-Solebury School District 02/26/2019

Facility Condition Assessment Findings: New Hope-Solebury School District 02/26/2019 Presentation Outline EMG Intro Scope Outline Project Organization Methodology Overall FCI Summary FCI Results by Building Conclusions

495 views • 28 slides

Development of the Mary River Mine Building Capacity Whitehorse, September 2014 Located at

Development of the Mary River Mine Building Capacity Whitehorse, September 2014 Located at Mary River, North Baffin Island, 1000 km north west of Iqaluit, 160 km south of Pond Inlet The property is comprised of more than nine known high

856 views • 34 slides