Preference-Based Bayesian Optimization in High Dimensions with Human - PowerPoint PPT Presentation

Feb 06, 2024 •40 likes •70 views

Preference-Based Bayesian Optimization in High Dimensions with Human Feedback Myra Cheng, Ellen Novoseller, Maegan Tucker, Richard Cheng, Joel Burdick, Yisong Yue California Institute of Technology At every iteration: LineCoSpar Algorithm

Preference-Based Bayesian Optimization in High Dimensions with Human Feedback Myra Cheng, Ellen Novoseller, Maegan Tucker, Richard Cheng, Joel Burdick, Yisong Yue California Institute of Technology
At every iteration: LineCoSpar Algorithm Pairwise preferences and coactive feedback ● Gaussian process-based model of the underlying utilities Human user Iteratively update the ● posterior from preference feedback Bayesian Preference ● Learn in high dimensions Model of utilities via 1-D subspaces over 1-D subspace and visited actions Actions selected via posterior sampling
Validated in User Studies Cartpole Simulation (4-D) Wearable Exoskeleton (6-D)

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Scaling Bayesian Optimization in High Dimensions Stefanie Jegelka, MIT BayesOpt Workshop 2017

Scaling Bayesian Optimization in High Dimensions Stefanie Jegelka, MIT BayesOpt Workshop 2017 joint work with Zi Wang , Chengtao Li, Clement Gehring (MIT) and Pushmeet Kohli (DeepMind) Bayesian Optimization with GPs f ( x )

421 views • 23 slides

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian RL Prior knowledge, policy optimization, discussion, Bayesian approaches for other RL variants Model-free Bayesian RL Gaussian

1.23k views • 63 slides

Stochastic optimization and sparse statistical recovery: An optimal algorithm for high dimensions

Stochastic optimization and sparse statistical recovery: An optimal algorithm for high dimensions Alekh Agarwal Microsoft Research Joint work with Sahand Negahban and Martin Wainwright Workshop on Optimization and Statistical Learning 2013, Les

695 views • 42 slides

Zeroth-order Optimization Yining Wang in High Dimensions Carnegie Mellon University Joint work

AISTATS 2018, Playa Blanca, Lanzarote, Spain Zeroth-order Optimization Yining Wang in High Dimensions Carnegie Mellon University Joint work with Simon Du, Sivaraman Balakrishnan and Aarti Singh B ACKGROUND Optimization: min x X f ( x )

253 views • 23 slides

Hessian-based sampling in high dimensions for goal-oriented model order reduction Peng Chen Omar

Hessian-based sampling in high dimensions for goal-oriented model order reduction Peng Chen Omar Ghattas Center for Computational Geosciences and Optimization The Institute for Computational Engineering and Sciences The University of Texas at

795 views • 60 slides

R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games Zhongxiang

R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games Zhongxiang Dai 1 Yizhou Chen 1 Bryan Kian Hsiang Low 1 Patrick Jaillet 2 Teck-Hua Ho 3 1 Department of Computer Science, National University of Singapore 2

534 views • 18 slides

Bayesian optimization and Information-based Approaches Jos e Miguel Hern andez-Lobato

Bayesian optimization and Information-based Approaches Jos e Miguel Hern andez-Lobato joint work with Michael A. Gelbart, Matt W. Hoffman, Ryan P. Adams and Zoubin Ghahramani April 31, 2015 (50% of these slides have been made by Matt)

723 views • 28 slides

A Novel Layer Sharing-based Incremental Learning via Bayesian Optimization Bomi Kim, Taehyeon

1 st International Electronic Conference on Applied Sciences A Novel Layer Sharing-based Incremental Learning via Bayesian Optimization Bomi Kim, Taehyeon Kim and Yoonsik Choe Department of Electrical and Electronic Engineering, Yonsei

635 views • 20 slides

3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference

AGENDA 1. Preference Learning Tasks 2. Performance Assessment and Loss Functions 3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference Relations c. Structured Output Prediction d. Model-Based Preference

583 views • 39 slides

Preference Elicitation for Interface Optimization Krzysztof Gajos and Daniel S. Weld University

Preference Elicitation for Interface Optimization Krzysztof Gajos and Daniel S. Weld University of Washington, Seattle Krzysztof Gajos Motivation: Supple Model-Based Interface Renderer Func. Custom Device User + + Interface Interface

809 views • 52 slides

Bayesian Optimization CSC2541 - Topics in Machine Learning Scalable and Flexible Models of

Bayesian Optimization CSC2541 - Topics in Machine Learning Scalable and Flexible Models of Uncertainty University of Toronto - Fall 2017 Overview 1. Bayesian Optimization of Machine Learning Algorithms 2. Gaussian Process Optimization in the

1.53k views • 94 slides

Preference Litigation ASK LLP What is a preference? A preference is a payment made by an

Preference Litigation ASK LLP What is a preference? A preference is a payment made by an insolvent debtor that favors certain creditors over others. The causes of action to avoid and recover preferential payments are codified in 11

853 views • 39 slides

Safe Bayesian Optimization for Optimal Control Schillinger, M., Hartmann, B., Skalecki, P.,

Safe Bayesian Optimization for Optimal Control Schillinger, M., Hartmann, B., Skalecki, P., Meister, M., Nguyen-Tuong, D., & Nelles, O. (2017). Safe Active Learning and Safe Bayesian Optimization for Tuning a PI-Controller. IFAC-PapersOnLine ,

203 views • 6 slides

Knowing The What, But Not The Where in Bayesian Optimization Vu Nguyen & Michael A. Osborne

Knowing The What, But Not The Where in Bayesian Optimization Vu Nguyen & Michael A. Osborne University of Oxford Vu Nguyen Bayesian Optimization 1 Black-box Optimization The relationship from to is through the black-box. Output

259 views • 24 slides

My research over Bayesian Optimization and Gaussian Processes Eduardo C. GarridoMerch an

My research over Bayesian Optimization and Gaussian Processes Eduardo C. GarridoMerch an PhD student. Teacher Assistant. Universidad Aut onoma de Madrid 1/13 Index Introduction: Bayesian Optimization and Gaussian Processes. 2/13

923 views • 70 slides

A Theoretical Analysis of Curvature Based Preference Models Pradyumn Shukla 1 Michael Emmerich 2

A Theoretical Analysis of Curvature Based Preference Models Pradyumn Shukla 1 Michael Emmerich 2 Andr Deutz 2 1 Karlsruhe Institute of Technology Institute AIFB 2 Leiden University LIACS Multi-objective Optimization Problem Given m , n

339 views • 13 slides

Powered Exoskeletons Upper-Limb Design and Technical Trends Kevin Chu The Papers Discussed 2

Powered Exoskeletons Upper-Limb Design and Technical Trends Kevin Chu The Papers Discussed 2 Upper-Limb Powered Exoskeleton Design by Joel C. Perry, Jacob Rosen, and Stephen Burn The Technical Trend of the Exoskeleton Robot System for

743 views • 25 slides

Ad astra per aspera, II Astronomy 101 Syracuse University, Fall 2020 Walter Freeman November

Ad astra per aspera, II Astronomy 101 Syracuse University, Fall 2020 Walter Freeman November 24, 2020 Astronomy 101 Ad astra per aspera, II November 24, 2020 1 / 39 I still remember when the first time I pointed the telescope at the sky and

969 views • 80 slides

Physically-Based Rendering Shih-Chin Weng shihchin.weng@gmail.com What is PBR? The Chemical

Physically-Based Rendering Shih-Chin Weng shihchin.weng@gmail.com What is PBR? The Chemical Brothers - Wide Open, The Mill Physically Based Rendering Simulate materials and lights based on physical laws or observations of real world more

1.48k views • 59 slides

Advanced 3D computer graphics for movies and games (NPGR010) Radiometry Ji Vorba, MFF UK/

Advanced 3D computer graphics for movies and games (NPGR010) Radiometry Ji Vorba, MFF UK/ Weta Digital jirka@cgg.mff.cuni.cz Slides of prof. Jaroslav Kivnek, minor edits by Ji Vorba Summary of basic radiometric quantities

2.12k views • 52 slides

A concept design of an adaptive tendon driven mechanism for active soft hand Orthosis. Rafhael de

A concept design of an adaptive tendon driven mechanism for active soft hand Orthosis. Rafhael de Andrade 1 Bruno Loureno 1, 2 Vitorino Neto 1 1 Laboratory of Robotics and Biomechanics, Department of Mechanical Engineering, Universidade Federal

398 views • 15 slides

9/20/2010 Summer School Locations Computational Intelligence i in Healthcare (CIHC 2010) H

9/20/2010 Summer School Locations Computational Intelligence i in Healthcare (CIHC 2010) H lth (CIHC 2010) 20 24 September 2010 Eindhoven, the Netherlands Information Systems Group Uzay Kaymak Ton Weijters Locations in Campus

65 views • 3 slides

What is new in Occupa4onal and Environmental Health (Nursing)?

3/12/16 What is new in Occupa4onal and Environmental Health (Nursing)? Barbara J. Burgel, RN, ANP, COHN-S, PhD, FAAOHN, Professor of Clinical

203 views • 5 slides

Data Explorer (DEX) RWTH Aachen University Page 2 DEX is a generator for (parts of)

Farbe! CD 1 Generative Class role Type attribute Software interface Interface Engineering Class * Type method() composition 2. Generating Data Explorers qualifier qualified_association Prof. Dr. Bernhard Rumpe Software

525 views • 30 slides