Programming Behavior Rod Grupen Department of Computer Science - - PowerPoint PPT Presentation

programming behavior
SMART_READER_LITE
LIVE PREVIEW

Programming Behavior Rod Grupen Department of Computer Science - - PowerPoint PPT Presentation

Programming Behavior Rod Grupen Department of Computer Science University of Massachusetts Amherst Laboratory for Perceptual Robotics Department of Computer Science Behavioral Build File projectN_control( ) projectN_enter_params( )


slide-1
SLIDE 1

Laboratory for Perceptual Robotics – Department of Computer Science

Rod Grupen Department of Computer Science University of Massachusetts Amherst

Programming Behavior

slide-2
SLIDE 2

Laboratory for Perceptual Robotics – Department of Computer Science 2

projectN_control( ) projectN_enter_params( ) projectN_visualize( ) projectN_ reset( ) also establishes specific convention for states and actions: action: any procedure that can be used to define new recommended setpoints states: the dynamic status of eligible actions

Behavioral Build File

slide-3
SLIDE 3

Laboratory for Perceptual Robotics – Department of Computer Science 3

A Landscape of Attractors

Emilio Bizzi - equilibrium setpoint theory - frog legs Marc Raibert - hopping platforms, Atlas, spot mini “funnels”

slide-4
SLIDE 4

Laboratory for Perceptual Robotics – Department of Computer Science 4

Control State Feedback

slide-5
SLIDE 5

Laboratory for Perceptual Robotics – Department of Computer Science 5

A Landscape of Attractors

a taxonomy of action: Search Track

slide-6
SLIDE 6

Laboratory for Perceptual Robotics – Department of Computer Science 6

Control State Feedback: Roger

0: (NO_REFERENCE) the reference stimuli is not detected 1: (TRANSIENT) stimuli are detected, not converged 2: (CONVERGED) controller converged to the setpoint f f .

CONVERGED TRANSIENT

actions return g: g = 0 (undefined) = 1 ( |Jc| > e ) = 2 ( |Jc| ~ 0 )

ALL ELIGIBLE ACTIONS RETURN THEIR INTERNAL STATE to inform decisions about which recommended setpoints to use

slide-7
SLIDE 7

Laboratory for Perceptual Robotics – Department of Computer Science 7

Multi-Modal State

s = [ g0 … gN ]

actions return g: g = 0 (undefined) = 1 ( |Jc| > e ) = 2 ( |Jc| ~ 0 )

unique integer state: s* = g0(30) + g1(31) + … + gN(3N-1) 0<= s* <=3N

slide-8
SLIDE 8

Laboratory for Perceptual Robotics – Department of Computer Science 8

/***********************************************************************************************/ /* SearchTrack() */ /***********************************************************************************************/

double recommended_setpoints[NACTIONS]; // NACTIONS = NTRACK + NSEARCH \\ let NTRACK =2 internal_state[0] = TRACK0(roger, time); // assigns values to recommended_setpoints[0] internal_state[1] = TRACK1(roger, time); // assigns values to recommended_setpoints[1]

// for N=2 state = internal state[1]*3 + internal_state[0]; switch (state) {

// TRACK1 TRACK 2

case 0: // NO_REFERENCE - NO REFERENCE \\ choose action[i] 0 <= i < NACTIONS \\ submit_setpoints(recommended_setpoints[i]);

\\ break;

case 1: // NO_REFERENCE - TRANSIENT case 2: // NO_REFERENCE - CONVERGED . . . case 8: } return_state = TRANSIENT;

SearchTrack(): State-Action Table a convention for programming, planning, & learning