Course Overview Agents acting in an environment Future and Ethics - - PowerPoint PPT Presentation

Course Overview

Agents acting in an environment Future and Ethics of AI Dimensions of complexity

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 1

What is Artificial Intelligence?

Artificial Intelligence is the synthesis and analysis of computational agents that act intelligently. An agent is something that acts in an environment. An agent acts intelligently if:

◮ its actions are appropriate for its goals and circumstances ◮ it is flexible to changing environments and goals ◮ it learns from experience ◮ it makes appropriate choices given perceptual and

computational limitations

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 2

Agents acting in an environment

Prior Knowledge Environment Stimuli Actions Past Experiences Goals/Preferences Agent Abilities

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 3

Inside Black Box

Learner Inference Engine

• ffline
• nline

Prior Knowledge Past Experiences/ Data Observations Goals/Preference Actions Abilities KB

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 4

Controller

memories Controller percepts commands Body memories Environment stimuli actions Agent

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 5

Functions implemented in a controller

memories percepts commands memories

For discrete time, a controller implements: belief state function returns next belief state / memory. What should it remember? command function returns commands to body. What should it do?

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 6

Future and Ethics of AI

What will super-intelligent AI bring?

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 7

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 8

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

◮ Smart weapons? Automated terrorists? c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 9

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

◮ Smart weapons? Automated terrorists?

What will a super-intelligent AI be able to do better?

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 10

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

◮ Smart weapons? Automated terrorists?

What will a super-intelligent AI be able to do better?

◮ predict the future ◮ optimize (constrained optimization) c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 11

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

◮ Smart weapons? Automated terrorists?

What will a super-intelligent AI be able to do better?

◮ predict the future ◮ optimize (constrained optimization)

Whose values/goals will they use? (Why?)

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 12

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

◮ Smart weapons? Automated terrorists?

What will a super-intelligent AI be able to do better?

◮ predict the future ◮ optimize (constrained optimization)

Whose values/goals will they use? (Why?) Will we need a new ethics of AI?

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 13

Future and Ethics of AI

What will super-intelligent AI bring?

◮ Automation and unemployment? What if people are not

longer needed to make economy work?

◮ Smart weapons? Automated terrorists?

What will a super-intelligent AI be able to do better?

◮ predict the future ◮ optimize (constrained optimization)

Whose values/goals will they use? (Why?) Will we need a new ethics of AI? Is super-human AI inevitable (wait till computers get faster)? (Singularity) Is there fundamental research to be done? Is it easy because humans are not as intelligent as we like to think?

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 14

Dimensions of Complexity

Flat or modular or hierarchical Explicit states or features or individuals and relations Static or finite stage or indefinite stage or infinite stage Fully observable or partially observable Deterministic or stochastic dynamics Goals or complex preferences Single-agent or multiple agents Knowledge is given or knowledge is learned from experience Reason offline or reason while interacting with environment Perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 15

State-space Search

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 16

Classical Planning

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 17

Decision Networks

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 18

Markov Decision Processes (MDPs)

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 19

Decision-theoretic Planning

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 20

Reinforcement Learning

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 21

Relational Reinforcement Learning

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 22

Classical Game Theory

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 23

Humans

flat or modular or hierarchical explicit states or features or individuals and relations static or finite stage or indefinite stage or infinite stage fully observable or partially observable deterministic or stochastic dynamics goals or complex preferences single agent or multiple agents knowledge is given or knowledge is learned reason offline or reason while interacting with environment perfect rationality or bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 24

Comparison of Some Representations

CP MDPs IDs RL POMDPs GT hierarchical ✔ properties ✔ ✔ ✔ relational ✔ indefinite stage ✔ ✔ ✔ ✔ stochastic dynamics ✔ ✔ ✔ ✔ ✔ partially observable ✔ ✔ ✔ values ✔ ✔ ✔ ✔ ✔ dynamics not given ✔ multiple agents ✔ bounded rationality

c

• D. Poole and A. Mackworth 2016

Artificial Intelligence, Lecture 16.1, Page 25