General Atari 2600 Game Playing Michael Bowling Work with: Joel - PowerPoint PPT Presentation

Jan 31, 2024 •259 likes •501 views

General Atari 2600 Game Playing Michael Bowling Work with: Joel Veness, Marc Bellemare, Anna Koop, Mostafa Vafadoost http://www.arcadelearningenvironment.org Friday, September 14, 2012 Friday, September 14, 2012

General Atari 2600 Game Playing Michael Bowling Work with: Joel Veness, Marc Bellemare, Anna Koop, Mostafa Vafadoost http://www.arcadelearningenvironment.org Friday, September 14, 2012
Friday, September 14, 2012
http://www.arcadelearningenvironment.org Friday, September 14, 2012
Independent Many Varied Interesting Friday, September 14, 2012
Friday, September 14, 2012
Friday, September 14, 2012
Reinforcement Learning A.I. 0100010101...00001110101 Friday, September 14, 2012
Planning A.I. 0100010101...00001110101 Friday, September 14, 2012
Model Learning Model A.I. Friday, September 14, 2012
Imitation/Apprenticeship Learning Expert A.I. Friday, September 14, 2012
Transfer Learning A.I. Pitfall! . . . Pitfall II Friday, September 14, 2012
Intrinsic Motivation A.I. Friday, September 14, 2012
Friday, September 14, 2012
Training Testing Games Games Friday, September 14, 2012
Friday, September 14, 2012
(Bellemare et al., AAAI 2012) Contingency Awareness: knowing what you control Friday, September 14, 2012
(Bellemare et al., AAAI 2012) Contingency Awareness: knowing what you control Contingency Aware Unaware Friday, September 14, 2012
(Bellemare et al., AAAI 2012) Contingency Awareness: knowing what you control Inter-Algorithm Score Distribution 1.0 Fraction of Games Extended 0.5 Basic MaxCol Extended MaxCol 0.0 1.0 0.8 0.6 0.4 0.2 0 Inter-Algorithm Score Friday, September 14, 2012
(Bellemare et al., NIPS 2012) Sketch-Based Hashing: tug-of-war vs. standard hashing Hash Table Size: 1000 Hash Table Size: 5000 Hash Table Size: 20,000 1.0 1.0 1.0 Tug-of-War Tug-of-War Fraction of games Fraction of games Fraction of games Standard 0.5 0.5 0.5 Standard Tug-of-War Standard 0.0 0.0 0.0 1.0 0.8 0.6 0.4 0.2 0 1.0 0.8 0.6 0.4 0.2 0 1.0 0.8 0.6 0.4 0.2 0 Inter-algorithm score Inter-algorithm score Inter-algorithm score 55 Testing Games Friday, September 14, 2012
(Bellemare et al., In Prep) Model Learning: pixels, probabilities, and priors Friday, September 14, 2012
(Bellemare et al., In Prep) Model Learning: pixels, probabilities, and priors Friday, September 14, 2012
Questions? http://www.arcadelearningenvironment.org Source code for ALE and all agents available! Friday, September 14, 2012
Friday, September 14, 2012
Will there be a competition? No vs. Friday, September 14, 2012

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Remember these? Playing Atari Games using RL VARSHA LALWANI AKSHAY MASARE Motivation May be we

Remember these? Playing Atari Games using RL VARSHA LALWANI AKSHAY MASARE Motivation May be we can design game players for each one of them! But, how about an AI agent who can learn to play them all ! This is where the concept of a general game

491 views • 11 slides

KR-Techniques for General Game Playing Michael Thielscher Roadmap 1. General Game Playing a

KR-Techniques for General Game Playing Michael Thielscher Roadmap 1. General Game Playing a Grand AI Challenge 2. KR-Aspects Formalizing game rules: Compact representations of state machines Challenge I: Mapping game descriptions to

651 views • 62 slides

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law General game playing

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law General game playing competition Game description language initial game state legal moves how moves update the game state how the game terminates Game

610 views • 33 slides

Game Playing Game playing AI Class 8 Ch. 5.1-5.3, 5.4.1, 5.5 State of the art and

Todays Class Game Playing Game playing AI Class 8 Ch. 5.1-5.3, 5.4.1, 5.5 State of the art and resources Framework Weve seen multi-agent Game trees systems, and search problems Minimax where another agents moved

234 views • 6 slides

1-bit Audio and the Arduino David J. Zielinski Overview 1. Terminology of Sound 2. Atari 2600

1-bit Audio and the Arduino David J. Zielinski Overview 1. Terminology of Sound 2. Atari 2600 a. clock division frequencies b. linear feedback shift registers 3. Arduino Uno a. Specifications b. Audio Generation Methods c. Code Examples

816 views • 47 slides

General Game Playing HANNES BERGENFALK Why u Dream of AI research is strong general intelligence

General Game Playing HANNES BERGENFALK Why u Dream of AI research is strong general intelligence u Systems like Deep Blue and Alpha go are amazing but they can only do one thing. u General Game Playing systems will still not be general

346 views • 12 slides

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Learning game rules

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Learning game rules Andrew Cropper, Richard Evans, and Mark Law General game playing competition Game description language initial game state legal moves

833 views • 35 slides

Set 4: Game-Playing ICS 271 Fall 2016 Kalev Kask Overview Computer programs that play

Set 4: Game-Playing ICS 271 Fall 2016 Kalev Kask Overview Computer programs that play 2-player games game-playing as search with the complication of an opponent General principles of game-playing and search game tree

1.02k views • 77 slides

General Game Playing in AI Research and Education Michael Thielscher GGP in AI Research &

General Game Playing in AI Research and Education Michael Thielscher GGP in AI Research & Education What is General Game Playing (GGP)? The Many Facets of GGP Research The Potential for GGP in AI Teaching General Game Playing

1.06k views • 60 slides

Chenhao Tan 1 Can machines think? (Turing, 1950) 2 3 4 Atari game (Bonus: try Google

Chenhao Tan 1 Can machines think? (Turing, 1950) 2 3 4 Atari game (Bonus: try Google image search atari breakout) 5 Minh et al. 2013 https://www.youtube.com/watch?v=V1e YniJ0Rnk 6 Ghazvininejad, Shi, Choi, and

348 views • 34 slides

Game Playing Tail end of Constraint Satisfaction Ch. 5.1-5.3, 5.4.1, 5.5 Questions Game

On to Games Game Playing Tail end of Constraint Satisfaction Ch. 5.1-5.3, 5.4.1, 5.5 Questions Game playing from reading? Framework Game trees Weve seen search problems Minimax where other agents moves Alpha-beta

227 views • 7 slides

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Inverse general game

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Inverse general game playing Andrew Cropper, Richard Evans, and Mark Law Inducing game rules Andrew Cropper, Richard Evans, and Mark Law General game playing

538 views • 30 slides

Evolving Game Playing Evolving Game Playing Strategies (4.4.3) Strategies (4.4.3) Darren

Evolving Game Playing Evolving Game Playing Strategies (4.4.3) Strategies (4.4.3) Darren Gerling Jason Gerling Jared Hopf Colleen Wtorek Overview Overview 1) Introduction - Agent Based Modeling 2) Prisoners Dilemma 3) Deterministic

724 views • 48 slides

Game Playing Why do AI researchers study game playing? 1. Its a good reasoning problem, formal

Game Playing Why do AI researchers study game playing? 1. Its a good reasoning problem, formal and nontrivial. 2. Direct comparison with humans and other computer programs is easy. 1 What Kinds of Games? Mainly games of strategy with the

703 views • 42 slides

Game Playing Introduc3on One of the earliest areas in

Game Playing Introduc3on One of the earliest areas in ar3ficial intelligence is game playing. Two-person zero-sum game. Games for which

292 views • 10 slides

New Trends in General Game Playing Michael Thielscher, Dresden Chess Players The 1 st Chess

IJCAI'09 Tutorial New Trends in General Game Playing Michael Thielscher, Dresden Chess Players The 1 st Chess Computer (Turk, 18 th Century) Alan Turing & Claude Shannon (~1950) Deep-Blue Beats World Champion (1997) In the early

1.24k views • 91 slides

UNLEARNING : The Challenge of Change Our Environment in which we Live &Work, Demands us

UNLEARNING : The Challenge of Change Our Environment in which we Live &Work, Demands us to UNLEARN , so that we can Shift and make room for something new -CTRL SHIFT 50 games for 50 ****Days like today Shif t is a wa y of life!

1.02k views • 69 slides

CS3000:&Algorithms&&&Data Jonathan&Ullman Lecture&7:&

CS3000:&Algorithms&&&Data Jonathan&Ullman Lecture&7:& Dynamic&Programming:&Knapsacks,&Edit&Distance Jan&29,&2020 TugGofGWar,&SubsetGSum,&Knapsack TugGofGWar We&have&

497 views • 31 slides

cse 311: foundations of computing Fall 2015 Lecture 22: Finite state machines review: finite

cse 311: foundations of computing Fall 2015 Lecture 22: Finite state machines review: finite state machines States Transitions on inputs Start state and final states The language recognized by a machine is the set of strings that

430 views • 19 slides

Algorithms for Big Data (VI) Chihao Zhang Shanghai Jiao Tong University Oct. 25, 2019

Algorithms for Big Data (VI) Chihao Zhang Shanghai Jiao Tong University Oct. 25, 2019 Algorithms for Big Data (VI) 1/13 Review . Algorithms for Big Data (VI) . Output ; , On input from a -universal family; Pick log We learnt AMS

776 views • 51 slides

International House Tashkent Subject: Physics Department: ES, Course 1 Lesson 5. Newton's laws

International House Tashkent Subject: Physics Department: ES, Course 1 Lesson 5. Newton's laws of motion Background Sir Isaac Newton (1643-1727) an English scientist and mathematician famous for his discovery of the law of gravity also

111 views • 10 slides

The D ark E nergy S urvey: Overview and New Results Brian Nord (@briandnord, nord@fnal.gov) for

The D ark E nergy S urvey: Overview and New Results Brian Nord (@briandnord, nord@fnal.gov) for the DES Collaboration Fermilab Users Meeting June 15, 2016 / 34 Sneak Preview The Dark Energy Survey (DES) Instrument: Dark Energy Camera

815 views • 49 slides

We, the World acf135 Phillip Capital Inc.

We, the World acf135 Phillip Capital Inc. Private & Confidential November 8, 2019 2 TUG OF WAR II The Union The City Of Chicago Smaller Classes No more money More

254 views • 13 slides

Presented by: Grace Carr Benjamin At the 32nd annual conference of the Association of Seventh-day

Presented by: Grace Carr Benjamin At the 32nd annual conference of the Association of Seventh-day Adventist Librarians June 19 24, 2012 Adventist International Institute of Advanced Studies (AIIAS) Philippines. Outline Introduction

594 views • 35 slides