Minecraft as a Platform for Project-Based Learning in AI Sameer - - PowerPoint PPT Presentation

minecraft as a platform for project based learning in ai
SMART_READER_LITE
LIVE PREVIEW

Minecraft as a Platform for Project-Based Learning in AI Sameer - - PowerPoint PPT Presentation

Minecraft as a Platform for Project-Based Learning in AI Sameer Singh University of California, Irvine Project Courses in AI Difficult to create ones for AI and ML Project courses are great for learning! Too many techniques: define


slide-1
SLIDE 1

Minecraft as a Platform for Project-Based Learning in AI

Sameer Singh University of California, Irvine

slide-2
SLIDE 2

Project Courses in AI

š Project courses are great for learning!

š define own goals š pick approach š abstract concepts → concrete code š teamwork š evaluate/analyze results, …

š Difficult to create ones for AI and ML š Too many techniques: supervised learning, search/planning, Bayesian methods, RL, … š Too many application domains: text, images, games, puzzles, robotics, time series, …

Most course define the problem and techniques for the students

slide-3
SLIDE 3

Minecraft

šAn open-world sandbox:

š Exploration š Resource gathering š Crafting š Construction š Combat

slide-4
SLIDE 4

Project Malmo (by Microsoft Research)

  • AI experimentation platform on top of Minecraft
  • Programmatic access to observations/actions
  • Observations: pixels, gridworld, objects, inventory…
  • Actions: generate world, disc/continuous movt, …

https://www.microsoft.com/en-us/research/project/project-malmo/

def player(obs) { … return action }

slide-5
SLIDE 5

Course Description

  • Duration: 10 weeks long undergraduate course
  • Teams: Groups of 3 students
  • Open-ended: students define their own projects
  • Real-world skills: submit webpages, Github repos, and YouTube videos

So far…

  • ffered 3 times (currently 4th)

260 students, 90 projects

slide-6
SLIDE 6

Examples

RoboFarm

  • Efficient Farming
  • Planting/harvesting
  • Genetic algorithms
  • https://daniel-davies.github.io/13-RoboFarm/

Revival

  • Style transfer of images
  • real photos ⟷ Minecraft
  • CycleGANs
  • https://sijielu.github.io/Revival/
slide-7
SLIDE 7

Examples

MinePilot

  • Self-driving car
  • Steering, Accel/brake
  • Deep RL from pixels
  • https://ziyangz5.github.io/MinePilot/

MinePac

  • Play Pacman
  • Navigation, gathering, etc.
  • Local/heuristic search
  • https://avielmenter.github.io/MinePac/
slide-8
SLIDE 8

Examples

FireEscape

  • Get to exit before fire
  • Discrete movement
  • Tabular Q-Learning
  • https://joshlopez97.github.io/FireEscape/

speech2craft

  • Command following bot
  • Navigation, gathering, etc.
  • Speech recog, NLP parsing
  • https://hiroishikawa.github.io/speech2craft/
slide-9
SLIDE 9

sameersingh.org/courses/malmo @sameer_

Thank you!