TRINITY OF AI Anima Anandkumar AI is in the news every day But - - PowerPoint PPT Presentation
TRINITY OF AI Anima Anandkumar AI is in the news every day But - - PowerPoint PPT Presentation
TRINITY OF AI Anima Anandkumar AI is in the news every day But what is intelligence? 2 Which one is more intelligent? 3 4 5 What is intelligence? Ability to acquire and apply knowledge and skills. What is general intelligence?
2
AI is in the news every day But what is intelligence?
3
Which one is more intelligent?
4
5
6
What is intelligence? Ability to acquire and apply knowledge and skills. What is general intelligence? Human-level intelligence and cognitive reasoning.
7
TRINITY OF AI DATA COMPUTE ALGORITHMS
8
EXAMPLE AI TASK: IMAGE CLASSIFICATION
Maple Villa Plant Garden Water Swimming Pool Tree Potted Plant Backyard
9
DATA: LABELED IMAGES FOR TRAINING AI
Picture credits: Image-net.org, ZDnet.com
Ø 14 million images and 1000 categories. Ø Largest database of labeled images. Ø Images in Fish category. Ø Captures variations of fish.
10
MODEL: CONVOLUTIONAL NEURAL NETWORK
.02 .85
p(cat) p(dog) Deep learning: Many layers give large capacity for model to learn from data
11
MOORE’S LAW: A SUPERCHARGED LAW Ø More than a billion
- perations per image.
Ø NVIDIA GPUs enable parallel operations. Ø Enables Large-Scale AI.
COMPUTE INFRASTRUCTURE FOR AI: GPU
12
PROGRESS IN TRAINING IMAGENET
Statista: Statistics Portal
10 20 30 40 2010 2011 2012 2013 2014 Human 2015
Error in making 5 guesses about the image category
Enabled by Trinity of AI : Data + Algorithms + Compute
13
Where do we go next?
14
MULTI-DIMENSIONAL PROCESSING
Image: 3 dimensions Width * Height * Channels Video: 4 dimensions Width * Height * Channels * Time
15
MULTI-DIMENSIONAL PROCESSING
ØProjection to lower dimensions can lose information. ØHow to capture all information in multidimensional data?
16
TENSORS: ENABLE MULTI-DIMENSIONAL PROCESSING
17
TENSORS: TOPIC DETECTION IN TEXT
STORM WORLD SERIES AUSTRALIA STOCK MARKET WASHINGTON HEALTH CRISIS MACHINE LEARNING
LIBRARY OF NEWS ARTICLES Amazon Comprehend LIST OF TOPICS
18
TENSORS: TOPIC DETECTION IN TEXT
Co-occurrence
- f word triplets
Topic 1 Topic 2
19
Where do we go next?
20
“ Mens sana in corpore sano.”
Juvenal in Satire X.
A New Vision for Autonomy
Center for Autonomous Systems and Technologies
22
CAST @ CALTECH LEARNING TO LAND
23
CAST @ CALTECH DRONE TESTING LAB
24
MIND & BODY NEXT-GENERATION AI
Fine-grained reactive Control
Instinctive:
Making and adapting plans
Deliberative:
Sense and react to human
Behavioral:
Acting for the greater good
Multi-Agent:
25