cse141: Introduction to Computer Architecture Steven Swanson - - PowerPoint PPT Presentation

▶
cse141 introduction to computer architecture
SMART_READER_LITE
LIVE PREVIEW

cse141: Introduction to Computer Architecture Steven Swanson - - PowerPoint PPT Presentation

Mar 10, 2023 334 likes •1.17k views

cse141: Introduction to Computer Architecture Steven Swanson Sanath Kumar Vineet Kumar Bharathan Balaji 1 Todays Agenda What is architecture? Why is it important? At the highest level, where is architecture today? Where is it

slide-1
SLIDE 1

cse141: Introduction to Computer Architecture

Steven Swanson

Sanath Kumar Vineet Kumar Bharathan Balaji

1

slide-2
SLIDE 2

Today’s Agenda

  • What is architecture?
  • Why is it important?
  • At the highest level, where is architecture today?

Where is it going?

  • What’s in this class?

2

slide-3
SLIDE 3

What is architecture?

  • How do you build a machine that computes?
  • Quickly, safely, cheaply, efficiently, in technology X, for

application Y, etc.

Civilization advances by extending the number of important

  • perations which we can perform

without thinking about them.

  • - Alfred North

Whitehead

slide-4
SLIDE 4

Orientation

The internet

slide-5
SLIDE 5

Orientation

The internet

slide-6
SLIDE 6

Orientation

The internet

slide-7
SLIDE 7

Orientation

System Bus (PCI) IO Power Memory Power Memory Memory Memory Architecture begins about here.

Radio

Storage

slide-8
SLIDE 8

Orientation

System Bus (PCI) IO Power Memory Power Memory Memory Memory Architecture begins about here.

Radio

Storage

slide-9
SLIDE 9

Orientation

System Bus (PCI) IO Power Memory Power Memory Memory Memory Architecture begins about here.

Radio

Storage Memory IO CPU

slide-10
SLIDE 10
slide-11
SLIDE 11
slide-12
SLIDE 12

You are here

slide-13
SLIDE 13

You are here

cse141

slide-14
SLIDE 14

You are here

cse141 cse141

slide-15
SLIDE 15

The processors go here…

slide-16
SLIDE 16

The processors go here…

slide-17
SLIDE 17

The processors go here…

slide-18
SLIDE 18

The processors go here…

slide-19
SLIDE 19

The processors go here…

slide-20
SLIDE 20

The processors go here…

slide-21
SLIDE 21

The processors go here…

slide-22
SLIDE 22

The processors go here…

slide-23
SLIDE 23

The processors go here…

slide-24
SLIDE 24

The processors go here…

slide-25
SLIDE 25

The processors go here…

slide-26
SLIDE 26

The processors go here…

slide-27
SLIDE 27

The processors go here…

slide-28
SLIDE 28

The processors go here…

slide-29
SLIDE 29

The processors go here…

slide-30
SLIDE 30

The processors go here…

slide-31
SLIDE 31

The processors go here…

slide-32
SLIDE 32

Abstractions of the Physical World…

Physics/Materials Devices Micro-architecture Architectures Processors

slide-33
SLIDE 33

Abstractions of the Physical World…

Physics/Materials Devices Micro-architecture Architectures Processors

This Course cse241a/ ECE dept Physics/ Chemistry/ Material science

slide-34
SLIDE 34

…for the Rest of the System

Architectures

JVM

Processor Abstraction Compilers Languages Software Engineers/ Applications

slide-35
SLIDE 35

…for the Rest of the System

Architectures

JVM

Processor Abstraction Compilers Languages Software Engineers/ Applications

cse130 cse121 cse131 cseEverythingElse

slide-36
SLIDE 36

Why study architecture?

11

  • As CEs or CSs you should understand how computers

work

  • Processors are the basis for everything in CS (except theory)
  • They are where the rubber meets the road.
  • Performance is important
  • Faster machines make applications cheaper
  • Understanding hardware is essential to understanding how systems

behave

  • It’s cool!
  • Microprocessors are among the most sophisticated devices

manufactured by people

  • How they work (and even that they work) as reliably and as quickly

as they do is amazing.

  • Architecture is undergoing two simulatenous revolution
  • - Multicore and mobility
  • The future is uncertain
  • Opportunities for innovation abound.
slide-37
SLIDE 37

Performance and You!

  • Live Demo

12

slide-38
SLIDE 38

Building Microprocessors

  • Chips are made of silicon
  • Aka “sand”
  • The most abundant element in the

earth’s crust.

  • Extremely pure (<1 part per billion)
  • This is the purest stuff people make
slide-39
SLIDE 39

Building Chips

slide-40
SLIDE 40

Building Chips

  • Photolithography

Silicon Wafer

slide-41
SLIDE 41

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

slide-42
SLIDE 42

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

Silicon Wafer SiO2 Resist

Apply photo resist

slide-43
SLIDE 43

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

Silicon Wafer SiO2 Resist

Apply photo resist

Silicon Wafer SiO2 Resist Mask Mask

Expose to UV

slide-44
SLIDE 44

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

Silicon Wafer SiO2 Resist

Apply photo resist

Silicon Wafer SiO2 Resist Mask Mask

Expose to UV

Silicon Wafer SiO2

Patterned resist

slide-45
SLIDE 45

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

Silicon Wafer SiO2 Resist

Apply photo resist

Silicon Wafer SiO2 Resist Mask Mask

Expose to UV

Silicon Wafer SiO2

Patterned resist

Silicon Wafer

Etch SiO2

slide-46
SLIDE 46

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

Silicon Wafer SiO2 Resist

Apply photo resist

Silicon Wafer SiO2 Resist Mask Mask

Expose to UV

Silicon Wafer SiO2

Patterned resist

Silicon Wafer

Etch SiO2

Silicon Wafer Met

Deposit metal

slide-47
SLIDE 47

Building Chips

  • Photolithography

Silicon Wafer Silicon Wafer SiO2

Grow silicon dioxide

Silicon Wafer SiO2 Resist

Apply photo resist

Silicon Wafer SiO2 Resist Mask Mask

Expose to UV

Silicon Wafer SiO2

Patterned resist

Silicon Wafer

Etch SiO2

Silicon Wafer Met

Deposit metal

Silicon Wafer Met

Etch SiO2

slide-48
SLIDE 48

Building Blocks: Transistors

slide-49
SLIDE 49

Building Blocks: Wires

slide-50
SLIDE 50

Building Blocks: Wires

slide-51
SLIDE 51

State of the art CPU

  • 1-2 Billion xtrs
  • 32nm features
  • 3-4Ghz
  • Several 100 designers
  • >5 years
  • $3Billion fab
  • >150 GFLOPS

19

slide-52
SLIDE 52

Current state of architecture

slide-53
SLIDE 53

Since 1940

slide-54
SLIDE 54

Since 1940

  • Plug boards -> Java
  • Hand assembling -> GCC
  • No OS -> Windows

Vista

slide-55
SLIDE 55

Since 1940

  • Plug boards -> Java
  • Hand assembling -> GCC
  • No OS -> Windows

Vista

Flexible performance is a liquid asset

  • 50,000 x speedup
  • >1,000,000,000 x density

(Moore’s Law)

slide-56
SLIDE 56

Moore’s Law: Raw transistors

slide-57
SLIDE 57

The Importance of Architecture

  • We design smarter and smarter processors
  • Process technology gives us about 20%

performance improvement per year

  • Until 2004, performance grew at about

40% per year.

  • Architecture is responsible for half the

gains in CPU performance

slide-58
SLIDE 58

Single CPU Performance

24

slide-59
SLIDE 59

Single CPU Performance

24

1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006

slide-60
SLIDE 60

Single CPU Performance

24

1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 47% per year

slide-61
SLIDE 61

Single CPU Performance

24

1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 47% per year 1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 47% per year 39% per year

slide-62
SLIDE 62

Single CPU Performance

24

1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 47% per year 1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 47% per year 39% per year 1 10 100 1000 10000 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT95 specINT2000 specINT2006 47% per year 39% per year 25% per year

slide-63
SLIDE 63

The clock speed addiction

25

  • Clock speed is the biggest contributor to power
  • Chip manufactures (Intel, esp.) pushed clock speeds very

hard in the 90s and early 2000s.

  • Doubling the clock speed increases power by 2-8x
  • Clock speed scaling is essentially finished.
1000 2000 3000 4000 5000 1996 1998 2000 2002 2004 2006 2008 2010 Clock speed (Mhz) Year specINT2000 specINT2006
slide-64
SLIDE 64

Power

26

Watts/cm

2

1 10 100 1000

1.5µ 1.5µ 1µ 1µ 0.7µ 0.7µ 0.5µ 0.5µ 0.35µ 0.35µ 0.25µ 0.25µ 0.18µ 0.18µ 0.13µ 0.13µ 0.1µ 0.1µ 0.07µ 0.07µ

slide-65
SLIDE 65

Power

26

Watts/cm

2

1 10 100 1000

1.5µ 1.5µ 1µ 1µ 0.7µ 0.7µ 0.5µ 0.5µ 0.35µ 0.35µ 0.25µ 0.25µ 0.18µ 0.18µ 0.13µ 0.13µ 0.1µ 0.1µ 0.07µ 0.07µ

slide-66
SLIDE 66

Power

26

Watts/cm

2

1 10 100 1000

1.5µ 1.5µ 1µ 1µ 0.7µ 0.7µ 0.5µ 0.5µ 0.35µ 0.35µ 0.25µ 0.25µ 0.18µ 0.18µ 0.13µ 0.13µ 0.1µ 0.1µ 0.07µ 0.07µ

slide-67
SLIDE 67

Power

26

Watts/cm

2

1 10 100 1000

1.5µ 1.5µ 1µ 1µ 0.7µ 0.7µ 0.5µ 0.5µ 0.35µ 0.35µ 0.25µ 0.25µ 0.18µ 0.18µ 0.13µ 0.13µ 0.1µ 0.1µ 0.07µ 0.07µ

slide-68
SLIDE 68

Power

26

Watts/cm

2

1 10 100 1000

1.5µ 1.5µ 1µ 1µ 0.7µ 0.7µ 0.5µ 0.5µ 0.35µ 0.35µ 0.25µ 0.25µ 0.18µ 0.18µ 0.13µ 0.13µ 0.1µ 0.1µ 0.07µ 0.07µ

slide-69
SLIDE 69

Power

26

Watts/cm

2

1 10 100 1000

1.5µ 1.5µ 1µ 1µ 0.7µ 0.7µ 0.5µ 0.5µ 0.35µ 0.35µ 0.25µ 0.25µ 0.18µ 0.18µ 0.13µ 0.13µ 0.1µ 0.1µ 0.07µ 0.07µ

slide-70
SLIDE 70

What’s Next: Brainiacs

  • Hold the clock rate steady.
  • Be smarter in silicon
  • More sophisticated processors
  • More clever algorithms
  • This continues to deliver about 25% per year.
  • But for how long?

27

slide-71
SLIDE 71

What’s Next: Parallelism

  • This is all the rage right now
  • You probably own a multi-processor, they used to

be pretty exotic.

  • They provide some performance, but it’s hard to

use.

  • There aren’t that many threads
  • Remember, flexible performance is a liquid asset
  • Remember or look forward to cse121

28

slide-72
SLIDE 72

29

Intel P4 1 core Intel Core 2 Duo 2 cores AMD Magny-Cours 6 cores SPARC T1 8 cores Cell BE 8 + 1 cores Intel Nahalem 4 cores Intel Sandbridge 4 cores + GPU

slide-73
SLIDE 73

Computer Performance

30

slide-74
SLIDE 74

Computer Performance

30

100 1000 10000 1996 1998 2000 2002 2004 2006 2008 2010 Relative Performance Year specINT2000 specINT2006 39% per year 25% per year

slide-75
SLIDE 75

Course Staff

  • Instructor: Steven Swanson
  • Lectures Tues + Thurs
  • TAs
  • Sanath Kumar
  • Vineet Kumar
  • Bharathan Balaji
  • See the course web page for

contact information and

  • ffice hours.

31

slide-76
SLIDE 76

What’s in this Class

32

  • Main topics
  • Instruction sets
  • The basics of silicon technology
  • Measuring performance
  • How processors work
  • Basic pipelining
  • Data and control hazards
  • Branch prediction and speculation
  • The memory system
  • Introduction to multiprocessors
  • Computing survival skills
  • Reading x86 assembly
  • Performance intuition and debugging
  • Occasional technology digressions
  • How various technologies actually work.
slide-77
SLIDE 77

Your Tasks

  • Read the text!
  • Computer Organization and Design: The Hardware/Software

Interface (4th Edition) -- previous editions are not supported

  • I’m not going to cover everything in class, but you are

responsible for all the assigned text.

  • Come to class!
  • I will cover things not in the book.

You are responsible for that too.

  • Class participation (5%)
  • Homeworks throughout the course. (10%)
  • Weekly quizzes on Thursdays (10%)
  • One midterm. (25%)
  • One cumulative final. (35%)
  • One project (15%)
  • Design your own ISA!

33

slide-78
SLIDE 78

Quizzes

  • Every Thursday at the beginning of class -- don’t

be late

  • Covers everything up to and including the

previous class

  • 10 Minutes, 4-5 questions
  • Roughly 1% of your grade each
  • No make-ups

34

slide-79
SLIDE 79

Homeworks

  • Assigned on Thursday, due one week later
  • Mostly from the book.
  • These are the best way to prepare for the tests.
  • Due in Sanath Kumar’s box, 15 minutes before

class starts.

  • Sanath’s mailbox is located in the grad student mail

room on the second floor of CSE.

35

slide-80
SLIDE 80

Micro Projects

  • Sort of like extra credit.
  • Each one you complete will replace your lowest

quiz or homework grade.

  • These are “challenge problems”
  • They are more work than the points suggest.
  • They are meant to be interesting and fun.
  • Submit them to me for grading via email:
  • Subject: 141 Microproject #n
  • If you get the subject wrong there is no guarantee I will

see them.

  • Due 2 weeks after they are assigned.

36

slide-81
SLIDE 81

The Link to 141L

  • You do not need to take 141L along with 141,

but you may need both to get your degree.

  • The classes are mostly independent, except
  • The results of the project will be used in 141L
  • You can earn extra credit by licensing your ISA groups in

141L who are not in 141

37

slide-82
SLIDE 82

Grading

  • Grading is on a 13 point scale -- F through A+
  • You will get a letter grade on each assignment
  • Your final grade is the weighted average of the

assignment grades.

  • An excel spreadsheet calculates your grades
  • We will post a sanitized version online once a week.
  • It will tell you exactly where you stand.
  • It specifies the curves used for each assignment etc.
  • OpenOffice doesn’t run it properly.

38

slide-83
SLIDE 83

Academic Honesty

  • Don’t cheat.
  • Cheating on a test will get you an F in the class and no
  • ption to drop, and a visit with your college dean.
  • Cheating on homeworks means you don’t have to turn

them in any more, but you don’t get points either. You will also take at least 25% penalty on the exam grades.

  • Copying solutions of the internet or a solutions

manual is cheating.

  • Review the UCSD student handbook
  • When in doubt, ask.

39