Computer Organization and Design

Dr. Arjan Durresi Louisiana State University Baton Rouge, LA 70803 d durresi@csc.lsu.edu @ l d These slides are available at: http://www.csc.lsu.edu/~durresi/CSC3501_07/
Louisiana State University

1- Introduction - 1

CSC3501 FALL07

Overview
How What When Why

Louisiana State University

1- Introduction - 2

CSC3501 FALL07

Overview
How am I going to grade you? What are we going to cover? When are you going to do it? Why you should take this course?

Louisiana State University

1- Introduction - 3

CSC3501 FALL07

Grading
Learning-centered course: The first priority: Maximize learning Your Y grade d will ill d depend p nd on nh how m much h you have learned 3 Quizzes (2 best out of three) 55% Activity in the class (15%) Questions and discussions in class give you points and improve the quality of teaching Homework (30%)

Louisiana State University

1- Introduction - 4

CSC3501 FALL07

Yes, I do use curve. Your grade depends upon the performance of the rest of the class. All homeworks are due at the beginning g g of the next class. All late submissions must be preapproved. All quizzes are open-book and extremely time limited. Quizzes consist of numerical as well as multiple-choice (true-false) questions. There is negative grading on incorrect multiple-choice questions.

Louisiana State University

Frequently Asked Questions

1- Introduction - 5

CSC3501 FALL07

What Is This Course About?

Understanding of basic issues, concepts, principles of Computer Architecture. Organizational paradigms that determine: Capabilities, Performance and the Success Relationship between hardware and software Focus on the concepts that are the basis of current computers.

Louisiana State University

1- Introduction - 6

CSC3501 FALL07

Text Book

David A. Patterson, John L. Hennessy" Computer Organization and Design The Hardware/Software Interface," Third Edition, 2005, ISBN:1-55860-604-1 . This book is very comprehensive. I will follow it as much as possible.

Louisiana State University

1- Introduction - 7

CSC3501 FALL07

Tuesday and Thursday: 3:00 to 4:00 PM and by appointments Office: 291 Coates Hall Telephone: (225)-578-3902 Email: durresi@csc.lsu.edu Course web page: http://www csc lsu edu/~durresi/CSC3501 http://www.csc.lsu.edu/ durresi/CSC3501_07 07 GTA:
Email:

Office Hours

Louisiana State University

1- Introduction - 8

CSC3501 FALL07

Introduction

This course is all about how computers work But what do we mean by a computer?

Different types: desktop, servers, embedded devices Different uses: automobiles, automobiles graphics, graphics finance, finance genomics genomics Different manufacturers: Intel, Apple, IBM, Microsoft, Sun Different underlying technologies and different costs! Many similarities from vehicle to vehicle (e.g., wheels) Huge differences from vehicle to vehicle (e.g., gas vs. electric) Focus on a specific instance and learn how it works While learning general principles and historical perspectives
1- Introduction - 9 CSC3501 FALL07

Analogy: Consider a course on automotive vehicles

Best way to learn:

Louisiana State University

Course Outline

Course overview and topics Introduction to Computer Architecture Instruction nstruct on Set S t Architecture rch t ctur Arithmetic for Computers Performance of Computer Systems Basics of Digital Logic Design Register Files and Memory ALU Design Designing of MIPS Processor (Single-Cycle) Designing of MIPS Processor (Multi-Cycle) Pipelining Memory Hierarchy
1- Introduction - 10 CSC3501 FALL07

Louisiana State University

Why learn this stuff?

You want to call yourself a computer scientist You want to build software people use (need performance) You need to make a purchasing decision or offer expert advice Both Hardware and Software affect performance:

Algorithm determines number of source-level statements Language/Compiler/Architecture determine machine instructions (Chapter 2 and 3) Processor/Memory determine how fast instructions are executed (Chapter 5, 6, and 7)

Assessing and Understanding Performance in Chapter 4

1- Introduction - 11 CSC3501 FALL07

Louisiana State University

Components: input (mouse, keyboard) output p (display, ( p y, printer) p ) memory (disk drives, DRAM, SRAM, CD) network Our primary focus: the processor (datapath and control) implemented using millions of transistors Impossible to understand by looking at each transistor We need...

Louisiana State University

What is a computer?

1- Introduction - 12

CSC3501 FALL07

Abstraction

Delving into the depths reveals more information An abstraction omits unneeded detail, helps us cope with complexity

What are some of the details that appear in these familiar abstractions?
Louisiana State University

1- Introduction - 13

CSC3501 FALL07

How do computers work?

Need to understand abstractions such as: Applications software Systems software Assembly Language Machine Language Architectural Issues: i.e., Caches, Virtual Memory, Pipelining Sequential logic, finite state machines Combinational logic, arithmetic circuits Boolean logic, 1s and 0s Transistors used to build logic gates (CMOS) Semiconductors/Silicon S i d /Sili used d to b build ild transistors i Properties of atoms, electrons, and quantum dynamics So much to learn!

Louisiana State University

1- Introduction - 14

CSC3501 FALL07

Forces on Computer Architecture

Technology
Applications
Computer Architecture Programming Languages

Operating Systems

History
(A = F / M)

Louisiana State University

1- Introduction - 15

CSC3501 FALL07

Amazing Underlying Technology Change

Louisiana State University

1- Introduction - 16

CSC3501 FALL07

Historical Perspective

ENIAC built in World War II was the first general purpose computer Used for computing artillery firing tables 80 feet long by 8.5 feet high and several feet wide Each E h of f the th t twenty t 10 digit di it registers i t was 2 f feet tl long Used 18,000 vacuum tubes Performed 1900 additions per second
Since then: Moores Law: transistor t i t capacity it doubles d bl every 18-24 months

Louisiana State University

1- Introduction - 17

CSC3501 FALL07

Below Your Program

Louisiana State University

1- Introduction - 18

CSC3501 FALL07

Operating System
Handling basic input and output operations Allocating g storage g and memory y Providing for sharing the computer among multiple applications using it simultaneously

Louisiana State University

1- Introduction - 19

CSC3501 FALL07

Below Your Program

High level languages: 1)Allow to think in a more natural way 2) Improve programmer productivity 3) Allows programs to be independent of the computer

Louisiana State University

1- Introduction - 20

CSC3501 FALL07

Computer Organization

The five classic components: 1) Input, 2) Output, 3) Memory, 4) Datapath 5) Control

Louisiana State University

1- Introduction - 21

CSC3501 FALL07

Inside Pentium 4

Louisiana State University

1- Introduction - 22

CSC3501 FALL07

Communicating with other computers

Networks are the backbone of the current computing system Information is exchanged among computers at high speed Resource sharing. Especially expensive resources. Nonlocal access. Freedom for users Optical, wireless

Louisiana State University

1- Introduction - 23

CSC3501 FALL07

The Chip Manufacturing Process

Louisiana State University

1- Introduction - 24

CSC3501 FALL07

An 8 8-inch wafer containing Pentium 4 processors

Louisiana State University

1- Introduction - 25

CSC3501 FALL07

Pentium 4 Processor

Louisiana State University

1- Introduction - 26

CSC3501 FALL07

Measurement and Evaluation

Design Analysis Architecture is an iterative process -- searching the space of possible designs -- at all levels of computer systems

Creativity
Cost / Performance Analysis

Good Ideas

Bad Ideas
Louisiana State University

Mediocre Ideas

1- Introduction - 27

CSC3501 FALL07

What is Computer Architecture?

Application Operating System Compiler Firmware Instruction Set Architecture

Instr. Set Proc. I/O system Datapath & Control Digital Design Circuit Design
Layout

of many levels of abstraction Under a rapidly changing set of forces Design, Measurement, and Evaluation
Coordination
Louisiana State University

1- Introduction - 28

CSC3501 FALL07

Computer Architecture

A modern meaning of the term computer architecture covers three aspects of computer design:

instruction set architecture, architecture computer organization and computer hardware. Instruction Set Architecture - ISA refers to the

actual programmer-visible machine interface such as instruction set, registers, memory organization and exception handling. Two main approaches: RISC and CISC architectures. A computer organization and computer hardware are two components of the implementation of a machine.
1- Introduction - 29 CSC3501 FALL07

Louisiana State University

of a design, such as the memory system, the bus structure, and the design of the internal CPU (where arithmetic logic arithmetic, logic, branching and data transfers are implemented). Computer hardware refers to the specifics of a machine, included the detailed logic design and the packaging technology of the machine. For many years the interaction between ISA and implementations was believed to be small, and implementation l issues were not a major focus f in designing instruction set architecture. In the 1980s, it becomes clear that both the difficulty and inefficiency of pipelining could be increased by instruction set architecture complications.
1- Introduction - 30

Computer organization includes the high-level aspects

Computer Architecture

Louisiana State University

CSC3501 FALL07

Louisiana State University

Computer architects must design a computer to meet functional requirements as well as price, power, and performance goals. Often, they also have to determine what the functional requirements are, which can be a major task. task Once a set of functional requirements has been established, the architect must try to optimize the design. Here are three major application areas and their main requirements: Desktop computers: focus on optimizing costperformance as measured by p y a single g user, with little regard for program size or power consumption, Server computers focus on availability, scalability, and throughput cost-performance, Embedded computers driven by price and often power issues, plus1-code size is important.CSC3501 FALL07 Introduction - 31

Tasks of Computer Architects

Classes of Computing

Louisiana State University

1- Introduction - 32

CSC3501 FALL07

Major Architectures

Louisiana State University

1- Introduction - 33

CSC3501 FALL07

Rapid Rate of Improvements

Now, less than one thousand dollars purchases a personal computer that has more performance more main memory performance, memory, and more disk storage than a computer bought in 1980 for one million dollars. For many applications, the highestperformance microcomputers of today outperform the supercomputers of less than 10 years ago. This rapid rate of improvement has come from two forces: technology used to build computers and innovations in computer design. 1- Introduction - 34 CSC3501 FALL07

Louisiana State University

Growth of capacity per DRAM chip over time

Louisiana State University

1- Introduction - 35

CSC3501 FALL07

Performance of Workstations

Louisiana State University

1- Introduction - 36

CSC3501 FALL07

A take on Moores Law

Bit-level parallelism 100,000,000 Instruction-level Thread-level (?)

10,000,000

R10000

1,000,000 Transistors

Pentium

i80386
R2000

100,000

i80286

R3000

i8086

10,000
i8080 i8008 i4004

1,000 1970

1975

1980

1985

1990

1995

2000

2005

Louisiana State University

1- Introduction - 37

CSC3501 FALL07

Clock Rate: ~30% per year Transistor Density: ~35% Chip Area: ~15% 15% Transistors per chip: ~55% Total Performance Capability: ~100% by the time you graduate... 3x clock rate (4-6 GHz) 10x transistor count (1 Billion transistors) 30x raw capability

Technology Trends

plus 16x dram density, 32x disk density

1- Introduction - 38 CSC3501 FALL07

Louisiana State University

Performance Trends
100 Supercomputers

10 Performance Mainframes Microprocessors Minicomputers 1

0.1 1965

1970

1975

1980

1985

1990

1995

Louisiana State University

1- Introduction - 39

CSC3501 FALL07

Technology Trends

Integrated circuit logic technology a growth in

transistor count on chip of about 55% per year. Semiconductor RAM density increases by 40% to 60% per year, while cycle time has improved very slowly, decreasing by about one-third in 10 years. Cost has decreased at rate about the rate at which density increases. Magnetic disc technology disk density has been recently improving more then 100% per year, while prior to 1990 about 30% per year. year Network technology Latency and bandwidth are important, though recently bandwidth has been primary focus. Internet infrastructure in the U.S. has been doubling in bandwidth every year.
1- Introduction - 40 CSC3501 FALL07

Louisiana State University

Developments in Computer Design

During the first 25 years of electronic computers both forces, technology and innovations in computer design made major contributions. contributions Then, during the 1970s, computer designers were largely dependent upon integrated circuit technology, with roughly 35% growth per year in processor performance. In the last 20 year, the combination of innovations in computer design and improvements in technology has led sustained growth in performance at an annual rate of over 55%. In this period, the main source of innovations in computer design has come from RISCstyle pipelined processors.
1- Introduction - 41 CSC3501 FALL07

Louisiana State University

Growth in Microprocessor Performance

Louisiana State University

1- Introduction - 42

CSC3501 FALL07

RISC Architecture

After 1985, any computer announced has been of RISC architecture. RISC designers focused on two critical i i l performance f techniques h i in i computer design: the exploitation of instruction-level parallelism, first through pipelining and later through multiple instruction issue, the h use of f cache, h first f in simple l forms f and d later using sophisticated organizations and optimizations.
1- Introduction - 43 CSC3501 FALL07

Louisiana State University

RISC ISA Characteristics

All operations on data apply to data in registers and typically change the entire register; The only operations that affect memory are load and store operations that move data from memory to a register or to memory from a register, respectively; A small number of memory addressing modes; The instruction formats are few in number with all instructions typically being one size; Large g number of registers; g These simple properties lead to dramatic simplifications in the implementation of advanced pipelining techniques, which is why RISC architecture instruction sets were designed this way.
1- Introduction - 44 CSC3501 FALL07

Louisiana State University

RISC and CISC Architecture

RISC Reduced Instruction Set Computer CISC Complex (and Powerful) Instruction Set Computer What does MIPS stand for? Answer: Microprocessor without Interlocked Pipeline Stages. MIPS processor is one of the first RISC processors. Again, all processors announced after 1985 have been of RISC architecture. What is the main example of CISC architecture processor? Answer: Intel IA-32 processors (in over 90% computers). p ) Intel IA-32 processors, from 80386 processor in early 80s to Pentium IV today, and the next one to be introduced this or next year, are of CISC architecture. All Intel IA-32 processors are having as a base the Identical instruction set architecture designed in early 1980s.
1- Introduction - 45 CSC3501 FALL07

Louisiana State University

Intel IA-32 Processors

The improvements in technology have allowed the latest Intel IA-32 processors (of CISC architecture) to adopt many innovations first pioneered in the RISC design. Since 1995, , Pentium processors p consist of a front end processor p and a RISC-style processor. The front end processor fetches and decodes Intel IA-32 complex instructions and maps them into microinstructions. A microinstruction is a simple instruction used in sequence to implement a more complex instruction. Microinstructions look very much as RISC instructions. Then, hen, the RISC-style S style processor executes microinstructions. m cro nstruct ons. As a transistor counts soured, the overhead (in transistors) of interpreting the more complex IA-32 architecture becomes negligible.

Louisiana State University

1- Introduction - 46

CSC3501 FALL07

This graph compares results of VAX 8700 (CISC) and MIPS M2000 (RISC) processors that execute nine programs from SPEC89 benchmarks. CPU time = Instruction_count * CPI / Clock_rate

VAX vs. MIPS processors

Louisiana State University

1- Introduction - 47

CSC3501 FALL07

Comparison of VAX and MIPS processors

The graph indicates that, on average, MIPS executed about twice as many instructions as VAX. (Bad for MIPS) The h graph h indicates d that, h on average, the h CPI P for f the h VAX was about six times larger than that for MIPS. (Bad for VAX) CPI the average number of clock cycles per instruction CPI = CPU_clock_cycles_for_a_program Instruction_count CPU time a time to execute a given program CPU time = Instruction_count *CPI Clock_rate Since clock rates were identical, identical MIPS had almost three times better performance (measured by CPU time) than VAX.

Louisiana State University

1- Introduction - 48

CSC3501 FALL07

Summary

There will be a lot of self-reading Get ready to work hard

Louisiana State University

1- Introduction - 49

CSC3501 FALL07

Thank You!

Louisiana State University

1- Introduction - 50

CSC3501 FALL07