CKV

Advanced VLSI Architecture

MEL G624

Lecture 2: Quantitative Analysis

 CKV
Current Trends in Technology
A computer architect must plan for technology changes

Aware of implementation technologies

Implementation technologies that are critical – IC, Memory

Integrated Circuit technology :

Transistor Density – 35% / year
Processor
Die Size – 10 - 20 % / year

Overall – 40 - 55 % / year The Famous Moore’s law

 CKV
Current Trends in Technology
Semiconductor DRAM:
DRAM capacity – 25-40 % / year
Primary memory
Rate is slowing

Concerns of stagnation
Semiconductor Flash:
Capacity per chip – 50-60 % / year

15-20X cheaper/bit than DRAM

Magnetic Disk Technology:
Capacity per chip – 40 % / year Secondary memory

15-25X cheaper/bit than Flash Magnetic disk still used??

Magnetic Disk Tech. Central
300-500X cheaper/bit than DRAM to server applications
 CKV

Well …!
Everything is getting better by about 40 % / year
Why is Frequency not increasing at the same rate?
 CKV

Trends in Power and Energy

Power is the biggest challenge facing computer designer

Power must be distributed throughout the chip

Power is dissipated as heat

Power supply
Three primary concerns Cooling Requirement
Maximum power requirement
Sustained power consumption (thermal design power)

Energy Efficiency
 CKV

Trends in Power and Energy

Energy and power within a microprocessor

What is the primary source of Energy consumption in CMOS

chips ?

Energy consumed when transistor

switches from one state to the other

1 2
Energy dynamic ∝ ×Capacitive load ×Voltage
2
 CKV

Trends in Power and Energy

Energy and power within a microprocessor

What is the relation between Power and Energy?

Power is the product of energy of a transition X frequency of

transitions
 CKV

Trends in Power and Energy

How can I reduce the energy and power consumption ?

1 2
Energy dynamic ∝ ×Capacitive load ×Voltage
2

Reducing Voltage  Voltages have dropped from 5 V to 1V in 20 Yrs

Capacitive load  Capacitances reduce as we move to new

technology nodes
 CKV

Trends in Power and Energy

All is well right ?

Intel 80386 ~ 2 W Intel core I7 3.3 GHz ~ 130W

Due to increase in no. of transistors switching and frequency with

which they switch
 CKV

Trends in Power and Energy

Given that this heat must be dissipated from chip of 1.5 cm x 1.5 cm

We have reached the limit of what can be cooled by air ?

 CKV

Trends in Power and Energy

How to reduce the power consumption ?

Distributing power, removing heat, preventing hotspots - Challenges

One of the reasons to move to multicore processors

CPU 3 GHz CPU 3 GHz

CPU 5 GHz

CPU 3 GHz CPU 3 GHz

 CKV

Trends in Power and Energy

Modern processors offer many techniques to improve

energy efficiency
Clock gating – Switch off Clock for inactive modules

Floating
Clock Point Unit

If no floating point operations are being done

Core 1 Core 2 If core 2 is idle stop Clock for core 2

 CKV

Trends in Power and Energy

Other Techniques

Dynamic Voltage- Frequency scaling (DVFS) – operate at low

frequency and low voltage when activity is less

Design for typical case – low power modes to extend battery

Overclocking – Turbo mode by Intel. For single threaded code

overclock single core and turned off other cores
 CKV

Trends in Power and Energy

Although dynamic power is primary source

Static power is catching up because of leakage currents

Power gating Power Core

 CKV

Performance

My
No.. my
computer
computer
is Faster
faster…!!!

When you say one computer is faster than the other, what do
you mean ?
 CKV

Performance

Desktop user may say computer is faster when program runs in

less time

Flipkart admin may say computer is faster when it completes

more transactions per hour

Computer user is interested in reducing Response time

-time between start and completion of an event

Operator of warehouse-scale computer might be interested in

increasing throughput
-amount of work done in given time
 CKV

Performance

Different metrics to measure performance of different computers

Here we will stick to Response time/Execution time

1
Perormance X =
Execution time X

If Perormance X >Perormance Y

What is relation between execution times of X and Y ?

 CKV

Performance

Time can be defined in different ways

Simple definition – wall clock time, response time, elapsed time

These mean total time to complete a task, including memory

access, I/O activities and operating system overhead
Thread 1
of task 1

I/O CPU Memory

Thread 1
of task 2

A processor may work on several programs simultaneously

 CKV

Performance

Need to distinguish between elapsed time and the time spent

on your task

CPU Execution time

Time spent by CPU for computing your task

Does not include time spent on waiting for I/O or other Programs

User CPU time System CPU time

System monitoring, logs
 CKV

Performance
How do you measure time??

One of the time measure is Clock cycles

¿CPU Clock cycles for a program×Clock cycle time

?? ?

?? ?
CPU Clock cycles for a program  
¿
Clock rate
 CKV

Performance
CPU clock cycles Processors executes Instructions

¿ Instructions for a program × Average clock cycles per instruction

Clock cycles per instruction  CPI

Classic CPU performance equation

CPU time
¿ No of Instructions × CPI ×Clock cycle time

No of instructions × CPI
¿
Clock Rate
 CKV

Performance

Alternative Representation

CPU time
¿ No of Instructions × CPI ×Clock cycle time

No of instructions × CPI
¿
Clock Rate

Instructions Clock cycles Seconds

time=seconds/ program=¿ program × Instruction ×Clock Cycle
 CKV

Thank You for Attending