Professional Documents
Culture Documents
CS4230 Parallel Programming Introduction To Parallel Algorithms
CS4230 Parallel Programming Introduction To Parallel Algorithms
Lecture 2:
Introduction to Parallel Algorithms
Mary Hall
August 23, 2012
08/23/2012
CS4230
08/23/2012
CS4230
08/23/2012
CS4230
Homework 1, cont.
Problem 3: What are your goals after this year and
how do you anticipate this class is going to help you
with that? Some possible answers, but please feel
free to add to them. Also, please write at least one
sentence of explanation.
- A job in the computing industry
- A job in some other industry that uses computing
- As preparation for graduate studies
- To satisfy intellectual curiosity about the future of the
computing field
- Other
08/23/2012
CS4230
Todays Lecture
Aspects of parallel algorithms (and a hint at
complexity!)
Derive parallel algorithms
Discussion
Sources for this lecture:
- Slides accompanying textbook
08/23/2012
CS4230
08/23/2012
CS4230
Overhead
- Well talk about some different kinds of
overhead
08/23/2012
CS4230
08/23/2012
CS4230
Parallel formulation?
08/23/2012
CS4230
{
{
{
{
{
{
{
{
3
4
t0
8
4
t1
t2
1
4
t3
t4
0
4
8
4
t5
t6
08/23/2012
CS4230
10
1
4
t7
9
4
What Happened?
Dependence on sum across
iterations/threads
- But reordering ok since operations on sum are
associative
CS4230
11
CS4230
12
08/23/2012
CS4230
13
CS4230
14
08/23/2012
CS4230
15
CS4230
16
Version 6 (homework):
Multiple cores forming a global sum
CS4230
08/23/2012
17
Task parallelism
- Partition various tasks carried out solving the problem among
the cores.
Data parallelism
- Partition the data used in solving the problem among the
cores.
- Each core carries out similar operations on its part of the
data.
CS4230
08/23/2012
18
Professor P
15 questions
300 exams
08/23/2012
CS4230
19
TA#1
CS4230
08/23/2012
TA#2
TA#3
20
TA#1
TA#3
100 exams
100 exams
TA#2
100 exams
CS4230
08/23/2012
21
TA#1
TA#3
Questions 11 - 15
Questions 1 - 5
TA#2
Questions 6 - 10
CS4230
08/23/2012
22
08/23/2012
CS4230
23
CS4230
24
CS4230
25