High Performance Computing

on Windows
The Windows Cluster at CCC, RWTH Aachen
Login, Using the Batchsystem
Christian Terboven
Center for Computing and Communication
RWTH Aachen University

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Agenda
The Windows-HPC cluster
Login from Windows
Login from Linux
Using the Batchsystem
Short demo: HelloWorld-C-MPI

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Agenda
The Windows-HPC cluster
Login from Windows
Login from Linux
Using the Batchsystem
Short demo: HelloWorld-C-MPI

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

The Windows-HPC cluster

Name of the interactive machine: cluster-win.rz.rwth-aachen.de
Current interactive machine: winoc45
Sun Fire V40z: quad Opteron, 2.2 GHz, 8 GB
Windows Server 2003, Enterprise Edition, 64bit
Login node, no jobs are scheduled on this machine

Backup and lab interactive machine: winwcc00

Dell PowerEdge 1950: dual dual-core Woodcrest, 3.0 GHz, 16 GB
Windows Server 2003, Enterprise Edition, 64bit
Jobs may be scheduled on this machine

Future frontend machine: winctc00

Dell Power Edge 1950, dual quad-core Clovertown, 2.7 GHz, 16 GB
Windows Server 2003, Enterprise Edition, 64bit
Login node, no jobs are scheduled on this machine

Switch of the frontend machines in about two weeks or so

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

The Windows-HPC cluster

Cluster management node: winoc48
Compute nodes: winoc46, winoc47, winoc48
Sun Fire V40z: quad Opteron, 2.2 GHz, 8 GB
Windows Compute Cluster Server 2003, 64bit

Compute nodes: winctc01, winctc02, winctc03

Dell PowerEdge 1950: dual quad-core Clovertown, 2.7 GHz, 16 GB
Windows Compute Cluster Server 2003, 64bit
InfiniBand network

Development software
Visual Studio 2005, SP1
Intel C/C++ and FORTRAN compilers, version 9.1 / 10.0 beta
Microsoft Compute Cluster Pack (Microsoft MPI)

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

The Windows-HPC cluster

Development software (contd)
MPICH2
Intel VTune Performance Analyzer
Intel Threading Tools: Thread Checker + Thread Profiler
Intel Threading Building Blocks
Intel Math Kernel Library (MKL)
Selected ISV applications:
Matlab R2006a (64bit)
Maple 10
Altair HyperView
MSC Marc Mentat
Fluent 6.2.16

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

The Windows-HPC cluster

Other software
Microsoft Office 2003, StarOffice 8
Other development software: MSDN, .NET, Windows SDK,
SSH-Client, X-Win 32, cygwin
File infrastructure:
The My Documents folder is mapped to
H:\Eigene_Dateien\Win-HPC\

Unix $HOME is exported as \\vfsc4\userid and mounted as H:

during interactive login
Unix $WORK is exported as \\vfsc5\work and mounted as W:
during interactive login
Batchjobs need to mount H: and W: explicitly, or use the path
expression to access the directories
C
Scratch filesystem $TMP / $TEMP is on local disc

HPC on Windows - 2007

Cen te r for
Computing and C omm un ic a tion

C
C

Agenda
The Windows-HPC cluster
Login from Windows
Login from Linux
Using the Batchsystem
Short demo: HelloWorld-C-MPI

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Login from Windows

Use the Remote Desktop Connection program, probably available
under Accessoires Communication.
Specify the computer name, in
general cluster-win.rz.rwthaachen.de. Throughout the lab
tomorrow, we will use separate
machines.

You can save a set of settings under

a named profile / link.

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Login from Windows

You can choose a resolution or
fullscreen mode.

You can choose the color depth.

In fullscreen mode you should set
this flag for easier handling of the
remote desktop window.

10

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Login from Windows

Take resources of your local
computer with you:
Audio device

11

Printer
Clipboard
Local hard disc drives
Locally mounted network drives

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Agenda
The Windows-HPC cluster
Login from Windows
Login from Linux
Using the Batchsystem
Short demo: HelloWorld-C-MPI

12

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Login from Linux

Use the rdesktop program available from www.rdesktop.org,
probably already included in your distribution.
Basic usage: rdesktop [options] host with
-u <user>: Login as user <user>
-d WIN-HPC: Login to domain WIN-HPC
-g WxH: Use resolution Width x Height
-f: Use fullscreen resolution
-a 24: Use 24bit color depth
-k de: Use german keyboard layout
-r sound:local: Play sound on local system

13

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Login from Linux

Important: choose WIN-HPC domain

as the login to other domains will fail.

14

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Agenda
The Windows-HPC cluster
Login from Windows
Login from Linux
Using the Batchsystem
Short demo: HelloWorld-C-MPI

15

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Using the Batchsystem

The Compute Cluster Job Manager is a GUI program to manage jobs
of the Batchsystem, find it under All Programs Microsoft Compute
Cluster Pack Compute Cluster Job Manager.
It is only possible to
influence your own
jobs!
Show Filter:
All Jobs
Active Jobs
Finished Jobs
Failed Jobs
Cancelled Jobs

16

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Using the Batchsystem

To submit a new Job choose File Submit Job.
You are free to choose a Job Name
and a Project Name as you like.
In the not too far future, we may
evaluate the Project Name field to
control resource allocation.

17

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Using the Batchsystem

Several options can be set for a Job.
You have to specify the number of
processors your job needs.
You may estimate the runtime for
your Job, but you are not required
to do so.
Currently, there is not runtime limit
for a Job / Task. We may introduce
that in the future (24h or so).
Problem without runtime limit:
Malfunctioning jobs may be
overlooked.
We cannot save Jobs from
dying in case of system
maintenance.
C

18

HPC on Windows - 2007

Cen te r for
Computing and C omm un ic a tion

C
C

Using the Batchsystem

A Job consists of one or more Tasks.
Tasks are the executable pieces of
a job. You can freely choose a
Task Name.
For Command Line you can specify
the full path to a program including
program options or to a .bat or
.cmd file.
You have to use \\vfsc4\userid
instead of H: and \\vfsc5\work
instead of W: throughout your Job.
For MPI Tasks just include mpiexec
in the Command Line, do not
specify any other options.

19

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Using the Batchsystem

Several options can be set for a Task.
Tasks are not allowed to use GUI
elements.
You can specify Standard Input,
Standard Output and Standard
Error for a Task, as well as the
Working Directory.
Using Task Dependencies you can
define an order in which Tasks
have to be executed.
In the Environment register, you
can set environment variables for a
Task, e.g. OMP_NUM_THREADS for
OpenMP Tasks.

20

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Using the Batchsystem

A dedicated machine can be specified for a Job / for Tasks.
If you do not need a special
machine just leave Use any
available nodes option set.
Problem for Shared-Memory
parallel Jobs: if you specify n
processors, the assigned n
processors may be distributed
among several machines.
Planned feature: If you specify
OpenMP in Project Name, we
will take care of finding n
processors on one machine.

21

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

Agenda
The Windows-HPC cluster
Login from Windows
Login from Linux
Using the Batchsystem
Short demo: HelloWorld-C-MPI

22

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion

End of this part

Questions?

23

HPC on Windows - 2007

C
C
C

Cen te r for
Computing and C omm un ic a tion