Deduplication in Windows Server 2012 R2

Mike.Resseler@Veeam.com

Deduplication?
Installation - Config
Architecture
VDI!
Results / Conclusions
More Tips

What is Deduplication?

(wikipedia)

In-line versus Post Process

Source versus Target

File-, Block- or Chunk-Based

Single Instance Storage

Hard Links

Picture: flickr.com/photos/woolamaloo_gazette/

Planning

Great:
{ File share | Virtualization Files | OS deploy files | Backup Files }

Maybe:
{ LOB | Web Servers | HPC |Static content providers }

Poor:
{ Hyper-V hosts | WSUS | SQL / Exchange Servers | Files > 1TB}

Installation

DDPEval <VolumePath:>
Examples:
C:\> DDPEVAL.EXE \\Server\Testshare
C:\> DDPEVAL.EXE E:\Test\
C:\> DDPEVAL.EXE F:
Will produce output similar to the following:
Data Deduplication Savings Evaluation Tool
Copyright 2011-2012 Microsoft Corporation. All Rights Reserved.
Evaluated folder: E:\Test
Processed files: 34
Processed files size: 12.03MB
Optimized files size: 4.02MB
Space savings: 8.01MB
Space savings percent: 66
Optimized files size (no compression): 11.47MB
Space savings (no compression): 571.53KB
Space savings percent (no compression): 4
Files with duplication: 2
Files excluded by policy: 20
Files excluded by error: 0

Windows Server 2012

1 single CPU 4GB Ram - SATA

GUI Based
Through Server Manager

PowerShell
Import-Module ServerManager
Add-WindowsFeature name FS-Data-Deduplication
Import-Module Deduplication

Video: Enable Dedup

Can it be duplicated?
Empty volume?
Resources?
Unsupported Config?

3 Days default (last modified)

Schedule: every hour
Exclusions: edb | jrs
Garbage collection /
data scrubbing on Saterday

Video: Enable Volume - GUI

Video: Enable Volume - GUI

Architecture

Filter Driver
Service Based (ddpsvc)
Garbage Collection
Optimization
Scrubbing

Jobs

Video: Start-DedupJob

Settings | Policies

Settings

Decisions

PowerShell

PowerShell

Get-command Module
Deduplication

Video: PowerShell

VDI!

Overview

Why?

How?

Conclusions

Benefits

Picture: flickr.com/photos/glasgows/

Picture: flickr.com/photos/drmartin/

Capacity optimization
Scale & Performance
Reliability & Data integrity
Management w/ Familiar Tools

BranchCache
Failover Clusters
DFS Replication
SIS: No!

Backups

DDPEval <VolumePath:>
Examples:
C:\> DDPEVAL.EXE \\Server\Testshare
C:\> DDPEVAL.EXE E:\Test\
C:\> DDPEVAL.EXE F:
Will produce output similar to the following:
Data Deduplication Savings Evaluation Tool
Copyright 2011-2012 Microsoft Corporation. All Rights Reserved.
Evaluated folder: E:\Test
Processed files: 34
Processed files size: 12.03MB
Optimized files size: 4.02MB
Space savings: 8.01MB
Space savings percent: 66
Optimized files size (no compression): 11.47MB
Space savings (no compression): 571.53KB
Space savings percent (no compression): 4
Files with duplication: 2
Files excluded by policy: 20
Files excluded by error: 0