Change Data Capture using AWS Database Migration Service

Migrate and Replicate

This architecture enables customers to migrate databases using on-going replication.

1 Sources for change data capture

(CDC) include Oracle, SQL Server,
Data MySQL, PostgreSQL, MongoDB,
AWS Cloud
Center 4 Data Targets Amazon Aurora, Amazon
1 DocumentDB, and Amazon RDS.
Data Sources
Homogeneous 2 The AWS Schema Conversion Tool
or makes heterogeneous database
heterogeneous migrations predictable by
Amazon Aurora Amazon automatically converting the
3 DynamoDB source database schema and a
Amazon Aurora majority of the database code
objects to a format compatible
with the target database.
Amazon RDS Amazon Elasticsearch
Service
AWS Database
3 AWS Database Migration Service
Amazon DocumentDB Migration Service helps you with one-time data
2 migration of databases and
Amazon continuous data replication. AWS
DocumentDB Amazon S3 Database Migration Service
AWS Schema captures changes on the source
Amazon RDS Conversion Tool database and applies them in a
heterogeneous transactionally consistent way to
the target.
MongoDB MongoDB Amazon
Redshift 4 Targets for CDC include Oracle,
SQL Server, MySQL, PostgreSQL,
MongoDB, Amazon Aurora,
Amazon DocumentDB, Amazon
RDS, and Amazon S3.

Reviewed for technical accuracy August 2, 2021

© 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Reference Architecture
 Change Data Capture using AWS Database Migration Service
Streaming
This architecture enables customers to ingest real-time changes from source databases through streaming services.
1 Sources for change data capture
(CDC) include Oracle, SQL Server,
MySQL, PostgreSQL, MongoDB,
Data AWS Cloud Amazon Aurora, Amazon
Center 3 DMS Targets Data Targets Consumption DocumentDB, and Amazon RDS.

Data Sources 1 4
5
2 AWS Database Migration Service
helps you with one-time data
migration of databases and
AWS Glue continuous data replication. AWS
Streaming Spark Streaming Amazon DynamoDB Database Migration Service
2 Amazon SageMaker captures changes on the source
Amazon Aurora Notebook database and applies them in a
transactionally consistent way to
Amazon Kinesis the target.
Amazon RDS
Amazon EMR
AWS Database
Amazon 3 You can use AWS DMS to stream
Amazon DocumentDB Migration Service data to an Amazon Kinesis data
QuickSight
stream and Amazon Managed
Amazon MSK Amazon Elasticsearch
Streaming for Apache Kafka
Amazon Kinesis Service
(Amazon MSK) to collect and
Data Analytics process large streams of data.
Amazon RDS Flink
Amazon Athena
Amazon S3 4 You can use purpose-built services
for analytics in your data lake or
MongoDB
data warehouse.
Amazon Kinesis
Data Firehose Amazon Redshift
Amazon Redshift Spectrum 5 You can visualize and consume
data using Amazon QuickSight,
Kibana, and Amazon SageMaker
Notebooks.
Reviewed for technical accuracy August 2, 2021
© 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Reference Architecture
Change Data Capture using AWS Database Migration Service
Amazon S3 with Extract, Transform, Load (ETL) for Upsert
This architecture enables customers to create data pipelines with change data capture to build transactional data lakes.

Data 1 Sources for change data capture

AWS Cloud 4 ETL for Upsert (CDC) include Oracle, SQL Server,
Center MySQL, PostgreSQL, MongoDB,
Data Sources 1 Amazon Aurora, Amazon
DocumentDB, and Amazon RDS.

AWS Glue
3 DMS Targets
2 AWS Database Migration Service
helps you with one-time data
Amazon Redshift
2 migration of databases and
Amazon Aurora continuous data replication. AWS
AWS Lambda Database Migration Service
captures changes on the source
database and applies them in a
AWS Database transactionally consistent way to
Migration Service Amazon S3 the target.
Amazon DocumentDB Append only
AWS Glue
3 The target for change data capture
Amazon S3 is Amazon S3.
Aggregation
Amazon RDS Amazon EMR
4 You can use AWS Glue, Amazon
EMR for extract, transform, load
Hudi
(ETL) upsert to Amazon S3 and
Amazon Redshift.
MongoDB

AWS Lake Formation

Governed Tables

Reviewed for technical accuracy August 2, 2021

© 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Reference Architecture