Download as pdf or txt
Download as pdf or txt
You are on page 1of 30

AWS Data, Databases, and Analytics Online Series

Deploying open source databases on AWS

Orlando Andico
Solutions Architect, AWS

© 2020, Amazon Web Services, Inc. or its Affiliates.


Agenda

 Benefits of open source databases

 Why move to managed open source databases

 Managed open source database services from AWS

 Flexible ways to deploy open source AWS databases

 Resources

 Q&A

© 2020, Amazon Web Services, Inc. or its Affiliates.


Benefits of open source databases

Community-driven innovation

No licenses
Users

No vendor lock-in

No vendor audits

© 2020, Amazon Web Services, Inc. or its Affiliates.


Open source innovation

© 2020, Amazon Web Services, Inc. or its Affiliates.


Why move to managed
open source and OS-compatible
databases?

© 2020, Amazon Web Services, Inc. or its Affiliates.


Self managing open source databases is time
consuming, complex, and expensive
Hardware & software installation, configuration, patching, backups

Performance, efficiency and high availability issues

Capacity planning and scaling clusters for compute and storage

Security, governance and compliance

Version updates and lack of support services

© 2020, Amazon Web Services, Inc. or its Affiliates.


Fully managed services on AWS
Spend time innovating & building new apps, not managing infrastructure
Self managed Fully managed

Schema design
Query construction You
Query optimization
Automatic fail-over
Backup & recovery
You Isolation & security
Industry compliance
Push-button scaling AWS
Automated patching
Advanced monitoring
Routine maintenance
© 2020, Amazon Web Services, Inc. or its Affiliates.
Built-in best practices
Benefits of moving to open source and OS-
compatible AWS databases

© 2020, Amazon Web Services, Inc. or its Affiliates.


Hulu is a leading premium streaming service that offers
instant access to live and on demand content

Challenge:
Launched Live TV from scratch. Needed to have
personalized user content and no-skipping ad delivery at
scale and real-time

Solution:
Hulu built Live TV service and Cloud DVR platform using:
• Amazon Aurora
• Amazon ElastiCache
• Amazon CloudFront
• Amazon S3

Result:
AWS open source-compatible database services enabled
the necessary scale for live video ingest, storage, and
delivery of content streams

© 2020, Amazon Web Services, Inc. or its Affiliates.


Security group Security group

M
Metadata Store,
Amazon ElastiCache temporary RDS Aurora
EC2 Instances for Redis MySQL Master

Replicated
storage

s
Amazon ElastiCache Metadata Store, RDS Aurora MySQL
EC2 Instances for Redis temporary Read Replica

© 2020, Amazon Web Services, Inc. or its Affiliates.


Managed open source and OS-
compatible database services from
AWS

© 2020, Amazon Web Services, Inc. or its Affiliates.


Fully managed open source and OS-compatible
database services

Amazon Amazon Amazon


Amazon Amazon ElastiCache Keyspaces
Aurora DocumentDB
RDS (for Apache
Cassandra)

Relational databases Non-relational databases

PostgreSQL

© 2020, Amazon Web Services, Inc. or its Affiliates.


Move to managed relational databases
Migrate on-premises or self-managed relational databases to open source and open
source-compatible managed database services
Migrate without the need to re-architect existing applications
Reduce DB administrative burden
Get better performance, availability, scalability, and security

Amazon Aurora
MySQL, PostgreSQL

PostgreSQL

Amazon RDS
MySQL, PostgreSQL, MariaDB

© 2020, Amazon Web Services, Inc. or its Affiliates.


Amazon Aurora
MySQL and PostgreSQL-compatible relational database built for the cloud
Performance and availability of commercial-grade databases at 1/10th the cost

Performance Availability
Highly secure Fully managed
and scalability and durability

5x throughput of standard Fault-tolerant, self-healing Network isolation, Managed by RDS:


MySQL and 3x of standard storage; six copies of data encryption at No server provisioning, software
PostgreSQL; scale-out up to across three Availability Zones; rest/transit, compliance patching, setup, configuration, or
15 read replicas continuous backup to Amazon S3 and assurance programs backups

Source: https://aws.amazon.com/rds/aurora/

© 2020, Amazon Web Services, Inc. or its Affiliates.


Amazon RDS
Managed relational database service with a choice of popular open source database
engines
Amazon
Aurora PostgreSQL

Easy to administer Performant & scalable Available & durable Secure and compliant

Easily deploy and maintain Scale compute Automatic Multi-AZ data Data encryption at rest and
hardware, OS and DB and storage with a few replication; automated in transit; industry
software; built-in monitoring clicks; minimal downtime for backup, snapshots, and compliance and assurance
your application failover programs

© 2020, Amazon Web Services, Inc. or its Affiliates.


A leading provider of financial management software for
consumers, small businesses, and accounting
professionals

Challenge:
Their data center lease was up. They needed a solution
before the tax season to cut cost and scale more

Solution:
Used AWS Database Migration Service (DMS) to move
on-premises MySQL to Amazon Aurora

Result:
With a managed solution like Aurora, the benefits go
beyond just cost savings: 80% less time spent on
maintenance, more encryption of data at rest, and
automatic growth of storage up to 64TB

© 2020, Amazon Web Services, Inc. or its Affiliates.


Moving on-premises MySQL
to Amazon Aurora
Data center—West

RDS DB
INSTANCE

Replication

Application server GIPHY API


SERVICES
RDS DB
INSTANCE STANDBY

© 2020, Amazon Web Services, Inc. or its Affiliates.


Move to managed non-relational databases
Migrate on-premises or self-managed non-relational databases to managed services
Migrate without the need to re-architect existing applications
Reduce DB administrative burden
Get better performance, availability, scalability, and security

Amazon DocumentDB
MongoDB

Amazon Keyspaces
(for Apache Cassandra)

Amazon ElastiCache
Redis, Memcached

© 2020, Amazon Web Services, Inc. or its Affiliates.


Amazon DocumentDB
Fast, scalable, highly available, fully managed MongoDB-compatible
database service

Millions of requests per second, Same code, drivers, and tools you Simple and
millisecond latency use with MongoDB fully managed

Secure and 2x throughput of managed Deeply integrated


compliant MongoDB services with AWS services

© 2020, Amazon Web Services, Inc. or its Affiliates.


Amazon Keyspaces (for Apache Cassandra)
Scalable, highly available, and managed Cassandra-compatible database service

Apache Single-digit millisecond


No servers to manage Simple migration
Cassandra-compatible performance at scale

Use the same application code, No need to provision, configure, Single-digit millisecond Simple migration to Amazon
licensed drivers, and tools and operate large Cassandra performance Keyspaces for Cassandra
built on Cassandra clusters or add and remove databases on premises or on
nodes manually Scale tables up and down EC2
automatically based on
application traffic
Virtually unlimited
throughput and storage

© 2020, Amazon Web Services, Inc. or its Affiliates.


Amazon ElastiCache
Fully managed in-memory data store, compatible with Redis or Memcached. Power
real-time applications with sub-millisecond latency.

Fully compatible with In-memory data store AWS manages all Scale writes and
open source Redis and cache for hardware and software reads with sharding
and Memcached microsecond setup, configuration, and replicas
response times monitoring

© 2020, Amazon Web Services, Inc. or its Affiliates.


Challenge:

Solution:
They moved from self managed Redis to fully managed
Amazon ElastiCache for Redis as a caching layer on RDS
for MySQL

Result:
ElastiCache provides sub-millisecond latency even in
times of peak traffic of hundreds of thousands of cab
requests per minute

Self managed
MOVE TO MANAGED → Amazon
© 2020,
RedisAmazon Web Services, Inc. or its Affiliates. ElastiCache for Redis
Flexible ways to deploy open source AWS
databases

© 2020, Amazon Web Services, Inc. or its Affiliates.


Migration Tools
AWS Database Migration Service (DMS)
DMS easily and securely migrates and/or replicate your databases and data
warehouses to AWS

Schema Conversion Tool (SCT)


SCT converts your commercial database and data warehouse schemas to open-
source engines or AWS-native services, such as Amazon Aurora and Redshift

© 2020, Amazon Web Services, Inc. or its Affiliates.


Migrate with AWS ProServe
and Partners

© 2020, Amazon Web Services, Inc. or its Affiliates.


AWS Database Migration Partners
Database Data Warehouse

License Advisory

© 2020, Amazon Web Services, Inc. or its Affiliates.


Demo

© 2020, Amazon Web Services, Inc. or its Affiliates.


AWS Training and Certification

Explore tailored Data Build cloud skills with Demonstrate expertise


or Database learning free digital Data training with a Data industry-
paths for customers courses such as “The recognized credential
and partners elements of Data (Data analytics and
Science”, or dive deep Database Specialty AWS
with classroom training Certifications)

aws.amazon.com/training/

© 2020, Amazon Web Services, Inc. or its Affiliates.


Visit the Data, Databases, and Analytics
Resource Hub for more resources
Dive deeper with these newly created whitepapers and e-books
to help you uncover new insights and value from your data

• An introduction to cloud databases


• Enter the purpose-built database era
• Harness the power of data
• Creating a modern analytics architecture
• The data-driven enterprise https://tinyurl.com/
• … and more! aws-data-databases-analytics

Visit resource hub »

© 2020, Amazon Web Services, Inc. or its Affiliates.


Thank you for attending
AWS Data, Databases, and Analytics Online Series
We hope you found it interesting! A kind reminder to complete the survey.
Let us know what you thought of today’s event and how we can improve the event
experience for you in the future.

aws-apac-marketing@amazon.com
twitter.com/AWSCloud
facebook.com/AmazonWebServices
youtube.com/user/AmazonWebServices
slideshare.net/AmazonWebServices
twitch.tv/aws

© 2020, Amazon Web Services, Inc. or its Affiliates.

You might also like