Where and how do I store data?

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storing via API or file system protocols

API

Amazon S3 Bucket

File System Protocol

File Gateway Amazon S3 Bucket

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Builders Online Series

Give unlimited scale storage to your application

with Amazon S3 and File Gateway

Kumar Nachiketa
Storage Specialty Solutions Architect,
Amazon Web Services
Agenda
• React application with Amazon S3 and AWS Amplify

• Ingest data to Amazon S3 via File Gateway and query with Amazon Athena

• Demo

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage components for focus today

OBJECT Hybrid Volume

gateway

Tape
gateway
Amazon AWS Storage
S3 Gateway

File
gateway

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“Amazon Simple Storage Service (S3) is storage
for the Internet. It is designed to make web-scale
computing easier for developers.”

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Bucket Objects

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Object (Data + Metadata)
Metadata example
Last-Modified
Content-MD5
x-amz-server-side-encryption
x-amz-version-id
.
.

Tags example (Key: Value)

Category: Places
Camera: Canon-80D
Resolution: 1920x1020
.
.
/photos/city.jpg

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key terms of Amazon S3

Region

https://mybucket.s3.us-west-2.amazonaws.com/photos/city.jpg
Bucket Key
(Prefix + file name)

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Amazon S3 storage classes

S3 Intelligent- S3 Glacier
S3 Standard S3 Standard-IA S3 One Zone-IA S3 Glacier
Tiering Deep Archive

Frequent Access frequency Archive

• Active, frequently • Data with changing • Infrequently • Re-creatable, less • Archive data • Long-term archive data
accessed data access patterns accessed data accessed data • Select minutes or hours • Select hours
• Milliseconds access • Milliseconds access • Milliseconds access • Milliseconds access • > 3 AZ • > 3 AZ
• > 3 AZ • > 3 AZ • > 3 AZ • 1 AZ • $5.12/ TB • $2.05/TB
• $25.6/TB • $20.48 to $25.6/TB • $20.48/TB • $16.38 / TB • Retrieval fee per GB • Retrieval fee per GB
• Monitoring fee per • Retrieval fee per GB • Retrieval fee per GB • Min storage duration • Min storage duration
object • Min storage duration • Min storage duration • Min object size • Min object size
• Min storage duration • Min object size • Min object size

*Based on Singapore region price

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pattern 1: Develop modern app using Amazon S3 API

API

Amazon S3 Bucket

File System Protocol

File Gateway Amazon S3 Bucket

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
React application: Photo album
AWS Cloud

Object
PUT, GET,
LIST

Amazon
S3 Bucket

Sign in page AWS

Amplify
React web Sign in,
application access ID,
tokens

Amazon
Cognito

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
React application: Photo album

Software on your system needed Demo steps:

1. Build a react app
2. Initialize local app
3. Add authentication service
4. Add storage

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pattern 2: Access S3 via File Gateway

API

Amazon S3 Bucket

File System Protocol

File Gateway Amazon S3 Bucket

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway
Store and access objects in Amazon S3 from file-based applications with local caching

On-premises AWS Cloud

✓ S3 Standard
✓ S3 Standard - IA
✓ S3 One Zone - IA

NFS & SMB HTTPS S3 lifecycle

Application File Gateway ✓ S3 Glacier

Appliance
✓ S3 Glacier Deep Archive

Supports SMB and NFS protocols – no application changes

Fully managed cache provides low latency access to data
Active Directory and Windows ACL support provides access controls

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo: Ingest data from a Linux server, ad-hoc query
using Amazon Athena

AWS Cloud AWS Cloud

Ad-hoc query on
ingested files

NFS

Linux EC2 File Gateway Amazon S3 Amazon

Instance bucket Athena

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway demo requirements and steps

Demo Steps
Software on your system needed 1. Create and activate File Gateway

2. Create share and mount on Linux

EC2 instance
3. Ingest CSV file

4. Query with Amazon Athena

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Next steps and takeaways
1. Amazon S3 for the modern application

2. File Gateway for the applications need file-system level access

3. Use data in Amazon S3 for analytics and machine learning

4. Start today ☺

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Digital Training
Featured Courses
• AWS Cloud Practitioner Essentials (Second Edition)
Learn the fundamentals of the AWS Cloud and prepare for the AWS
Certified Cloud Practitioner exam.
• Amazon DynamoDB for Serverless Architectures
An introduction to Amazon DynamoDB and how it’s leveraged in
building a serverless architecture.
• AWS Security Fundamentals
Learn fundamental cloud computing and AWS security concepts,
including AWS access control and management, governance, logging,
Build cloud skills with and encryption methods.
550+ free digital training • Getting Started with Amazon Simple Storage Service (Amazon S3)
courses, or dive deep The course provides you with the knowledge to determine when to use
with classroom training Amazon S3 by reviewing typical use cases and understanding how the
service provides object storage for your applications.

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. aws.amazon.com/training
Thank you for attending AWS Builders Online Series
We hope you found it interesting! A kind reminder to complete the survey.
Let us know what you thought of today’s event and how we can improve the event
experience for you in the future.

aws-apac-marketing@amazon.com
twitter.com/AWSCloud

facebook.com/AmazonWebServices
youtube.com/user/AmazonWebServices

slideshare.net/AmazonWebServices
twitch.tv/aws

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Builders Online Series

Thank you

Kumar Nachiketa
Storage Specialty Solutions Architect,
Amazon Web Services