Storage Services

•     AMI

•     Instance Store Volume

•     S3

•     Glacier

•     EBS

•     EFS

•     FSx :

•     Storage Gateway

•     Snowball • Datasync

https://aws.amazon.com/products/storage/

AMI

•    Includes OS/env/application server/application

•    Instance store-backed AMI : backup from S3

•    EBS-backed AMI

•    Instance Root device • Instance Root Volume:

•    Booting image

•    OS/env/application server

•    custom application • Block device mapping

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ComponentsAMIs.html

https://medium.com/awesome-cloud/aws-difference-between-ebs-and-instance-store-f030c4407387

Instance Store / EBS

•    Direct connected block device storage to EC2

•    Ephemeral

•    Instance Stop Not supported

•    Local Storage

•    No Snapshopt

•    No Persistent

•    SSD, HDD

https://aws.amazon.com/ko/premiumsupport/knowledge-center/instance-store-vs-ebs/

EBS-backed

https://aws.amazon.com/ko/premiumsupport/knowledge-center/create-ami-ebs-backed/

Instance Store-backed

 

hvm vs paravirtual

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/virtualization_types.html

File/Block/Object Storage

•                    File

•                    FAT32, LFS, NFS

•                    path, metadata

•                    hierarchical. linkedlist

•                    Scale : adding system

•                    Block :

•                    SAN

•                    Devide by block

•                    Map

•                    Data : distributed by block • Object :

•                    AWS S3

https://ubuntu.com/blog/what-are-the-different-types-of-storage-block-object-and-file/

S3

•     2006 Launched

•     11 9s availability

•     Region Service

•     3 tier backup / at least 3+ AZ

•     Namespace + Block Storage

•     Encryption Supported

•     CloudFront

•     Data Repository For DataLake

•     Object : Data + Metadata

•     Write Once Read Many

•     Versionining

https://aws.amazon.com/s3/ https://aws.amazon.com/s3/features

S3 Concept

•    Global unique • Bucket +  Object Name( key )

•    Region only, Cross-region replication

•    API access

•    Eventually consistent

•    Partition by Prefix

•    Hex hash prefix

https://www.slideshare.net/AmazonWebServices/amazon-s3-masterclass

S3 Storage Class

•     S3 Standard

•     S3 Intelligent Tiering • Automated realloation

•     S3 Standard Infrequency Access

•     Lifecycle rule management • S3 One Zone Infrequent Access • One zone :

•     S3 Reduced Redundancy Storage • deprecated

•     S3 Glacier

•     Lifecycle Rule Management

•     Operated by S3 lifecycle, CLI, S3 console, SDK

https://aws.amazon.com/ko/s3/storage-classes/ https://blog.bespinglobal.com/post/aws-amazon-s3-life-cycle-rule/

S3 Glacier

•    Storage Limit : 40TB

•    Default : encrypted

•    S3 Glacier Instant Retrieval • Millisecond retrieval

•    S3 Glacier Flexible Retrieval

•    Min to 12 hours retrieval

•    S3 Glacier Deep Archive • 12-48 hours retrieval

•    Vault : directory

•    Archive : stored data unit

https://docs.aws.amazon.com/ko_kr/amazonglacier/latest/dev/introduction.html

•    Tape backup = 3 tier

EBS

•     Persistent Storage

•     One AZ Available

•     Block Storage

•     99.999 Availability

•     Encryption Supported

•     SDD, HDD

•     SSD

•     General Purpose, Provisioned IOPS : gp3, gp2 ( 100-10,000 IOPS)

•     HDD

•     Throughput optimized, cold hdd

https://aws.amazon.com/ko/ebs/volume-types/

EFS

•    Network shared

•    Standard OS interface

•    Region VPC service

•    Mount target

•    VPC NFS v4 end point

•    Storage class

•    Standard

•    Infrequent Access

https://docs.aws.amazon.com/ko_kr/efs/latest/ug/whatisefs.html https://docs.aws.amazon.com/efs/latest/ug/storage-classes.html

Amazon FSx

•    FSx

•    3rd party rich-feature, high performance / Lustre, Window FSx

•    FSx for Lustre • 100G +

•    FSx for Window File server • Support Active Directory

https://docs.aws.amazon.com/ko_kr/fsx/latest/WindowsGuide/what-is.html

Storage Gateway

•    Connect on-premises storage to aws cloud storage

•    File Gateway

•    Volume Gateway

•    Tape Gateway

https://blog.bespinglobal.com/post/aws-storage-gateway-%EC%9D%B4%ED%95%B4%ED%95%98%EA%B8%B0/ https://ltlkodae.tistory.com/21

Snowball

•    Snowball

•    21kg, 50TB, 80TB, external encrypted external storage

•    Snowball Edge

•    Snowball + computing

•    Snowball Mobile

•    Network Attached Data Store

https://docs.aws.amazon.com/snowball/latest/ug/device-differences.html

DataSync

•    Sync between

•    on-premises and cloud

•    cloud and cloud

•    Copy between file systems

•    Connect to S3, EFS, FSx

https://www.slideshare.net/AmazonWebServices/amazon-s3-masterclass

QnA

AWS Solutions Architect

                                                                                                                                                                              

    Colin Kang

EC2 Launch

•    AMI : OS / architecture (x86/Arm)

•    Instance Type : t2.micro ( 1vcpu/1GB ) – x2iden.32xlarge (

128vcpu/4098GB)

•    Keypair

•    Network : VPC/subnet/securitygroup

•    Storage : root + new

•    Advanced

•    IAM/PlacementGroup/Tenancy (shared/dedicated)/Tag

https://docs.aws.amazon.com/efs/latest/ug/gs-step-one-create-ec2-resources.html/

EC2 Launch with Template

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-launch-templates.html/

EC2 AMI

 

Amazon Machine Image

•    Quick Start AMI : Linux/Mac..

•    Marketplace AMI

•    Vendor provide

•    Community AMI

•    Private AMI

•    User defined

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AMIs.html

EC2 Instance ( vcpu/mem/bandwidh

•    Geneal Purpose : T3, T2, T5, M6, M5, M4, M3

•    Compute Optimize : C5, C4, C3

•    Memory Optimze : X1e, X1, R4, R3

•    Accelerated Computing : GPU : P3, P2, G3, F1

•    Storage Optimized : H1, I3, D2

•    HPC Optimized : High Performance Compuing : Hpc6id, Hpc6a

https://aws.amazon.com/ec2/instance-types/

Network

 

VPC : • Isolated Network

•    Subnet :

•    VPC sub network

https://en.wikipedia.org/wiki/CAP_theorem

https://www.geeksforgeeks.org/difference-between-shared-nothing-architecture-and-shared-disk-architecture/

PlacementGroup

•    Default : distributed

•    Placement group : interdependent instances

•    Cluster : packs instances close together inside an Availability Zone

•    Partition : spreads one partition do not share the underlying hardware, eg Hadoop

•    Spread : strictly places distinct underlying hardward

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/placement-groups.html

Storage

 

EBS volume : SSD, HDD / IOPS

•     Attach multiple EBS storage volume

•     snapshot

•     Instance Store Volume :

•     Ephemeral

•     Speed : Instance Store Volume > EBS

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Storage.html/

Security

 

VPC ACL

•    SecurityGroup

•    IAM role

•    Keypare

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-security.html https://aws.amazon.com/blogs/security/category/compute/amazon-ec2/page/2/

https://aws.amazon.com/blogs/security/how-to-help-prepare-for-ddos-attacks-by-reducing-your-attack-surface/

Auto Scale

 

Launch Configuration

•    Launch Template

https://docs.aws.amazon.com/autoscaling/ec2/userguide/what-is-amazon-ec2-auto-scaling.html

QnA