AWS Platform at a Glance

AWS Platform at a Glance

1)  AWS - S3


What is S3

S3 provides developers and IT teams with secure, durable, highly-scalable object storage.  Amazon S3 is easy to use, with a simple web services interface to store and retrieve any amount of data from anywhere on the web.

Highly scalable.

S3 is a safe place to store the files.  As it is object-based storage - can store, images, photos, videos and can easily spread across multiple servers.

Basics of S3 :

1)  S3 is object based - i.e.  allows to  upload files.
2)  Files can be from 0 Bytes to 5 TB.
3)  There is unlimited storage.
4)  Files are stored in Buckets.
5)  S3 is a universal namespace.  That is, names must be unique globally.
6)   eg:  https://s3dev-india-south-1.amazonaws.com/devendradev
             India-south region -               
7)  When you upload a file to S3, you will receive a HTTP 200 code if the upload was successful.


Data Consistency Model for S3

-> Read after write consistency for PUTS of new objects.
-> Eventual Consistency for overwrite PUTS and DELETES(Can take some time to propagate).
-> S3 is A Simple Key-value Store
-> S3 is Object based.  Objects consist of the following:
       Key(This is simply the name of the object)
       Value(This is simply the data and is made up of sequence of bytes).
       Version ID(Important for versioning)
       Metadata(Data about data you are storing).
       Subresources :
                    Access Control Lists
                    Torrent.
->  Built for 99.99% availability for the S3 platform.
->  Amazon Guarantee 99.9 % availability.
--> Amazon guarantees 99.999999% durability for s3 information.(Remember 11 x 9s).
->  Tiered Storage Available.
-->  Lifecycle Management.
-->  Versioning.
-->  Different types of encryption available.
-->  Secure your data using Access Control Lists and bucket Policies.

S3 - Storage Tiers/Classes. :

a)  S3 Standard -  99.99 % availability, 99.9999999%durability, stored redundantly across multiple
                             devices in multiple facilities, and is designed to sustain the loss of 2 facilities
                             concurrently.

b)  S3 - IA  : ( Infrequently Accessed ) : For data  that is accessed less frequently, but requires rapid
                       access when needed.  Lowe fee than S3, but you are charged a retrieval fee.
c)  S3 One zone - IA :  Want a lower-cost option for infrequently accessed data, but do not require                                           the   multiple Availability zone data resilience.
d)  S3 Glacier  :  Very cheapest one , and  Operations to do with  -  File Storage using  AWS - S3
                            Glacier, as saving distributed data is always challenging,  AWS - Glacier  is                                           Secure, durable and extremely low cost cloud storage for data recording and long
                             term storage purpose.


       . Uploading files to S3
       .  Retrieving
       .  Automating maintenance.
       .  Archiving and restoring
      .   Versioning Objects & cross region replication.

        Key features of AWS Glacier involves


                   Scalable                           -  Grows with your needs.
                   Durability                        -  Multiple copies in multiple facilities.
                   Secure                             -  Non-optional AES 256 encryption.
                   Cost effective                 -  $0.01/GB/month on average
                   Asynchronous                 - 3 to 5 hours latency for retrieval.


Two ways to store data in Glacier:

                  1)  By creating Glacier Vaults -
                  2)  By using  Life cycle policies.

Now  it's matter  of  prices/charges :

It's being charged for below :

a)  Storage  ( per gig basis)

b)  Request  ( 1000 reqs per minute)

c)  Storage Management Pricing  -  When you upload a file to S3 – it’s matter  of tags.

      For each tag price will vary

d)  Data Transfer Pricing   -  From  one region to another region.

e)  Transfer Acceleration   -

              Amazon  S3 Transfer Acceleration enables fast, easy, and secure transfers of files over long distances between your end users and an S3 bucket.

              Transfer Acceleration takes advantage of  Amazon CloudFront’s globally distributed edge locations.  As the data arrives at an edge location, data is routed to Amazon S3 over an optimized network path.

            Eg:

  If S3 bucket is in London, and user uploading directly  from H location ( near USA), then Amazon S3 will be accelerate the uploaded one from H location across all locations in World.

# Terms -  # Key words -   topic wise

Security:

Identity Access Management (IAM)

Storage: 

S3, 
Glacier, 
Snowball, 
Storage Gateway, 
S3 Transfer Acceleration


Compute: 

EC2, 
Lambda, 
Elastic Beanstalk

Database: 
RDS, 
DynamoDB, 
ElastiCache, 
Redshift

Networking: 

VPC, 
CloudFront, 
Route 53, 
API Gateway

Application Services: 
Simple Notification Service (SNS), 
Simple Queue Service (SQS), 
Elastic Transcoder, 
Kinesis