10-AWS | Application Integration

Application Integration

Process and Migrate Data

Kinesis

  • Collect, process, and analyze data streams in real time.
  • Features
    • K data Stream
      • Real-time data capture –> Collect streaming data with a data stream
    • K Data Firehose
      • Process and deliver streaming data with data delivery stream.
      • Load streaming data into data lakes, data stores, and analytics tools for:
    • K Data Analytics
      • Get insights in real time –> Analyze streaming data with data analytics application.

Amazon Elastic MapReduce(EMR)

  • Managed Hadoop Framework
  • Easily run and scale Apache Spark, Hive, Presto, and other big data workloads

Amazon Athena

  • Amazon Athena is an interactive query service that makes it easy to analyze data directly in Amazon S3 using standard SQL

AWS Glue

  • AWS Glue is a fully managed ETL (extract, transform, and load) service that makes it simple and cost-effective to categorize your data, clean it, enrich it, and move it reliably between various data stores and data streams.

AWS Database Migration Service(DMS)

  • The quickest and easiest way to migrate databases to AWS with low cost and minimal downtime.
  • Fee
    • AWS Database Migration Service (DMS) offers free use for 6 months per instance
    • if you’re migrating to Amazon Aurora, Amazon Redshift or Amazon DynamoDB.

Security, Identity, and Compliance

  • Compliances
    • FIPS –> Pederal Information Processing standard publication
    • PCIDSS –> Payment Card Industry Data Security Standard
    • HIPAA –> Health Insurance Portability and Accountability Act
    • SOX –> Sarbames Oxley Act
  • Security
    • IAM, Keys, WAF, docs
  • AWS Key Managememt Service(AWS KMS)
    • Customer Managed Keys –> View and Manage
    • AWS Managed Keys –> View Only
    • AWS owned keys –> None
  • AWS CloudHSM

WAF & Shield

  • AWS WAF
    • Web Application Firewall that helps protect web applications from attacks
  • AWS Shield
    • Managed DDoS protection service.
    • AWS Shield offers two tiers of protection - Standard and Advanced
  • AWS Firewall Manager
    • Centralized security management

Active Directory

  • Directory Service Solutions for Microsoft Active Directory
  • Migrate from Microsoft Active Directory (AD) to AWS by
    • AWS Managed Microsoft AD
      • Used managed actual Microsoft Active Directory in the AWS Cloud
    • Simple AD
      • Simple AD is a standalone managed directory that is powered by a Linux-Samba Active Directory compatible server.
    • AD Connector
      • AD Connector is a proxy for redirecting directory requests to your existing Microsoft Active Directory without caching any information in the cloud
    • Amazon Cognito User pools

Cognito

  • Amazon Cognito offers user pools and identity pools.
  • User pools are user directories that provide sign-up and sign-in options for your app users.
  • Identity pools provide AWS credentials to grant your users access to other AWS services.

AWS Single Sign-on(SSO)

  • It a cloud-based single sign-on (SSO) service that makes it easy to centrally manage SSO access to all of your AWS accounts and cloud applications

AWS Serverless

AWS Serverless

AWS Serverless

AWS Lambda

Run functions on demand without the server.

AWS Lambda is a serverless computing service provided by AWS that lets you run code without provisioning or managing servers.

We don’t need to worry about which AWS resources to launch, or how will they manage them.

The Lambda functions can perform any kind of computing task, from serving web pages and processing streams of data to calling APIs and integrating with other AWS services.

[Read More]

02-Docker | Docker Basic

Installation, Docker Image, Container

Docker

2.1 Docker installation

# Check docker
docker version
sudo docker run hello-world
  • On Linux
    • Docker client, Docker daemon and Container runs on the same Host
  • On Window or MacOSX
    • Docker daemon cannot be run directly on Non-Linux platform natively because it user Linux specific Kernel feature
    • Need to run inside Docker-Machine
      • Install Docker Desktop
[Read More]

04-Docker | Docker-Compose

Manage multiple docker container

Docker-Compose

  • DC makes it easier to configure and run applications made up of multiple containers
  • DC is a very handy tool to quickly get docker environment up and running.
  • It uses yaml files to store the configuration of all the containers
  • We can create some containers like: web app, postgres and redis
    • and can establish an internal connection
[Read More]