Skip To Content
Big Data on AWS is a Program

Big Data on AWS

Self-paced

Sorry! The enrollment period is currently closed. Please check back soon.

Full program description

Big Data on AWS

Course Overview

NTUC LearningHub Course Code: AWSBD

In this course, you will learn about cloud-based Big Data solutions such as Amazon EMR, Amazon Redshift, Amazon Kinesis, and the rest of the AWS Big Data platform. We will show you how to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue. We will also teach you how to create Big Data environments, work with Amazon DynamoDB, Amazon Redshift, Amazon QuickSight, Amazon Athena, and Amazon Kinesis, and leverage best practices to design Big Data environments for security and cost-effectiveness.

Who Should Attend

This course is intended for:

  • Solutions architects
  • SysOps administrators
  • Data scientists
  • Data analysts

Course Duration

3 Day / 24 hours

Course Outline

Day 1

  • Overview of Big Data
  • Ingestion
  • Big Data streaming and Amazon Kinesis
  • Using Kinesis to stream and analyze Apache server logs
  • Storage Solutions
  • Querying Big Data using Amazon Athena
  • Using Amazon Athena to analyze log data
  • Introduction to Apache Hadoop and Amazon EMR

Day 2

  • Using Amazon Elastic MapReduce
  • Storing and Querying Data on DynamoDB
  • Hadoop Programming Frameworks
  • Processing Server Logs with Hive on Amazon EMR
  • Streamlining Your Amazon EMR Experience with Hue
  • Running Pig Scripts in Hue on Amazon EMR
  • Spark on Amazon EMR
  • Processing New York Taxi dataset using Spark on Amazon EMR

Day 3

  • Using AWS Glue to automate ETL workloads
  • Amazon Redshift and Big Data
  • Visualizing and Orchestrating Big Data
  • Visualizing
  • Managing Amazon EMR Costs
  • Securing Big Data solutions
  • Big Data Design Patterns

Course Objectives

In this course, you will learn to:

  • Fit AWS solutions inside a Big Data ecosystem
  • Leverage Apache Hadoop in the context of Amazon EMR
  • Identify the components of an Amazon EMR cluster, then launch and configure an Amazon EMR cluster
  • Use common programming frameworks available for Amazon EMR, including Hive, Pig, and streaming
  • Improve the ease of use of Amazon EMR by using Hadoop User Experience (Hue)
  • Use in-memory analytics with Apache Spark on Amazon EMR
  • Choose appropriate AWS data storage options
  • Identify the benefits of using Amazon Kinesis for near real-time Big Data processing
  • Leverage Amazon Redshift to efficiently store and analyze data
  • Comprehend and manage costs and security for a Big Data solution
  • Identify options for ingesting, transferring, and compressing data
  • Leverage Amazon Athena for ad-hoc query analytics
  • Use AWS Glue to automate extract, transform, and load (ETL) workloads
  • Use visualization software to depict data and queries using Amazon QuickSight

Pre-requisites

  • Basic familiarity with big data technologies, including Apache Hadoop, HDFS, and SQL/NoSQL querying
  • Students should complete the Big Data Technology Fundamentals web-based training or have equivalent experience
  • Working knowledge of core AWS services and public cloud implementation
  • Students should complete the AWS Essentials course or have equivalent experience
  • Basic understanding of data warehousing, relational database systems, and database design

Price

 

Before GST

With GST

Original Course Fee

S$2550.00

S$2728.50

Terms and conditions apply. NTUC LearningHub reserve the right to make changes or improvements to any of the products described in this document without prior notice.

Prices are subject to other LHUB miscellaneous fees.

AWSBD