Get in Touch

Course Outline

Introduction:

  • Apache Spark within the Hadoop Ecosystem
  • Brief overview of Python and Scala

Fundamentals (Theory):

  • Architecture
  • RDDs
  • Transformations and Actions
  • Stages, Tasks, and Dependencies

Hands-on Workshop: Mastering Basics in Databricks Environment:

  • RDD API Exercises
  • Basic transformation and action functions
  • PairRDDs
  • Joins
  • Caching strategies
  • DataFrame API Exercises
  • SparkSQL
  • DataFrame operations: select, filter, group, and sort
  • UDFs (User Defined Functions)
  • Exploring the Dataset API
  • Streaming capabilities

Hands-on Workshop: Deployment in AWS Environment:

  • AWS Glue fundamentals
  • Differences between AWS EMR and AWS Glue
  • Sample jobs on both platforms
  • Pros and cons analysis

Additional Topics:

  • Introduction to Apache Airflow orchestration

Requirements

Programming skills (preferably in Python or Scala)

Foundational knowledge of SQL

 21 Hours

Number of participants


Price per participant

Testimonials (3)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories