Skip to main content
DatabricksPySparkSnowflakeApache Airflow
🟢 Beginner Learning Path

PySpark Beginner

Learn PySpark from absolute basics through carefully designed real engineering challenges.

100

Problems

10 XP

Each Challenge

Easy

Difficulty
PySpark Beginner

PySpark Beginner

Progress

12%
✓DataFrame Basics
◐Select
○Filter
○withColumn
○Sort
○Distinct
○Group By
○Join
○Window Functions
100 Challenges
1000 XP
▶

DataFrame Basics

Learn how Spark creates, reads and manages DataFrames.

4 Challenges40 XP
▶
PY-001:Load Employee Master Dataset•Easy•⭐ 10 XP
Start Challenge →
▶

DataFrame Transformation

Transform DataFrames using filtering and projection operations.

3 Challenges30 XP
▶
PY-002:Filter Employees by Department•Easy•⭐ 10 XP
Start Challenge →
▶
PY-005:Remove Unnecessary Columns•Easy•⭐ 10 XP
Start Challenge →
▶

Select

Retrieve only the columns required for analysis.

3 Challenges30 XP
▶
PY-003:Select Specific Columns•Easy•⭐ 10 XP
Start Challenge →
▶

withColumn

Create and transform DataFrame columns.

4 Challenges40 XP
▶
PY-004:Calculate Salary Increase•Easy•⭐ 10 XP
Start Challenge →
▶

Filter

Filter rows using one or more conditions.

3 Challenges30 XP
▶
PY-006:Find High-Earning Employees•Easy•⭐ 10 XP
Start Challenge →
▶

Sort

Sort records using one or multiple columns.

2 Challenges20 XP
▶
PY-007:Sort Employees by Salary•Easy•⭐ 10 XP
Start Challenge →
▶

Distinct

Remove duplicate records efficiently.

2 Challenges20 XP
▶
PY-008:Remove Duplicate Employee Records•Easy•⭐ 10 XP
Start Challenge →
▶

GroupBy

Aggregate data using grouping operations.

5 Challenges50 XP
▶
PY-009:Calculate Department Salary Statistics•Medium•⭐ 20 XP
Start Challenge →
▶

Window Functions

Calculate ranking, rolling, and partitioned analytics.

2 Challenges50 XP
▶
PY-010:Top Employees by Department•Medium•⭐ 20 XP
Start Challenge →