Mastering PySpark | Learn RDD and DataFrame with Simple Examples

Author: Naveen Nelamali (SparkByExamples.com)

Buy $24.00 Free Preview

Why Choose SparkByExamples

Best Qualified Tutors
Easy Explanations
Simple Examples

Course curriculum

1. What is PySpark?
  FREE PREVIEW
2. PySpark Features & Advantages
  FREE PREVIEW
3. PySpark Architecture
  FREE PREVIEW
4. PySpark Ecosystem
5. Use Cases and Applications of PySpark
1. Install PySpark on MacOS
2. Install PySpark on Windows
3. Install Anaconda, PySpark and Jupyter Notebook
1. What is Spark Session?
2. Creating SparkSession
3. SparkSession Most Used Methods
4. What is Spark Context?
5. What does SparkContext do?
6. SparkContext Most Used Methods
7. FAQ's or Interview Questions
1. RDD - Introduction
2. RDD - Create RDD from Parallelize
3. RDD - Collect Data from RDD
4. RDD - Read Text and CSV File
  FREE PREVIEW
5. RDD - How to Parallelize RDD?
6. RDD - Transformations
  FREE PREVIEW
7. RDD - Actions
8. RDD - Word Count Example
  FREE PREVIEW
9. RDD - Repartition
10. RDD - Types of RDD
1. RDD - Cache and Persistence
2. Spark Persistence Levels
3. RDD - Broadcast Variables
4. RDD - Accumulator Variable
1. PySpark Next Steps
2. RDD Examples to Explore
1. What is DataFrame?
2. How DataFrame differ from RDD
3. Creating a DataFrame
4. DataFrame Transformations
5. DataFrame Actions
1. Select DataFrame Columns
2. Filter DataFrame Rows
3. Rename DataFrame Column
4. Add & Update Columns of DataFrame
5. Drop DataFrame Column
6. PySpark map()
7. PySpark mapPartitions()
8. PySpark flatMap()
9. PySpark Union and Union All
1. PySpark Join Types
2. Groupby and Aggregations
3. Remove Duplicate Rows
4. Pivot and Unpivot a DataFrame
1. PySpark Collect Data from DataFrame
1. String Functions
2. Date and Timestamp Functions
3. Aggregate Functions
4. Array Functions
5. Map Functions
6. Sort Functions
7. Window Functions
8. JSON Functions
1. StructType & StructField with examples
2. UDF (User Defined Functions)
3. Cache and Persist Explained
4. Creating Views & Tables
1. Working with CSV Files
2. Working with JSON Files
1. PySpark Learning Next Steps

About this course

$24.00
65 lessons

SparkByExamples Review

Clear explanation !

Rajeev Prabhakar

The PySpark Tutorial explained concepts very well along with hands-on examples !

Read Less

Well Articulated Intro

Sai BHARGAV kanisetty

Good for beginners into world of Pyspark, Pls add more courses for next levels

Read Less

Awesome introduction

Sai Lohith Gummireddy

Awesome introduction

Read Less

Nice explanatons

senthil kumar

Very good one. Thanks

Read Less

excellent

Mugambi Amos

so far,i have been finding the texts easy to learn,understand and apply

Read Less

Discover your potential, starting today

Enroll today

Mastering PySpark | Learn RDD and DataFrame with Simple Examples

Why Choose SparkByExamples

Best Qualified Tutors

Easy Explanations

Simple Examples

Course curriculum

Introduction to PySpark

Setting Up PySpark

PySpark SparkSession & SparkContext

Working with PySpark RDD

Cache, Persistence and Shared Variables

RDD Examples and Next Steps

PySpark DataFrame

DataFrame Narrow Transformations

DataFrame Wide Transformations

DataFrame Actions

PySpark SQL Functions

PySpark Advance Features

PySpark Data Source API

PySpark Learning Next Steps

About this course

SparkByExamples Review

Clear explanation !

Rajeev Prabhakar

Well Articulated Intro

Sai BHARGAV kanisetty

Awesome introduction

Sai Lohith Gummireddy

Nice explanatons

senthil kumar

excellent

Mugambi Amos

Discover your potential, starting today