Udemy – Spark and Python for Big Data with PySpark 2019-9

Description

“Spark and Python for Big Data with PySpark” is the name of a training course on Udemy that teaches how to use Spark and Python in metropolitan areas. In this course, you will also learn about PySpark and Spark Streaming and get a good understanding of machine learning topics. One of the most valuable technologies in the field of technology is the ability to analyze large amounts of data. This course attempts to introduce you to one of the best technologies in the field, namely Apache Spark.

Apache Spark is an open source framework and distributed system that many large companies such as Google, Facebook, Amazon and NASA use to solve big data problems. This framework can provide up to 100 times better performance than Hadoop MapReduce and fully meet your needs. In this course, you will fully understand Spark and learn how to use the Python language in macro data.

Courses taught in this course:

Use Spark and Python to analyze big data
Use Spark 2.0 DataFrame syntax
Participation in consulting projects
Use Spark with Random Forests for classification
Use a reinforcing gradient tree
Use MLlib to build machine learning models

Spark and Python specifications for Big Data with PySpark:

English language
Duration: 10 hours and 35 minutes
Number of lessons: 66
Education level: Medium
Teacher: Jose Portilla
File format: mp4

Course topics

66 lectures 10:35:05

Introduction to the course
4 lectures 30:12

Setting up Python with Spark
2 lectures 06:11

Local VirtualBox setup
3 lectures 31:09

AWS EC2 PySpark setup
4 lectures 38:58

Set up Databricks
1 lecture 11:41

AWS EMR cluster setup
1 lecture 17:16

Python crash course
7 lectures 58:50

Spark DataFrame basics
7 lectures 01:04:52

Spark DataFrame Project Exercise
2 lectures 20:06

Introduction to machine learning with MLlib
2 lectures 7:25 p.m

Linear regression
6 lectures 01:00:03

Logistic regression
5 lectures 01:00:02

Decision trees and random forests
5 lectures 52:26

K-means clustering
5 lectures 41:20

Collaborative filtering for recommendation systems
2 lectures 6:39 p.m

Natural Language Processing
4 lectures 46:26

Spark streaming with Python
5 lectures 57:18

bonus
1 lecture 00:10

Course requirements

General programming knowledge in any language (preferably Python)
20 GB of free storage on your local computer (or alternatively a strong internet connection for AWS)