Spark for Developers
Are you a developer looking to master the highest-performing distributed processing framework? From theoretical foundations to cloud deployment, build hands-on expertise in Apache Spark.
What you'll learn
Understand Spark fundamentals
Master Spark's distributed architecture, partitioning, lineage, and the framework's philosophy to write high-performing code from the start.
Develop and test Spark applications
Work with RDDs, DataFrames and advanced operations (UDF, UDAF, window functions), and set up a complete testing strategy.
Optimize and deploy to production
Understand Spark's inner workings (caching, shuffle, memory), optimize performance, and deploy Spark jobs to the cloud.
The detailed programme
Seven progressive modules to go from discovering Spark to cloud deployment, mastering distributed processing end to end.
Discovering Spark
3h30
Big Data, distributed systems and first steps with Spark: build your first application and understand the foundational concepts.
Objectives
- Understand horizontal scaling, distributed systems and the MapReduce paradigm
- Master Spark's core concepts: partitioning, lineage, optimization and parallelization
- Build a Spark application and choose between RDD, Dataset and DataFrame
What's covered
- Vertical and horizontal scaling, distributed systems, the MapReduce paradigm
- Partitioning, lineage, optimization and parallelization in Spark
- Batch, Streaming and ML: building a Spark application
- RDD, Dataset, DataFrame: when to use what
- Parquet format and storage systems
Your experts
Training investment
1 500,00 €
per participant
9 000,00 €
per session
Fund your training through an OPCO
As a Qualiopi-certified training provider, the courses we offer can be funded through an OPCO (the French vocational-training funding body). Find which OPCO you depend on here.
Let's discuss your project
Personalised quotes, tailor-made formats, OPCO funding options: we answer all your questions.
Request a quote