The importance of partitioning

[acs]

It is key to understand why data partitioning is needed and its implications.

There are great resources about it like:

https://medium.com/parrot-prediction/partitioning-in-apache-spark-8134ad840b0