Data Craft - making data pipelines trustworthy
Archive of posts with
Three biggest traps to avoid while setting Spark executor memory
What happens when you set the executor memory of a Spark worker which uses YARN as the cluster resource manager? Does it get exactly the amount of memory you requested?...
16 Dec 2019