Spark - Build Memory Config Calculator in Tamil
Spark - Build Memory Config Calculator in Tamil
English Video -
Code -
Spark Executor Memory: The amount of memory allocated to each executor in Spark, used for storing data and performing computations.
Spark Driver Memory: The amount of memory allocated to the Spark driver, responsible for the overall coordination of the application, including task scheduling.
Spark Cores: The number of CPU cores allocated to each executor, which determines the number of tasks an executor can run in parallel.
Number of Executors: The total number of executors in a Spark application, determining the parallelism level across the cluster.
YARN Memory Overhead: Extra memory allocated on top of the executor memory for YARN to handle resource management, including JVM overhead, caches, and thread stacks.
Email: atozknowledge.com
LinkedIn :
Instagram:
YouTube channel link
www.youtube.com/
Website
Technology in Tamil & English
Watch video Spark - Build Memory Config Calculator in Tamil online without registration, duration 07 minute 37 second in high hd quality. This video was added by user Data Engineering 14 August 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 87 once and liked it 3 people.