Each configuration below is identical to the extent that each cluster has 400 GB total of RAM 160 total cores and only one Executor per VM. Given an extremely long-running job for which completion must be guaranteed, which cluster configuration will be able to guarantee completion of the job in light of one or more VM failures?
Select an option, then click Submit answer.
Reference / correct answer:
• Total VMs: 16 • 25 GB per Executor • 10 Cores / Executor
Most accepted answer: B. • Total VMs: 16 • 25 GB per Executor • 10 Cores / Executor
Community votes: B=6
Selected Answer: B Correct: B - This configuration offers the highest fault tolerance. With 16 nodes, the failure of a single VM results in only a ~6% loss of total cluster resources, minimizing the amount of data that must be recomputed and reducing the risk of job failure compared to configurations with fewer, larger nodes. upvoted 1 times
Selected Answer: B Suretly B upvoted 1 times
Selected Answer: B Total VMs = 16 Resources per VM: 25 GB RAM and 10 cores per executor. Impact of a VM Failure: Losing one VM means losing only 6.25% of the cluster’s resources. Fault Tolerance: Excellent fault tolerance. The cluster can handle multiple VM failures (up to ~3 VMs) and still function effectively. Best Balance: With smaller VMs, the job remains highly fault-tolerant while using resources efficiently. upvoted 2 times
16 core provides more redundancy, fault tolerance and more parallelism. But if dataset is huge, 8VM maybe better. The question is missing some information. upvoted 2 times
Selected Answer: B This setup ensures that the job can continue running and complete even if some VMs fail, as there are more VMs available to handle the workload upvoted 2 times