Free DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Web TestEngine Demo

Exit VCEDump DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Databricks Certified Associate Developer for Apache Spark

Q13 Single choice

A data engineer is running a Spark job to process a dataset of 1 TB stored in distributed storage. The cluster has 10 nodes, each with 16 CPUs. Spark UI shows:

Low number of Active Tasks

Many tasks complete in milliseconds

Fewer tasks than available CPUs

Which approach should be used to adjust the partitioning for optimal resource allocation?

A
Set the number of partitions equal to the total number of CPUs in the cluster
B
Set the number of partitions to a fixed value, such as 200
C
Set the number of partitions equal to the number of nodes in the cluster
D
Set the number of partitions by dividing the dataset size (1 TB) by a reasonable partition size, such as
128 MB

Previous Check answer

Question map13 / 82

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82

Current Correct Answered Incorrectly Reviewed 0 Remaining 82

Marked Questions0

No marked questions.

Answered Incorrectly0

No incorrect answers.

DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Web TestEngine demo