Free DATABRICKS-CERTIFIED-PROFESSIONAL-DATA-ENGINEER Web TestEngine Demo

Q28 Single choice

A data engineer is troubleshooting a slow-running Delta Lake query on Databricks SQL involves complex joins and large datasets. They need to identify whether the root cause is related to poor data skipping, inefficient join strategies, or excessive data shuffling.

Which approach should identify the specific bottlenecks using native Databricks tools?

A
Analyze the Top Operators panel in the Query Profile to identify high-cost operations like BroadcastNestedLoopJoin
B
Check the query's execution time in the Jobs UI and correlate it with cluster resource utilization metrics.
C
Enable the EXPLAIN command to review the parsed logical plan and manually estimate shuffle sizes.
D
Use the LIMIT clause to run a subset of the query and compare execution times with the full dataset.

DATABRICKS-CERTIFIED-PROFESSIONAL-DATA-ENGINEER Web TestEngine demo