Free DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Web TestEngine Demo

Q3 Single choice

A data engineer is working on a Spark job that reads data from a large text file, applies a filter to remove invalid records, and then groups the data by a specific column. After writing the results in a table, the engineer wants to understand the execution pattern of the Spark job to optimize its performance.

What is the sequence of operations in the Spark job?

A
The Spark job reads the entire text file into memory, applies the filter, and then groups the data by the specified column.
B
The Spark job reads the text file, applies the filter as an action, and then groups the data by the specified column as a transformation.
C
The Spark job reads the text file lazily, applies the filter and grouping as a single transformation, and then executes the entire pipeline as an action.
D
The Spark job reads the text file lazily, applies the filter as a narrow transformation, and then groups the data by the specified column as a wide transformation, causing a shuffle.

DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Web TestEngine demo