Databricks Databricks Certifications DATABRICKS-CERTIFIED-DATA-ENGINEER-ASSOCIATE Questions & Answers

• Question 21:

  A data engineering team has two tables. The first table march_transactions is a collection of all retail transactions in the month of March. The second table april_transactions is a collection of all retail transactions in the month of April. There are no duplicate records between the tables.

  Which of the following commands should be run to create a new table all_transactions that contains all records from march_transactions and april_transactions without duplicate records?

  A. CREATE TABLE all_transactions AS SELECT * FROM march_transactions INNER JOIN SELECT * FROM april_transactions;

  B. CREATE TABLE all_transactions AS SELECT * FROM march_transactions UNION SELECT * FROM april_transactions;

  C. CREATE TABLE all_transactions AS SELECT * FROM march_transactions OUTER JOIN SELECT * FROM april_transactions;

  D. CREATE TABLE all_transactions AS SELECT * FROM march_transactions INTERSECT SELECT * from april_transactions;

  E. CREATE TABLE all_transactions AS SELECT * FROM march_transactions MERGE SELECT * FROM april_transactions;

  Correct Answer: B

  Explanation: To create a new table all_transactions that contains all records from march_transactions and april_transactions without duplicate records, you should use the UNION operator, as shown in option B. This operator combines the result sets of the two tables while automatically removing duplicate records.

• Question 22:

  Which of the following approaches should be used to send the Databricks Job owner an email in the case that the Job fails?

  A. Manually programming in an alert system in each cell of the Notebook

  B. Setting up an Alert in the Job page

  C. Setting up an Alert in the Notebook

  D. There is no way to notify the Job owner in the case of Job failure

  E. MLflow Model Registry Webhooks

  Correct Answer: B

  Explanation: https://docs.databricks.com/en/workflows/jobs/job-notifications.html

• Question 23:

  A data engineer has created a new database using the following command:

  CREATE DATABASE IF NOT EXISTS customer360;

  In which of the following locations will the customer360 database be located?

  A. dbfs:/user/hive/database/customer360

  B. dbfs:/user/hive/warehouse

  C. dbfs:/user/hive/customer360

  D. More information is needed to determine the correct response

  Correct Answer: B

  Explanation: dbfs:/user/hive/warehouse - which is the default location

• Question 24:

  In which of the following scenarios should a data engineer select a Task in the Depends On field of a new Databricks Job Task?

  A. When another task needs to be replaced by the new task

  B. When another task needs to fail before the new task begins

  C. When another task has the same dependency libraries as the new task

  D. When another task needs to use as little compute resources as possible

  E. When another task needs to successfully complete before the new task begins

  Correct Answer: E

• Question 25:

  Which of the following commands will return the location of database customer360?

  A. DESCRIBE LOCATION customer360;

  B. DROP DATABASE customer360;

  C. DESCRIBE DATABASE customer360;

  D. ALTER DATABASE customer360 SET DBPROPERTIES ('location' = '/user'};

  E. USE DATABASE customer360;

  Correct Answer: C

  Explanation: To retrieve the location of a database named "customer360" in a database management system like Hive or Databricks, you can use the DESCRIBE DATABASE command followed by the database name. This command will provide information about the database, including its location.

• Question 26:

  A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.

  Which of the following commands could the data engineering team use to access sales in PySpark?

  A. SELECT * FROM sales

  B. There is no way to share data between PySpark and SQL.

  C. spark.sql("sales")

  D. spark.delta.table("sales")

  E. spark.table("sales")

  Correct Answer: E

  https://spark.apache.org/docs/3.2.1/api/python/reference/api/pyspark.sql.SparkSession.tabl e.html

• Question 27:

  A new data engineering team team has been assigned to an ELT project. The new data engineering team will need full privileges on the table sales to fully manage the project.

  Which of the following commands can be used to grant full permissions on the database to the new data engineering team?

  A. GRANT ALL PRIVILEGES ON TABLE sales TO team;

  B. GRANT SELECT CREATE MODIFY ON TABLE sales TO team;

  C. GRANT SELECT ON TABLE sales TO team;

  D. GRANT USAGE ON TABLE sales TO team;

  E. GRANT ALL PRIVILEGES ON TABLE team TO sales;

  Correct Answer: A

• Question 28:

  A new data engineering team has been assigned to work on a project. The team will need access to database customers in order to see what tables already exist. The team has its own group team.

  Which of the following commands can be used to grant the necessary permission on the entire database to the new team?

  A. GRANT VIEW ON CATALOG customers TO team;

  B. GRANT CREATE ON DATABASE customers TO team;

  C. GRANT USAGE ON CATALOG team TO customers;

  D. GRANT CREATE ON DATABASE team TO customers;

  E. GRANT USAGE ON DATABASE customers TO team;

  Correct Answer: E

  Explanation: The GRANT statement is used to grant privileges on a database, table, or view to a user or role. The ALL PRIVILEGES option grants all possible privileges on the specified object, such as CREATE, SELECT, MODIFY, and

  USAGE. The syntax of the GRANT statement is:

  GRANT privilege_type ON object TO user_or_role;

  Therefore, to grant full permissions on the database customers to the new data engineering team, the command should be:

  GRANT ALL PRIVILEGES ON DATABASE customers TO team;

• Question 29:

  Which of the following describes the relationship between Bronze tables and raw data?

  A. Bronze tables contain less data than raw data files.

  B. Bronze tables contain more truthful data than raw data.

  C. Bronze tables contain aggregates while raw data is unaggregated.

  D. Bronze tables contain a less refined view of data than raw data.

  E. Bronze tables contain raw data with a schema applied.

  Correct Answer: E

  Explanation: The Bronze layer is where we land all the data from external source systems. The table structures in this layer correspond to the source system table structures "as-is," along with any additional metadata columns that capture the load date/time, process ID, etc. The focus in this layer is quick Change Data Capture and the ability to provide an historical archive of source (cold storage), data lineage, auditability, reprocessing if needed without rereading the data from the source system. https://www.databricks.com/glossary/medallion- architecture#:~:text=Bronze%20layer%20%28raw%20data%29

• Question 30:

  A data engineer is using the following code block as part of a batch ingestion pipeline to read from a composable table:

  

  Which of the following changes needs to be made so this code block will work when the transactions table is a stream source?

  A. Replace predict with a stream-friendly prediction function

  B. Replace schema(schema) with option ("maxFilesPerTrigger", 1)

  C. Replace "transactions" with the path to the location of the Delta table

  D. Replace format("delta") with format("stream")

  E. Replace spark.read with spark.readStream

  Correct Answer: E

  Explanation: https://docs.databricks.com/en/structured-streaming/delta-lake.html