Free PROFESSIONAL-DATA-ENGINEER Web TestEngine Demo

Q31 Single choice

You are designing a pipeline that publishes application events to a Pub/Sub topic. You need to aggregate events across hourly intervals before loading the results to BigQuery for analysis. Your solution must be scalable so it can process and load large volumes of events to BigQuery.

What should you do?

A
Create a streaming Dataflow job to continually read from the Pub/Sub topic and perform the necessary
aggregations using tumbling windows
B
Schedule a batch Dataflow job to run hourly, pulling all available messages from the Pub-Sub topic and performing the necessary aggregations
C
Schedule a Cloud Function to run hourly, pulling all avertable messages from the Pub/Sub topic and performing the necessary aggregations
D
Create a Cloud Function to perform the necessary data processing that executes using the Pub/Sub trigger every time a new message is published to the topic.

PROFESSIONAL-DATA-ENGINEER Web TestEngine demo