Noos
PT EN
RAN-DBDEA-00017
Ranvier · DBDEA

Exam DBDEA Topics: ingestion Difficulty: medium

An Auto Loader stream reads files that land in Amazon S3 at a rate that has grown to hundreds of thousands of files per hour spread over a deep directory tree. The stream uses directory listing mode with a continuous trigger, and monthly cloud bills show ever-increasing S3 LIST request charges. The team can obtain the elevated cloud permissions required for notification setup. Which change best addresses the cost and scalability problem?

Options (Reading Mode) Click to filter discussion →
  1. A. Keep directory listing mode and raise cloudFiles.fetchParallelism so that the directory tree is listed more quickly
  2. B. Switch to file notification mode: file events go to a queue that the stream consumes, scaling far beyond listing
  3. C. Require producers to write into a single flat directory so that each run needs only one LIST call
  4. D. Replace Auto Loader with a scheduled COPY INTO statement, because COPY INTO lists the directory more cheaply than Auto Loader
Reveal answer

Correct answer: Switch to file notification mode: file events go to a queue that the stream consumes, scaling far beyond listing

Reference: https://docs.databricks.com/aws/en/ingestion/cloud-object-storage/auto-loader/file-notification-mode

Train this exam on Ranvier →

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (B): Switch to file notification mode: file events go to a queue that the stream consumes, scaling far beyond listing

Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.