Noos
PT EN
RAN-DBDEA-00121
Ranvier · DBDEA

Exam DBDEA Topics: ingestion Difficulty: easy

A team starts a new Auto Loader stream on a bucket that already contains three years of legacy extracts from a retired system. Those historical files will be loaded once by a separate backfill script; the stream itself must capture only the files that arrive from its first run onward. How should the stream be configured so the legacy extracts are never ingested?

Options (Reading Mode) Click to filter discussion →
  1. A. Delete the legacy extracts from the bucket before starting the stream, so the first run finds nothing old to pick up
  2. B. Use COPY INTO for this table instead, because COPY INTO always skips files that already existed in the folder before its very first execution
  3. C. Create the target table with a date filter on ingestion time, which Auto Loader honors when it discovers new files
  4. D. Set cloudFiles.includeExistingFiles to false, so the first run ignores files already in the bucket and ingests only new arrivals
Reveal answer

Correct answer: Set cloudFiles.includeExistingFiles to false, so the first run ignores files already in the bucket and ingests only new arrivals

Reference: https://docs.databricks.com/aws/en/ingestion/cloud-object-storage/auto-loader/

Train this exam on Ranvier →

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (D): Set cloudFiles.includeExistingFiles to false, so the first run ignores files already in the bucket and ingests only new arrivals

Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.