Noos
PT EN
RAN-DBDEA-00200
Ranvier · DBDEA

Exam DBDEA Topics: ingestion Difficulty: hard

A landing bucket holds three years of historical files that must be loaded into a new table exactly once by a dedicated backfill run. After that run completes, ongoing arrivals must be captured incrementally by an Auto Loader stream, without reprocessing a single historical file and without backfill flags in the streaming code. Which design meets both requirements?

Options (Reading Mode) Click to filter discussion →
  1. A. Point the Auto Loader stream at the whole bucket with a low cloudFiles.maxFilesPerTrigger and let it chew through history first
  2. B. Load history with COPY INTO and keep using COPY INTO nightly, because Auto Loader would reload everything anyway
  3. C. Run one backfill batch with COPY INTO over the history, then start Auto Loader with cloudFiles.includeExistingFiles set to false
  4. D. Start the stream first and run the backfill afterwards, since Auto Loader skips files loaded by other tools
Reveal answer

Correct answer: Run one backfill batch with COPY INTO over the history, then start Auto Loader with cloudFiles.includeExistingFiles set to false

Reference: https://docs.databricks.com/aws/en/ingestion/cloud-object-storage/auto-loader/

Train this exam on Ranvier →

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (C): Run one backfill batch with COPY INTO over the history, then start Auto Loader with cloudFiles.includeExistingFiles set to false

Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.