Noos
PT EN
RAN-DBDEA-00023
Ranvier · DBDEA

Exam DBDEA Topics: ingestion Difficulty: medium

An Auto Loader stream runs with an inferred schema. In today's batch, some records use a column name with different casing (OrderID instead of order_id), and one field's value does not match the type Auto Loader inferred for it. Where does this non-conforming data end up?

Options (Reading Mode) Click to filter discussion →
  1. A. The affected records are dropped silently; only a row-count discrepancy in the stream metrics hints that something was lost
  2. B. The stream fails immediately, because case mismatches and type mismatches are fatal errors during schema inference
  3. C. The mismatched values are redirected to the bad records path that Auto Loader configures by default for every stream
  4. D. They land in the _rescued_data column Auto Loader adds automatically — non-conforming fields plus the source file path
Reveal answer

Correct answer: They land in the _rescued_data column Auto Loader adds automatically — non-conforming fields plus the source file path

Reference: https://docs.databricks.com/aws/en/ingestion/cloud-object-storage/auto-loader/

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (D): They land in the _rescued_data column Auto Loader adds automatically — non-conforming fields plus the source file path

Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.