Noos
PT EN
RAN-DBDEA-00021
Ranvier · DBDEA

Exam DBDEA Topics: ingestion Difficulty: hard

An Auto Loader stream with an inferred schema has run for weeks using only the default schema evolution settings. This morning, the producer adds a new column loyalty_points to the JSON files. What happens on the next micro-batch, and what does Databricks recommend operationally?

Options (Reading Mode) Click to filter discussion →
  1. A. The new column is silently ignored forever; to add it, the team must edit the inferred schema files stored under the schema location
  2. B. The stream keeps running with the old schema and quietly stores all loyalty_points values in the _rescued_data column, with no interruption at all
  3. C. Auto Loader adds loyalty_points and the stream stops with UnknownFieldException; a restart resumes it with the new schema
  4. D. The stream drops the offending files into a bad records path and keeps ingesting the remaining files with the old schema
Reveal answer

Correct answer: Auto Loader adds loyalty_points and the stream stops with UnknownFieldException; a restart resumes it with the new schema

Reference: https://docs.databricks.com/aws/en/ingestion/cloud-object-storage/auto-loader/

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (C): Auto Loader adds loyalty_points and the stream stops with UnknownFieldException; a restart resumes it with the new schema

Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.