Noos
PT EN
RAN-DBDEA-00099
Ranvier · DBDEA

Exam DBDEA Topics: troubleshooting Difficulty: easy

A job ran unchanged for months on a shared cluster whose `pandas` cluster library was pinned to 1.5.3. Last week, another team updated the cluster's libraries to pandas 2.2.0 for their own pipeline. Since then, this job's tasks fail immediately with an `AttributeError` when the code calls `DataFrame.append`. What happened, and what is the best-practice fix?

Options (Reading Mode) Click to filter discussion →
  1. A. The cluster's Spark version was silently downgraded during the library update; pin the previous Spark version to restore the job
  2. B. The other team's pipeline rewrote the job's input files into a format the reader no longer understands
  3. C. The job hits out-of-memory while importing pandas; move it to larger workers
  4. D. A library version conflict — pandas 2.2.0 removed the API this job uses; give the job its own cluster or pinned libraries
Reveal answer

Correct answer: A library version conflict — pandas 2.2.0 removed the API this job uses; give the job its own cluster or pinned libraries

Reference: https://docs.databricks.com/aws/en/compute/configure

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (D): A library version conflict — pandas 2.2.0 removed the API this job uses; give the job its own cluster or pinned libraries

⚓ Official Documentation Anchor: https://docs.databricks.com/aws/en/compute/configure
Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.