Noos
PT EN
RAN-DBDEA-00207
Ranvier · DBDEA

Exam DBDEA Topics: ingestion Difficulty: medium

A nightly JDBC extraction reads a 200-million-row table from an external database and then filters it down to the last three days inside Spark. Network costs are enormous, and the external database is barely coping with the full scans. Which change pushes the filtering work to the source database?

Options (Reading Mode) Click to filter discussion →
  1. A. Increase numPartitions so the extraction parallelizes across more JDBC connections and the full scan finishes faster
  2. B. Wrap the predicate into the dbtable subquery, so the source database applies it before returning rows
  3. C. Cache the DataFrame before filtering, so the second run skips the JDBC read
  4. D. Convert the read to Auto Loader and let it discover only the new rows
Reveal answer

Correct answer: Wrap the predicate into the dbtable subquery, so the source database applies it before returning rows

Reference: https://docs.databricks.com/aws/en/archive/connectors/jdbc

02 — The Myelin Layer · Canonical Discussion

Where the exam tries to trick you — and how those who passed solved it.

0 Passed

contributed to this question

Answer Distractor Matrix Click an option to filter or open its dissection.
✦ Consolidated Synthesis (Wiki) rev. #1 (baseline) · CC BY-SA 4.0
Start synthesis for this question →

No community synthesis consolidated for this question yet. Below is the verifiable official starting point — if you passed the exam, open the option dissection.

Official Answer (B): Wrap the predicate into the dbtable subquery, so the source database applies it before returning rows

Ranvier · DBDEA

Contribute to this Question

Your contribution builds your Orbital Sheath

Peer contributions

No public contribution yet. Be the first who passed to explain why the distractors trick candidates — your contribution builds your Orbital Sheath.