All pull requests

Pull requests

• [SPARK-60387][SQL][4.0] Keep the existing table when saveAsTable overwrite fails before writing

  #59658·dongjoon-hyun opened Oct 20, 2026Member·

  ·

• [SPARK-60098][SQL] Fix memory leaks in ParquetColumnVector

  #59657·frroliveira opened Oct 20, 2026·

  ·
  1

• [SPARK-60387][SQL][4.1] Keep the existing table when saveAsTable overwrite fails before writing

  #59656·dongjoon-hyun opened Oct 20, 2026Member·

  ·

• [SPARK-60406][SQL] Count CollapseProject's column references by expression ID

  #59655·AnishMahto opened Oct 20, 2026Contributor·

  ·

• [SPARK-60397][SQL] Fix ORC filter pushdown on nanosecond timestamp columns read with a lower precision

  #59654·dongjoon-hyun opened Oct 20, 2026Member·

  ·

• [SPARK-60403][SQL] Fix (SortMergeJoin|ShuffledHashJoin|MergeRows)Exec codegen to call functions in nested classes by their qualified names

  #59653·dongjoon-hyun opened Oct 20, 2026Member·

  ·

• [SPARK-60400][SQL] Fix ORC TIMESTAMP schema inference with spark.sql.timestampType=TIMESTAMP_NTZ

  #59652·dongjoon-hyun opened Oct 20, 2026Member·

  ·

• [SPARK-60399][DOCS][SQL] Add a Metric Views programming guide and a CREATE METRIC VIEW reference page

  #59651·lisancao opened Oct 20, 2026·

  ·

• [SPARK-60398][SQL] Fix ExpandExec codegen to call switch case functions in nested classes by their qualified names

  #59650·dongjoon-hyun opened Oct 20, 2026Member·

  ·
  1

• [SPARK-60396][SQL] Fix Hive ORC filter pushdown on nanosecond timestamp columns

  #59649·dongjoon-hyun opened Oct 20, 2026Member·

  ·
  1

• [SPARK-60391][SQL] Add DataFrame API for BIN BY

  #59648·vranes opened Oct 20, 2026Contributor·

  ·

• [SPARK-60113][4.3][CORE][SQL] Wait for the pipelined Python UDF writer to exit before task completion cleanup

  #59647·viirya opened Oct 20, 2026Member·

  ·
  1

• [WIP][SQL] Support DROP TABLE in the single-pass analyzer

  #59646·vladanvasi-db opened Oct 20, 2026Contributor·

  ·

• [SPARK-56720][4.0][SS] Fail subsequent async log writes after a prior failure in async progress tracking

  #59645·snmvaughan opened Oct 20, 2026Contributor·

  ·

• [SPARK-56720][4.1][SS] Fail subsequent async log writes after a prior failure in async progress tracking

  #59644·snmvaughan opened Oct 20, 2026Contributor·

  ·

• [SPARK-60386][SQL] Enforce FILE EXTERNAL in table columns and reject FILE where it would need an ordering

  #59640·dejankrak-db opened Oct 20, 2026Contributor·

  ·
  1

• [SPARK-60381][SQL] Account the late-materialization survivor buffer to the task's execution memory

  #59639·peter-toth opened Oct 20, 2026Contributor·

  ·
  17

• [ML][MLLIB][PYTHON] Say deprecated APIs will be removed in the future

  #59638·zhengruifeng opened Oct 20, 2026Contributor·

  ·

• [SPARK-59824][SQL][FOLLOWUP] Guard top-level geometry and geography inputs to pickle Python UDFs

  #59637·ivoson opened Oct 20, 2026Contributor·

  ·
  1

• [SPARK-60382][SQL] CoalesceBucketsInJoin should see only the streamed side of a broadcast join

  #59636·wangyum opened Oct 20, 2026Member·

  ·
  3

• [SPARK-60384][BUILD] Check binary compatibility against Spark 4.2.0

  #59635·zhengruifeng opened Oct 20, 2026Contributor·

  ·

• [SPARK-60383][CORE] Keep streaming shuffle implementation details out of the public API

  #59633·zhengruifeng opened Oct 20, 2026Contributor·

  ·
  2

• [MINOR][CORE][SQL] Correct versions of configs introduced in Spark 4.3.0

  #59632·zhengruifeng opened Oct 20, 2026Contributor·

  ·

• [MINOR][4.3][SQL][PYTHON] Document collect_union in the function reference

  #59631·zhengruifeng opened Oct 20, 2026Contributor·

  ·

• [SPARK-60379][SQL] Push down shuffle exchange through union

  #59630·ulysses-you opened Oct 20, 2026Contributor·

  ·
  2