All pull requests

Pull requests

• [SPARK-60781][SQL] Reject subqueries in CHECK constraint conditions

  #59999·dongjoon-hyun opened Oct 31, 2026Member·

  ·

• [SPARK-60779][SQL] Shrink zstd output buffers to reduce direct memory held by Arrow batches

  #59998·dongjoon-hyun opened Oct 31, 2026Member·

  ·

• [SQL] Preserve Parquet LIST element layout and field IDs after pruning

  #59997·sunchao opened Oct 31, 2026Member·

  ·

• [SQL] Bind nested Dataset projections to the serializer output schema

  #59996·sunchao opened Oct 31, 2026Member·

  ·

• [SPARK-60778][K8S] Do not reuse a PVC mounted by a live executor when no new snapshot arrives

  #59995·guangyy opened Oct 31, 2026·

  ·

• [SPARK-60420][SQL][FOLLOWUP] Remove unreleased Oracle TimestampNTZ legacy config

  #59990·urosstan-db opened Oct 31, 2026Contributor·

  ·
  4

• [SPARK-48575][CORE] Reduce listing calls of rolling event log directories in History Server

  #59989·surawut-jirasaktavee opened Oct 31, 2026·

  ·

• [SPARK-xxx][SQL] Remove redundant Generate under DISTINCT aggregation

  #59988·yew1eb opened Oct 31, 2026·

  ·

• [SPARK-60547][PYTHON] Truncate TimeType values to the declared precision in createDataFrame

  #59987·guan404ming opened Oct 31, 2026Member·

  ·

• [SPARK-60198][PYTHON] Document the transpiler hook's runtime contract

  #59986·guan404ming opened Oct 31, 2026Member·

  ·

• [SPARK-60329][SQL] Evaluate an IS NOT NULL check written in a filter before a later conjunct that can raise under whole-stage codegen

  #59985·MaxGekk opened Oct 31, 2026Member·

  ·

• [SPARK-60332][SQL] Evaluate a common subexpression of a predicate's conjuncts before the first conjunct that references it

  #59984·MaxGekk opened Oct 31, 2026Member·

  ·

• [SQL][DOCS] Make built-in SQL function documentation generation deterministic

  #59983·Shiv-61 opened Oct 31, 2026·

  ·
  1

• [SPARK-60773][CONNECT] Make server-side Maven resolution opt-in

  #59982·qianlan717 opened Oct 31, 2026Contributor·

  ·

• [SPARK-60650][PS] Fix named size aggregation in pandas API on Spark

  #59981·adiranjan25 opened Oct 31, 2026·

  ·

• [SPARK-60188][4.X][PYTHON] Warn on unknown transpiler names in pyTranspilers

  #59980·holdenk opened Oct 31, 2026Contributor·

  ·

• [SPARK-60150][4.X][SQL] Normalize float grouping keys in filters pushed below Aggregate

  #59979·holdenk opened Oct 31, 2026Contributor·

  ·

• [SPARK-58628][4.X][SQL] Transpiler: skip null guards for is-not-None-narrowed parameters

  #59978·holdenk opened Oct 31, 2026Contributor·

  ·

• [SPARK-60769][SQL] Read Maven resolution settings from session configuration

  #59977·qianlan717 opened Oct 31, 2026Contributor·

  ·

• [SPARK-60767][PYTHON] Flush Python worker init responses for initialization timing

  #59976·Spenserrrr opened Oct 30, 2026Contributor·

  ·
  1

• [SPARK-59546][4.X][SQL] Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XML

  #59975·holdenk opened Oct 30, 2026Contributor·

  ·

• [SPARK-60768][SQL] Skip nested schema pruning in DSv2 column pruning when no nested field is requested

  #59974·yhuang-db opened Oct 30, 2026Contributor·

  ·
  2

• [SPARK-48710][FOLLOWUP][PYTHON][DOCS][3.5] Document the NumPy upper bound in the installation guide

  #59973·huashi-st opened Oct 30, 2026·

  ·

• [SPARK-60766][SQL] Prune nested fields through dynamic array indices and map keys

  #59972·sunchao opened Oct 30, 2026Member·

  ·
  27

• [SPARK-60763][DOCS] Add migration note for the V2 scan grouping change in Spark 4.2

  #59970·rekbun opened Oct 30, 2026·

  ·