Commits

Branch selector

 v3.2.1-rc1

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 7, 2022

• Preparing Spark release v3.2.1-rc1

  

  Huaxin Gao

  committed
  2b0ee22

  Copy full SHA for 2b0ee22

• [SPARK-37802][SQL][3.2] Composite field name should work with Aggregate push down

  Show description for 4b5d2d7
  huaxingao

  committed
  4b5d2d7

  Copy full SHA for 4b5d2d7

Commits on Jan 5, 2022

• [SPARK-37800][SQL][FOLLOW-UP] Remove duplicated LogicalPlan inheritance

  Show description for 2470640
  HyukjinKwon

  committed
  2470640

  Copy full SHA for 2470640

• [SPARK-37807][SQL] Fix a typo in HttpAuthenticationException message

  Show description for 731e056
  

  Chilaka Ramakrishna

  authored and

  dongjoon-hyun

  committed
  731e056

  Copy full SHA for 731e056

• [SPARK-30789][SQL][DOCS][FOLLOWUP] Add document for syntax `(IGNORE | RESPECT) NULLS`

  Show description for 9b6be1a
  

  beliefer

  authored and

  cloud-fan

  committed
  9b6be1a

  Copy full SHA for 9b6be1a

• [SPARK-35714][FOLLOW-UP][CORE] WorkerWatcher should run System.exit in a thread out of RpcEnv

  Show description for 537de84
  Ngone51

  committed
  537de84

  Copy full SHA for 537de84

Commits on Jan 4, 2022

• [SPARK-37784][SQL] Correctly handle UDTs in CodeGenerator.addBufferedState()

  Show description for 45b7b7e
  JoshRosen

  committed
  45b7b7e

  Copy full SHA for 45b7b7e

• [SPARK-37728][SQL][3.2] Reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

  Show description for 5f9b92c
  

  yimin-yang

  authored and

  dongjoon-hyun

  committed
  5f9b92c

  Copy full SHA for 5f9b92c

• [SPARK-37800][SQL] TreeNode.argString incorrectly formats arguments of type Set[_]

  Show description for c280f08
  

  ssimeonov

  authored and

  cloud-fan

  committed
  c280f08

  Copy full SHA for c280f08

Commits on Dec 30, 2021

• [SPARK-37779][SQL] Make ColumnarToRowExec plan canonicalizable after (de)serialization

  Show description for edf0f6b
  HyukjinKwon

  committed
  edf0f6b

  Copy full SHA for edf0f6b

Commits on Dec 29, 2021

• [SPARK-37705][SQL][3.2] Rebase timestamps in the session time zone saved in Parquet/Avro metadata

  Show description for 906994f
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  906994f

  Copy full SHA for 906994f

Commits on Dec 26, 2021

• [SPARK-37659][UI][3.2] Fix FsHistoryProvider race condition between list and delet log info

  Show description for 01fff64
  

  ulysses-you

  authored and

  dongjoon-hyun

  committed
  01fff64

  Copy full SHA for 01fff64

Commits on Dec 24, 2021

• [MINOR][PYTHON][DOCS] Update pandas_pyspark.rst

  Show description for 35d7c4a
  

  kamelCased

  authored and

  HyukjinKwon

  committed
  35d7c4a

  Copy full SHA for 35d7c4a

• [SPARK-37302][BUILD][FOLLOWUP] Extract the versions of dependencies accurately

  Show description for 0888622
  sarutak

  committed
  0888622

  Copy full SHA for 0888622

• [SPARK-37391][SQL] JdbcConnectionProvider tells if it modifies security context

  Show description for 662c6e8
  

  Danny Guinther

  authored and

  HyukjinKwon

  committed
  662c6e8

  Copy full SHA for 662c6e8

Commits on Dec 23, 2021

• [SPARK-37695][CORE][SHUFFLE] Skip diagnosis ob merged blocks from push-based shuffle

  Show description for d1cd110
  

  pan3793

  authored and

  Ngone51

  committed
  d1cd110

  Copy full SHA for d1cd110

Commits on Dec 22, 2021

• [MINOR][DOCS][PYTHON] Fix docstring of SeriesGroupBy.nsmallest

  Show description for 3768734
  

  zero323

  authored and

  HyukjinKwon

  committed
  3768734

  Copy full SHA for 3768734

• [MINOR][SQL] Fix the typo in function names: crete

  Show description for 9249c56
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  9249c56

  Copy full SHA for 9249c56

Commits on Dec 21, 2021

• [SPARK-37692][DOCS] Fix an example of mixed interval fields in the SQL migration guide

  Show description for 669f6df
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  669f6df

  Copy full SHA for 669f6df

Commits on Dec 20, 2021

• [SPARK-37678][PYTHON] Fix _cleanup_and_return signature

  Show description for ebf7e61
  

  zero323

  authored and

  ueshin

  committed
  ebf7e61

  Copy full SHA for ebf7e61

Commits on Dec 19, 2021

• [MINOR][PYTHON][DOCS] Fix documentation for Python's recentProgress & lastProgress

  Show description for 63f09c1
  

  alexott

  authored and

  HyukjinKwon

  committed
  63f09c1

  Copy full SHA for 63f09c1

Commits on Dec 17, 2021

• [SPARK-37654][SQL] Fix NPE in Row.getSeq when field is Null

  Show description for 255e82e
  

  huaxingao

  authored and

  HyukjinKwon

  committed
  255e82e

  Copy full SHA for 255e82e

Commits on Dec 16, 2021

• [SPARK-37060][CORE][3.2] Handle driver status response from backup masters

  Show description for 22eb1eb
  

  testsgmr

  authored and

  Ngone51

  committed
  22eb1eb

  Copy full SHA for 22eb1eb

• [SPARK-37656][BUILD] Upgrade SBT to 1.5.7

  Show description for 6b2b6ea
  

  sarutak

  authored and

  HyukjinKwon

  committed
  6b2b6ea

  Copy full SHA for 6b2b6ea

Commits on Dec 15, 2021

• [SPARK-37633][SQL] Unwrap cast should skip if downcast failed with an…

  Show description for 49b830c
  

  manuzhang

  authored and

  sunchao

  committed
  49b830c

  Copy full SHA for 49b830c

• Revert "[SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings"

  Show description for 50af717
  HyukjinKwon

  committed
  50af717

  Copy full SHA for 50af717

Commits on Dec 14, 2021

• [SPARK-37217][SQL][3.2] The number of dynamic partitions should early check when writing to external tables

  Show description for 9cd64f8
  

  cxzl25

  authored and

  sunchao

  committed
  9cd64f8

  Copy full SHA for 9cd64f8

• [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

  Show description for 62e4202
  

  wayneguow

  authored and

  MaxGekk

  committed
  62e4202

  Copy full SHA for 62e4202

• [SPARK-37577][SQL][3.2] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

  Show description for e16d3f9
  

  viirya

  authored and

  dongjoon-hyun

  committed
  e16d3f9

  Copy full SHA for e16d3f9

Commits on Dec 13, 2021

• [SPARK-37624][PYTHON][DOCS] Suppress warnings for live pandas-on-Spark quickstart notebooks

  Show description for 35942fc
  HyukjinKwon

  committed
  35942fc

  Copy full SHA for 35942fc

• [SPARK-37481][CORE][WEBUI] Fix disappearance of skipped stages after they retry

  Show description for f20c408
  

  yaooqinn

  authored and

  Ngone51

  committed
  f20c408

  Copy full SHA for f20c408

Commits on Dec 12, 2021

• [SPARK-37615][BUILD] Upgrade SBT to 1.5.6

  Show description for 6b5ae04
  

  williamhyun

  authored and

  dongjoon-hyun

  committed
  6b5ae04

  Copy full SHA for 6b5ae04

Commits on Dec 10, 2021

• [SPARK-37594][SPARK-34399][SQL][TESTS] Make UT more stable

  Show description for 0bd2dab
  

  AngersZhuuuu

  authored and

  srowen

  committed
  0bd2dab

  Copy full SHA for 0bd2dab

Commits on Dec 9, 2021

• [SPARK-37451][SQL] Fix cast string type to decimal type if spark.sql.legacy.allowNegativeScaleOfDecimal is enabled

  Show description for 1890348
  

  wangyum

  authored and

  dongjoon-hyun

  committed
  1890348

  Copy full SHA for 1890348

Commits on Dec 8, 2021

• [SPARK-37392][SQL] Fix the performance bug when inferring constraints for Generate

  Show description for 59380fe
  cloud-fan

  committed
  59380fe

  Copy full SHA for 59380fe

Pagination

Previous

Next