Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 20, 2022

• [SPARK-38962][SQL] Fix wrong computeStats at DataSourceV2Relation

  Show description for f0fa8b1
  

  ulysses-you

  authored and

  cloud-fan

  committed
  f0fa8b1

  Copy full SHA for f0fa8b1

• [SPARK-37575][SQL][FOLLOWUP] Update the migration guide for added legacy flag for the breaking change of write null value in csv to unquoted empty string

  Show description for a67acba
  

  anchovYu

  authored and

  cloud-fan

  committed
  a67acba

  Copy full SHA for a67acba

• [SPARK-38844][PYTHON][TESTS][FOLLOW-UP] Test pyspark.pandas.tests.test_generic_functions

  Show description for 7144e1a
  HyukjinKwon

  committed
  7144e1a

  Copy full SHA for 7144e1a

• [SPARK-38956][TESTS] Fix FAILED_EXECUTE_UDF test case on Java 17

  Show description for ef00aa1
  

  williamhyun

  authored and

  HyukjinKwon

  committed
  ef00aa1

  Copy full SHA for ef00aa1

• [SPARK-37613][SQL][FOLLOWUP] Supplement docs for regr_count

  Show description for 1b106ea
  

  beliefer

  authored and

  HyukjinKwon

  committed
  1b106ea

  Copy full SHA for 1b106ea

• [SPARK-38828][PYTHON] Remove TimestampNTZ type Python support in Spark 3.3

  Show description for 581000d
  

  itholic

  authored and

  HyukjinKwon

  committed
  581000d

  Copy full SHA for 581000d

• [SPARK-38943][PYTHON] EWM support ignore_na

  Show description for 1dfb439
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  1dfb439

  Copy full SHA for 1dfb439

Commits on Apr 19, 2022

• [SPARK-38929][SQL] Improve error messages for cast failures in ANSI

  Show description for f76b3e7
  

  anchovYu

  authored and

  MaxGekk

  committed
  f76b3e7

  Copy full SHA for f76b3e7

• [SPARK-38727][SQL][TESTS] Test the error class: FAILED_EXECUTE_UDF

  Show description for 134ab48
  

  panbingkun

  authored and

  MaxGekk

  committed
  134ab48

  Copy full SHA for 134ab48

• [SPARK-38747][SQL][TESTS] Move the tests for `PARSE_SYNTAX_ERROR` from ErrorParserSuite to QueryParsingErrorsSuite

  Show description for bcb235f
  

  panbingkun

  and

  MaxGekk

  committed
  bcb235f

  Copy full SHA for bcb235f

• [SPARK-37691][SQL] Support ANSI Aggregation Function: `percentile_disc`

  Show description for 639301a
  

  beliefer

  authored and

  cloud-fan

  committed
  639301a

  Copy full SHA for 639301a

• [SPARK-38931][SS] Create root dfs directory for RocksDBFileManager with unknown number of keys on 1st checkpoint

  Show description for abb1df9
  

  Myasuka

  authored and

  HeartSaVioR

  committed
  abb1df9

  Copy full SHA for abb1df9

• [SPARK-38720][SQL][TESTS] Test the error class: CANNOT_CHANGE_DECIMAL_PRECISION

  Show description for 29eea67
  

  panbingkun

  and

  MaxGekk

  committed
  29eea67

  Copy full SHA for 29eea67

• [SPARK-37672][SQL] Support ANSI Aggregate Function: regr_sxx

  Show description for e1e110f
  

  beliefer

  authored and

  cloud-fan

  committed
  e1e110f

  Copy full SHA for e1e110f

• [SPARK-38811][SQL] Support ALTER TABLE ADD COLUMN commands with DEFAULT values

  Show description for 67d6f01
  

  dtenedor

  authored and

  gengliangwang

  committed
  67d6f01

  Copy full SHA for 67d6f01

• [SPARK-38825][SQL][TEST][FOLLOWUP] Add test for in(null) and notIn(null)

  Show description for b760e4a
  huaxingao

  committed
  b760e4a

  Copy full SHA for b760e4a

• [SPARK-38796][SQL] Update to_number and try_to_number functions to restrict S and MI sequence to start or end only

  Show description for 242ee22
  

  dtenedor

  authored and

  cloud-fan

  committed
  242ee22

  Copy full SHA for 242ee22

• [SPARK-37670][SQL] Support predicate pushdown and column pruning for de-duped CTEs

  Show description for 175e429
  

  maryannxue

  and

  cloud-fan

  committed
  175e429

  Copy full SHA for 175e429

• [SPARK-38940][PYTHON] Test Series' anchor frame for in-place updates on Series

  Show description for 4b38188
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  4b38188

  Copy full SHA for 4b38188

• [SPARK-38903][PYTHON] Implement `ignore_index` of `Series.sort_values` and `Series.sort_index`

  Show description for eadd535
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  eadd535

  Copy full SHA for eadd535

• [SPARK-38880][PYTHON] Implement `numeric_only` parameter of `GroupBy.max/min`

  Show description for 68a7aa5
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  68a7aa5

  Copy full SHA for 68a7aa5

• [SPARK-38933][SQL][DOCS] Add examples of window functions into SQL docs

  Show description for d2c5c53
  

  beliefer

  authored and

  HyukjinKwon

  committed
  d2c5c53

  Copy full SHA for d2c5c53

Commits on Apr 18, 2022

• [SPARK-38856][SHUFFLE] Fix a rejectedExecutionException error when push-based shuffle is enabled

  Show description for 2a1f976
  

  weixiuli

  authored and

  Mridul Muralidharan

  committed
  2a1f976

  Copy full SHA for 2a1f976

• [SPARK-38851][CORE][TESTS] Refactor `HistoryServerSuite` to add UTs for RocksDB

  Show description for a826469
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  a826469

  Copy full SHA for a826469

• [SPARK-38910][YARN] Clean spark staging before `unregister`

  Show description for 87c744b
  

  AngersZhuuuu

  authored and

  srowen

  committed
  87c744b

  Copy full SHA for 87c744b

• [SPARK-38885][BUILD] Upgrade Netty to 4.1.76

  Show description for 6d3c1c1
  

  LuciferYang

  authored and

  srowen

  committed
  6d3c1c1

  Copy full SHA for 6d3c1c1

• [SPARK-37015][PYTHON] Inline type hints for python/pyspark/streaming/dstream.py

  Show description for dff52d6
  

  dchvn

  authored and

  zero323

  committed
  dff52d6

  Copy full SHA for dff52d6

• [SPARK-38886][SQL] Remove outer join if aggregate functions are duplicate agnostic on streamed side

  Show description for ca044e6
  

  ulysses-you

  authored and

  cloud-fan

  committed
  ca044e6

  Copy full SHA for ca044e6

• [SPARK-37643][SQL] when charVarcharAsString is true, for char datatype predicate query should skip rpadding rule

  Show description for c1ea8b4
  

  fhygh

  authored and

  cloud-fan

  committed
  c1ea8b4

  Copy full SHA for c1ea8b4

• [MINOR] Improve to update some mutable hash maps

  Show description for 2a667fb
  

  weixiuli

  authored and

  srowen

  committed
  2a667fb

  Copy full SHA for 2a667fb

• [SPARK-38746][SQL][TESTS] Move the tests for `PARSE_EMPTY_STATEMENT` to QueryParsingErrorsSuite

  Show description for 857acca
  

  panbingkun

  authored and

  MaxGekk

  committed
  857acca

  Copy full SHA for 857acca

• [SPARK-38689][SQL] Use error classes in the compilation errors of not allowed DESC PARTITION on views

  Show description for de18ce6
  

  ivoson

  authored and

  MaxGekk

  committed
  de18ce6

  Copy full SHA for de18ce6

• [SPARK-38926][SQL] Output types in error messages in SQL style

  Show description for 0d16159
  MaxGekk

  committed
  0d16159

  Copy full SHA for 0d16159

• [SPARK-38928][TESTS][SQL] Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

  Show description for 1f55a2a
  

  williamhyun

  authored and

  dongjoon-hyun

  committed
  1f55a2a

  Copy full SHA for 1f55a2a

Commits on Apr 17, 2022

• [SPARK-38816][ML][DOCS] Fix comment about choice of initial factors in ALS

  Show description for b2b350b
  

  srowen

  authored and

  HyukjinKwon

  committed
  b2b350b

  Copy full SHA for b2b350b

Pagination

Previous

Next