Commits

Branch selector

 master

User selector

itholic

Datepicker

All time

Commit History

Commits on Apr 20, 2022

• [SPARK-38828][PYTHON] Remove TimestampNTZ type Python support in Spark 3.3

  Show description for 581000d
  

  itholic

  authored and

  HyukjinKwon

  committed
  581000d

  Copy full SHA for 581000d

Commits on Apr 14, 2022

• [SPARK-38107][SQL][FOLLOWUP] Refine the error-class name and message for grouped agg pandas UDF

  Show description for 0085bfc
  

  itholic

  authored and

  HyukjinKwon

  committed
  0085bfc

  Copy full SHA for 0085bfc

Commits on Apr 8, 2022

• [SPARK-38755][PYTHON][TEST] Add file to address missing pandas general functions

  Show description for 2d6541e
  

  itholic

  authored and

  HyukjinKwon

  committed
  2d6541e

  Copy full SHA for 2d6541e

• [SPARK-38800][DOCS][PYTHON] Explicitly document the supported pandas version

  Show description for 85cf2e8
  

  itholic

  and

  HyukjinKwon

  committed
  85cf2e8

  Copy full SHA for 85cf2e8

Commits on Apr 4, 2022

• [SPARK-38780][FOLLOWUP][PYTHON][DOCS] PySpark docs build should fail when there is warning

  Show description for 835b46d
  

  itholic

  authored and

  HyukjinKwon

  committed
  835b46d

  Copy full SHA for 835b46d

• [SPARK-38780][PYTHON][DOCS] PySpark docs build should fail when there is warning

  Show description for bd8100b
  

  itholic

  authored and

  HyukjinKwon

  committed
  bd8100b

  Copy full SHA for bd8100b

Commits on Mar 11, 2022

• [SPARK-38107][SQL] Use error classes in the compilation errors of python/pandas UDFs

  Show description for 34e3029
  

  itholic

  authored and

  HyukjinKwon

  committed
  34e3029

  Copy full SHA for 34e3029

Commits on Mar 8, 2022

• [SPARK-38183][PYTHON][FOLLOWUP] Check the ANSI conf properly when creating pandas-on-Spark session

  Show description for a13b478
  

  itholic

  authored and

  HyukjinKwon

  committed
  a13b478

  Copy full SHA for a13b478

Commits on Feb 23, 2022

• [SPARK-38235][SQL][TESTS] Add test util for testing grouped aggregate pandas UDF

  Show description for bf22078
  

  itholic

  authored and

  HyukjinKwon

  committed
  bf22078

  Copy full SHA for bf22078

Commits on Feb 22, 2022

• [SPARK-38279][TESTS][3.2] Pin MarkupSafe to 2.0.1 fix linter failure

  Show description for a103a49
  

  itholic

  authored and

  HyukjinKwon

  committed
  a103a49

  Copy full SHA for a103a49

Commits on Feb 15, 2022

• [SPARK-38145][PYTHON][TESTS] Make PySpark tests pass when "spark.sql.ansi.enabled" is True by default

  Show description for ca9bbba
  

  itholic

  authored and

  HyukjinKwon

  committed
  ca9bbba

  Copy full SHA for ca9bbba

• [SPARK-38183][PYTHON] Show warning when creating pandas-on-Spark session under ANSI mode

  Show description for 5613e2f
  

  itholic

  authored and

  HyukjinKwon

  committed
  5613e2f

  Copy full SHA for 5613e2f

Commits on Jan 10, 2022

• [SPARK-37835][SQL][DOCS] Fix the comments on SQLQueryTestSuite.scala/ThriftServerQueryTestSuite.scala to more explicit

  Show description for 02f1405
  

  itholic

  authored and

  HyukjinKwon

  committed
  02f1405

  Copy full SHA for 02f1405

Commits on Dec 30, 2021

• [SPARK-37657][FOLLOWUP][PYTHON] Separate the tests for pandas < 1.1.0

  Show description for 113ac8e
  

  itholic

  authored and

  HyukjinKwon

  committed
  113ac8e

  Copy full SHA for 113ac8e

Commits on Dec 28, 2021

• [SPARK-37756][PYTHON] Enable matplotlib test for pandas API on Spark

  Show description for 78899e3
  

  itholic

  authored and

  HyukjinKwon

  committed
  78899e3

  Copy full SHA for 78899e3

Commits on Dec 24, 2021

• [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

  Show description for 656127d
  

  itholic

  and

  HyukjinKwon

  committed
  656127d

  Copy full SHA for 656127d

Commits on Dec 23, 2021

• [SPARK-37668][PYTHON] 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

  Show description for f6be769
  

  itholic

  authored and

  HyukjinKwon

  committed
  f6be769

  Copy full SHA for f6be769

Commits on Dec 15, 2021

• [SPARK-37575][SQL][FOLLOWUP] Update migration guide for null values saving in CSV data source

  Show description for 8630652
  

  itholic

  authored and

  HyukjinKwon

  committed
  8630652

  Copy full SHA for 8630652

Commits on Nov 17, 2021

• [SPARK-37352][PYTHON] Silence the index_col advice in to_spark() for internal usage

  Show description for 719e2f5
  

  itholic

  authored and

  HyukjinKwon

  committed
  719e2f5

  Copy full SHA for 719e2f5

Commits on Nov 15, 2021

• [SPARK-37327][PYTHON] Silence the to_pandas() advice log for internal usage

  Show description for 27abceb
  

  itholic

  authored and

  HyukjinKwon

  committed
  27abceb

  Copy full SHA for 27abceb

Commits on Nov 12, 2021

• [SPARK-37022][PYTHON][FOLLOWUP] Remove unnecessary comment in lint-python

  Show description for 976d292
  

  itholic

  authored and

  HyukjinKwon

  committed
  976d292

  Copy full SHA for 976d292

• [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

  Show description for 10c0777
  

  itholic

  authored and

  HyukjinKwon

  committed
  10c0777

  Copy full SHA for 10c0777

Commits on Oct 28, 2021

• [SPARK-37036][PYTHON] Add util function to raise advice warning for pandas API on Spark

  Show description for 502a1ec
  

  itholic

  authored and

  HyukjinKwon

  committed
  502a1ec

  Copy full SHA for 502a1ec

Commits on Oct 27, 2021

• [SPARK-36348][PYTHON][FOLLOWUP] Complete test_astype for index

  Show description for c7d9bd2
  

  itholic

  authored and

  HyukjinKwon

  committed
  c7d9bd2

  Copy full SHA for c7d9bd2

Commits on Oct 13, 2021

• [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

  Show description for 46bcef7
  

  itholic

  authored and

  HyukjinKwon

  committed
  46bcef7

  Copy full SHA for 46bcef7

Commits on Oct 1, 2021

• [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

  Show description for 13ddc91
  

  itholic

  authored and

  HyukjinKwon

  committed
  13ddc91

  Copy full SHA for 13ddc91

Commits on Sep 23, 2021

• [SPARK-36506][PYTHON] Improve test coverage for series.py and indexes/*.py

  Show description for 5268904
  

  itholic

  authored and

  HyukjinKwon

  committed
  5268904

  Copy full SHA for 5268904

Commits on Sep 9, 2021

• [SPARK-36689][PYTHON] Cleanup the deprecated APIs and raise proper warning message

  Show description for 0227793
  

  itholic

  authored and

  HyukjinKwon

  committed
  0227793

  Copy full SHA for 0227793

Commits on Sep 8, 2021

• [SPARK-36531][SPARK-36515][PYTHON] Improve test coverage for data_type_ops/* and groupby

  Show description for 71dbd03
  

  itholic

  authored and

  HyukjinKwon

  committed
  71dbd03

  Copy full SHA for 71dbd03

Commits on Sep 3, 2021

• [SPARK-36609][PYTHON] Add `errors` argument for `ps.to_numeric`

  Show description for 61b3223
  

  itholic

  and

  HyukjinKwon

  committed
  61b3223

  Copy full SHA for 61b3223

Commits on Aug 26, 2021

• [SPARK-36537][PYTHON] Revisit disabled tests for CategoricalDtype

  Show description for fe48618
  

  itholic

  authored and

  HyukjinKwon

  committed
  fe48618

  Copy full SHA for fe48618

• [SPARK-36505][PYTHON] Improve test coverage for frame.py

  Show description for 97e7d6e
  

  itholic

  authored and

  HyukjinKwon

  committed
  97e7d6e

  Copy full SHA for 97e7d6e

Commits on Aug 18, 2021

• [SPARK-36368][PYTHON] Fix CategoricalOps.astype to follow pandas 1.3

  Show description for f2e593b
  

  itholic

  authored and

  ueshin

  committed
  f2e593b

  Copy full SHA for f2e593b

• [SPARK-36388][SPARK-36386][PYTHON][FOLLOWUP] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

  Show description for c91ae54
  

  itholic

  authored and

  ueshin

  committed
  c91ae54

  Copy full SHA for c91ae54

Commits on Aug 17, 2021

• [SPARK-36387][PYTHON] Fix Series.astype from datetime to nullable string

  Show description for c0441bb
  

  itholic

  authored and

  ueshin

  committed
  c0441bb

  Copy full SHA for c0441bb

Pagination

Previous

Next