Commits

Branch selector

 master

User selector

JoshRosen

Datepicker

All time

Commit History

Commits on Jan 4, 2022

• [SPARK-37784][SQL] Correctly handle UDTs in CodeGenerator.addBufferedState()

  Show description for eeef48f
  JoshRosen

  committed
  eeef48f

  Copy full SHA for eeef48f

Commits on Nov 29, 2021

• [SPARK-37447][SQL] Cache LogicalPlan.isStreaming() result in a lazy val

  Show description for 5d09828
  

  JoshRosen

  authored and

  cloud-fan

  committed
  5d09828

  Copy full SHA for 5d09828

Commits on Nov 19, 2021

• [SPARK-37379][SQL] Add tree pattern pruning to CTESubstitution rule

  Show description for 3b4eb1f
  JoshRosen

  committed
  3b4eb1f

  Copy full SHA for 3b4eb1f

Commits on Oct 18, 2021

• [SPARK-36151][INFRA] MiMa updates after 3.2.0 release: bump previousSparkVersion and re-enable tests for Scala 2.13 artifacts

  Show description for 47111af
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  47111af

  Copy full SHA for 47111af

Commits on Oct 14, 2021

• [SPARK-23626][CORE] Eagerly compute RDD.partitions on entire DAG when submitting job to DAGScheduler

  Show description for c4e975e
  JoshRosen

  committed
  c4e975e

  Copy full SHA for c4e975e

Commits on Sep 16, 2021

• [SPARK-36774][CORE][TESTS] Move SparkSubmitTestUtils to core module and use it in SparkSubmitSuite

  Show description for 3ae6e67
  JoshRosen

  committed
  3ae6e67

  Copy full SHA for 3ae6e67

Commits on Mar 2, 2020

• [SPARK-31003][TESTS] Fix incorrect uses of assume() in tests

  Show description for f0010c8
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  f0010c8

  Copy full SHA for f0010c8

• [SPARK-29419][SQL] Fix Encoder thread-safety bug in createDataset(Seq)

  Show description for f4499f6
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  f4499f6

  Copy full SHA for f4499f6

Commits on Feb 25, 2020

• [SPARK-30944][BUILD] Update URL for Google Cloud Storage mirror of Maven Central

  Show description for f152d2a
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  f152d2a

  Copy full SHA for f152d2a

Commits on Jan 20, 2020

• [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

  Show description for d50f8df
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  d50f8df

  Copy full SHA for d50f8df

Commits on Jan 7, 2020

• [SPARK-30414][SQL] ParquetRowConverter optimizations: arrays, maps, plus misc. constant factors

  Show description for 7a1a5db
  

  2 peopleauthored and

  HyukjinKwon

  committed
  7a1a5db

  Copy full SHA for 7a1a5db

• [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

  Show description for 93d3ab8
  

  2 peopleauthored and

  cloud-fan

  committed
  93d3ab8

  Copy full SHA for 93d3ab8

Commits on Oct 2, 2019

• [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

  Show description for c6938ea
  

  2 peopleauthored and

  cloud-fan

  committed
  c6938ea

  Copy full SHA for c6938ea

Commits on Jul 18, 2019

• [SPARK-28430][UI] Fix stage table rendering when some tasks' metrics are missing

  Show description for 3776fbd
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  3776fbd

  Copy full SHA for 3776fbd

Commits on Jun 26, 2019

• [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

  Show description for d83f84a
  

  2 peopleauthored and

  HyukjinKwon

  committed
  d83f84a

  Copy full SHA for d83f84a

Commits on Jun 20, 2019

• [SPARK-28112][TEST] Fix Kryo exception perf. bottleneck in tests due to absence of ML/MLlib classes

  Show description for ec032ce
  

  JoshRosen

  and

  gatorsmile

  committed
  ec032ce

  Copy full SHA for ec032ce

Commits on Jun 19, 2019

• [SPARK-28102][CORE] Avoid performance problems when lz4-java JNI libraries fail to initialize

  Show description for 6b27ad5
  

  JoshRosen

  and

  joshrosen-stripe

  committed
  6b27ad5

  Copy full SHA for 6b27ad5

• [SPARK-27839][SQL] Change UTF8String.replace() to operate on UTF8 bytes

  Show description for fc65e0f
  JoshRosen

  committed
  fc65e0f

  Copy full SHA for fc65e0f

Commits on Jun 10, 2019

• [SPARK-27846][CORE] Eagerly compute Configuration.properties in sc.hadoopConfiguration

  Show description for 95a9212
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  95a9212

  Copy full SHA for 95a9212

Commits on May 29, 2019

• [SPARK-27829][SQL] In Dataset.joinWith() inner joins, don't nest data before shuffling

  Show description for 19aaf0f
  

  2 peopleauthored and

  cloud-fan

  committed
  19aaf0f

  Copy full SHA for 19aaf0f

Commits on May 21, 2019

• [SPARK-27786][SQL] Fix Sha1, Md5, and Base64 codegen when commons-codec is shaded

  Show description for 604aa1b
  

  JoshRosen

  authored and

  cloud-fan

  committed
  604aa1b

  Copy full SHA for 604aa1b

Commits on May 7, 2018

• [SPARK-24160] ShuffleBlockFetcherIterator should fail if it receives zero-size blocks

  Show description for d2aa859
  

  JoshRosen

  authored and

  cloud-fan

  committed
  d2aa859

  Copy full SHA for d2aa859

Commits on Jan 10, 2018

• [SPARK-22997] Add additional defenses against use of freed MemoryBlocks

  Show description for f340b6b
  JoshRosen

  committed
  f340b6b

  Copy full SHA for f340b6b

• [SPARK-22982] Remove unsafe asynchronous close() call from FileDownloadChannel

  Show description for edf0a48
  

  JoshRosen

  authored and

  cloud-fan

  committed
  edf0a48

  Copy full SHA for edf0a48

Commits on Jan 9, 2018

• [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner

  Show description for f20131d
  

  JoshRosen

  authored and

  cloud-fan

  committed
  f20131d

  Copy full SHA for f20131d

Commits on Jan 8, 2018

• [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions

  Show description for 2c73d2a
  

  JoshRosen

  authored and

  gatorsmile

  committed
  2c73d2a

  Copy full SHA for 2c73d2a

• [SPARK-22985] Fix argument escaping bug in from_utc_timestamp / to_utc_timestamp codegen

  Show description for 71d65a3
  

  JoshRosen

  authored and

  gatorsmile

  committed
  71d65a3

  Copy full SHA for 71d65a3

Commits on Jul 18, 2017

• [SPARK-21444] Be more defensive when removing broadcasts in MapOutputTracker

  Show description for 5952ad2
  JoshRosen

  committed
  5952ad2

  Copy full SHA for 5952ad2

Commits on Jun 12, 2017

• [SPARK-20715] Store MapStatuses only in MapOutputTracker, not ShuffleMapStage

  Show description for 3476390
  JoshRosen

  committed
  3476390

  Copy full SHA for 3476390

Commits on Jun 9, 2017

• [SPARK-20863] Add metrics/instrumentation to LiveListenerBus

  Show description for 2a23cdd
  

  JoshRosen

  authored and

  cloud-fan

  committed
  2a23cdd

  Copy full SHA for 2a23cdd

Commits on May 30, 2017

• HOTFIX: fix Scalastyle break introduced in 4d57981cfb18e7500cde6c03ae46c7c9b697d064

  JoshRosen

  committed
  798a04f

  Copy full SHA for 798a04f

Commits on May 17, 2017

• [SPARK-20776] Fix perf. problems in JobProgressListener caused by TaskMetrics construction

  Show description for 30e0557
  

  JoshRosen

  authored and

  cloud-fan

  committed
  30e0557

  Copy full SHA for 30e0557

Commits on May 10, 2017

• [SPARK-20685] Fix BatchPythonEvaluation bug in case of single UDF w/ repeated arg.

  Show description for 8ddbc43
  

  JoshRosen

  authored and

  gatorsmile

  committed
  8ddbc43

  Copy full SHA for 8ddbc43

• [SPARK-20686][SQL] PropagateEmptyRelation incorrectly handles aggregate without grouping

  Show description for a90c5cd
  

  JoshRosen

  authored and

  cloud-fan

  committed
  a90c5cd

  Copy full SHA for a90c5cd

Commits on Apr 25, 2017

• [SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT

  Show description for f44c8a8
  

  JoshRosen

  authored and

  rxin

  committed
  f44c8a8

  Copy full SHA for f44c8a8

Pagination

Previous

Next