2018-08-09 (GCS 1.9.5, BQ 0.13.5)
Changelog
Cloud Storage connector:
-
Improve build configuration (
pom.xmls) compatibility with Maven release plugin.Changes version string from
1.9.5-hadoop2tohadoop2-1.9.5. -
Update Maven plugins versions.
-
Do not send batch request when performing operations (rename, delete, copy) on 1 object.
-
Add
fs.gs.performance.cache.dir.metadata.prefetch.limit(default=1000) configuration property to control number of prefetched metadata objects in the same directory byPerformanceCachingGoogleCloudStorage.To disable metadata prefetching set property value to
0.To prefetch all objects metadata in a directory set property value to
-1. -
Add configuration properties to control batching of copy operations separately from other operations:
fs.gs.copy.max.requests.per.batch (default: 30) fs.gs.copy.batch.threads (default: 0) -
Fix
RejectedExecutionExceptionduring parallel execution of GCS batch requests. -
Change default values for GCS batch/directory operations properties:
fs.gs.copy.with.rewrite.enable (default: false -> true) fs.gs.copy.max.requests.per.batch (default: 30 -> 1) fs.gs.copy.batch.threads (default: 0 -> 50) fs.gs.max.requests.per.batch (default: 30 -> 25) fs.gs.batch.threads (default: 0 -> 25)
BigQuery connector:
-
POM updates for GCS connector 1.9.5.
-
Improve build configuration (
pom.xmls) compatibility with Maven release plugin.Changes version string from
0.13.5-hadoop2tohadoop2-0.13.5. -
Update Maven plugins versions.