这是indexloc提供的服务,不要输入任何密码
Skip to content

2018-08-09 (GCS 1.9.5, BQ 0.13.5)

Choose a tag to compare

@medb medb released this 10 Aug 05:19
· 997 commits to master since this release

Changelog

Cloud Storage connector:

  1. Improve build configuration (pom.xmls) compatibility with Maven release plugin.

    Changes version string from 1.9.5-hadoop2 to hadoop2-1.9.5.

  2. Update Maven plugins versions.

  3. Do not send batch request when performing operations (rename, delete, copy) on 1 object.

  4. Add fs.gs.performance.cache.dir.metadata.prefetch.limit (default=1000) configuration property to control number of prefetched metadata objects in the same directory by PerformanceCachingGoogleCloudStorage.

    To disable metadata prefetching set property value to 0.

    To prefetch all objects metadata in a directory set property value to -1.

  5. Add configuration properties to control batching of copy operations separately from other operations:

    fs.gs.copy.max.requests.per.batch (default: 30)
    fs.gs.copy.batch.threads (default: 0)
    
  6. Fix RejectedExecutionException during parallel execution of GCS batch requests.

  7. Change default values for GCS batch/directory operations properties:

    fs.gs.copy.with.rewrite.enable (default: false -> true)
    fs.gs.copy.max.requests.per.batch (default: 30 -> 1)
    fs.gs.copy.batch.threads (default: 0 -> 50)
    fs.gs.max.requests.per.batch (default: 30 -> 25)
    fs.gs.batch.threads (default: 0 -> 25)
    

BigQuery connector:

  1. POM updates for GCS connector 1.9.5.

  2. Improve build configuration (pom.xmls) compatibility with Maven release plugin.

    Changes version string from 0.13.5-hadoop2 to hadoop2-0.13.5.

  3. Update Maven plugins versions.