这是indexloc提供的服务,不要输入任何密码
Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 4 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,19 +124,17 @@ spark.index.exists.parquet("temp/codes.parquet")
// example uses filters on both columns, though any filters can be used,
// e.g. only on id or code
// Metastore will cache index catalog to reduce time for subsequent calls
val df = spark.index.parquet("temp/codes.parquet").
filter($"id" === 123 && $"code" === "123")
df.collect
spark.index.parquet("temp/codes.parquet").
filter($"id" === 123 && $"code" === "123").collect

// Delete index in metastore, also invalidates cache
// no-op if there is such index does not exist
// (does NOT delete original table)
spark.index.delete.parquet("temp/codes.parquet")

// You can compare performance with this
val df = spark.read.parquet("temp/codes.parquet").
filter($"id" === 123 && $"code" === "123")
df.collect
spark.read.parquet("temp/codes.parquet").
filter($"id" === 123 && $"code" === "123").collect
```

### Java API
Expand Down