这是indexloc提供的服务,不要输入任何密码
Skip to content

Conversation

@ajnavarro
Copy link
Contributor

@ajnavarro ajnavarro commented Apr 27, 2018

To avoid problems with other shaded packages from transitive dependencies, added a unique key to shade our packages.

Signed-off-by: Antonio Jesus Navarro Perez antnavper@gmail.com

@ajnavarro ajnavarro requested a review from smacker April 27, 2018 11:08
To avoid problems with other shaded packages from transitive dependencies, added a unique key to shade our packages.

Signed-off-by: Antonio Jesus Navarro Perez <antnavper@gmail.com>
@smacker
Copy link
Contributor

smacker commented Apr 27, 2018

tested on cluster with custom jar by @ajnavarro

root@spark-smacker:/# spark-shell --jars /engine-uber.jar --master=spark://p-spark-master:7077

import tech.sourced.engine._
val engine = Engine(spark, "hdfs://hdfs-namenode/5-siva", "siva")
engine.getRepositories.getHEAD.getCommits.getTreeEntries.getBlobs.limit(5).extractUASTs.show()

+--------------------+--------------------+--------------------+---------------+--------------------+---------+------------+-------------+
|             blob_id|         commit_hash|       repository_id| reference_name|             content|is_binary|        path|         uast|
+--------------------+--------------------+--------------------+---------------+--------------------+---------+------------+-------------+
|25a742dff0a403b2b...|9df2b534f35a48e04...|bitbucket.org/kd0...|refs/heads/HEAD|[23 20 53 65 65 2...|    false|  .gitignore|           []|
|30d54d47ae82add19...|9df2b534f35a48e04...|bitbucket.org/kd0...|refs/heads/HEAD|[73 6F 75 72 63 6...|    false|     Gemfile|[[B@3b5fa30d]|
|b1d9bb0e3721e95f4...|9df2b534f35a48e04...|bitbucket.org/kd0...|refs/heads/HEAD|[47 45 4D 0A 20 2...|    false|Gemfile.lock|           []|
|dd4e97e22e159a585...|9df2b534f35a48e04...|bitbucket.org/kd0...|refs/heads/HEAD|[3D 3D 20 52 45 4...|    false| README.rdoc|           []|
|05de8bb536903fd7a...|9df2b534f35a48e04...|bitbucket.org/kd0...|refs/heads/HEAD|[23 20 41 64 64 2...|    false|    Rakefile|[[B@7d800902]|
+--------------------+--------------------+--------------------+---------------+--------------------+---------+------------+-------------+

@ajnavarro ajnavarro merged commit a427f05 into src-d:master Apr 27, 2018
@ajnavarro ajnavarro deleted the fix/grpc-error branch April 27, 2018 12:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants