Skip to content

Commit

Permalink
Updates in spark-agent build process (#15)
Browse files Browse the repository at this point in the history
* removing all dependencies from shadowJar

* Including custom shadowJar (without ext dependencies)

We're adding a custom task to the `build.gradle` file to allow a customized shadowJar build (uber JAR) that does not contain external dependencies such as org.apache.http, etc.

* adding the artifact of the custom shadowJar to the publishing task

* including spark-extension-entrypoint in dependencies sh

* enabling dependencies in pom for interfaces

* remove slim shadow from build.gradle

---------

Co-authored-by: Jhonatas Rosendo <[email protected]>
  • Loading branch information
lmassaoy and jrosend authored Jan 29, 2025
1 parent c084198 commit 79c0d1f
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 4 deletions.
9 changes: 5 additions & 4 deletions integration/spark-extension-interfaces/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -169,10 +169,11 @@ publishing {
}
}

pom.withXml {
Node pomNode = asNode()
pomNode.remove(pomNode.get("dependencies"))
}
// -------- removing the following section to enable the dependencies within the pom file --------
// pom.withXml {
// Node pomNode = asNode()
// pomNode.remove(pomNode.get("dependencies"))
// }
}
}

Expand Down
1 change: 1 addition & 0 deletions integration/spark/buildDependencies.sh
Original file line number Diff line number Diff line change
Expand Up @@ -3,3 +3,4 @@ set -x -e
(cd ../../client/java && ./gradlew publishToMavenLocal)
(cd ../spark-extension-interfaces && ./gradlew publishToMavenLocal)
(cd ../sql/iface-java && ./script/compile.sh && ./script/build.sh)
(cd ../spark-extension-entrypoint && ./gradlew publishToMavenLocal)

0 comments on commit 79c0d1f

Please sign in to comment.