Skip to content

Add assembly classifier to uber-jar, publish normal jar #956

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

bastewart
Copy link

With this change two dependency jars will be produced instead of the current one.

The current uber-jar will now have a -assembly suffix on the aretefact. In place of the un-classified jar will be a "thin" jar; one with just the spark-excel classes.

This change means end-users can avoid pulling in the uber-jar to environments where it may not be suitable, especially considering the uber-jar contains unshaded dependencies.

Resolves #852

With this change two dependency jars will be produced instead
of the current one.

The current uber-jar will now have a `-assembly` suffix on the
aretefact. In place of the un-classified jar will be a "thin" jar;
one with just the `spark-excel` classes.

This change means end-users can avoid pulling in the uber-jar to
environments where it may not be suitable, especially considering
the uber-jar contains unshaded dependencies.

Resolves nightscape#852
@bastewart
Copy link
Author

I'll update the README and CHANGELOG as requested if this change is OK!

@nightscape
Copy link
Owner

The issue is that spark-submit and spark-shell don't support specifying a classifier, which would make the plugin unusable with those two (see #654 (comment)).
Build tools like Mill, SBT, Maven and Gradle do support classifiers, so there it would not be an issue.
Reversing the logic so that the normal JAR gets a -thin classifier might be an option.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEATURE] Optimize JAR size
2 participants