Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixes for package creation and pip installs #781

Conversation

sfc-gh-jsikorski
Copy link
Contributor

@sfc-gh-jsikorski sfc-gh-jsikorski commented Feb 14, 2024

Pre-review checklist

  • I've confirmed that instructions included in README.md are still correct after my changes in the codebase.
  • I've added or updated automated unit tests to verify correctness of my new code.
  • I've added or updated integration tests to verify correctness of my new code.
  • I've confirmed that my changes are working by executing CLI's commands manually.
  • I've confirmed that my changes are up-to-date with the target branch.
  • I've described my changes in the release notes.
  • I've described my changes in the section below.

Changes description

*Tweaked package creation mechanism in snow snowpark package create - now we check for minimal required version, not the latest installed by pip, to reduce the size of uploaded packages (and problems mentioned in #763)

  • Improved the way we handle packages created from git repo

Fixes: #763 , #122 , #116 (probably was fixed before, but now confirmed)

@sfc-gh-jsikorski sfc-gh-jsikorski changed the title [DRAFT] Fixes for package creation and pip installs Fixes for package creation and pip installs Feb 19, 2024
@sfc-gh-jsikorski sfc-gh-jsikorski requested a review from a team as a code owner March 8, 2024 13:42
@@ -64,7 +73,7 @@ def upload(file: Path, stage: str, overwrite: bool):


def create(zip_name: str):
file_name = zip_name if zip_name.endswith(".zip") else f"{zip_name}.zip"
file_name = f"{get_package_name(zip_name)}.zip"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we moved the .zip suffix to get_package_name function?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

get_package_name is used to extract name, that we will use to resolve dependencies etc. - so for example, takes the name from github repo url, zipname etc. - it seems way too early to add .zip suffix there

@sfc-gh-jsikorski sfc-gh-jsikorski enabled auto-merge (squash) March 11, 2024 15:22
@sfc-gh-jsikorski sfc-gh-jsikorski merged commit 92434f0 into main Mar 11, 2024
10 checks passed
@sfc-gh-jsikorski sfc-gh-jsikorski deleted the jsikorski/SNOW-1053803-fix-anaconda-check-in-install-packages branch March 11, 2024 15:26
sfc-gh-sichen pushed a commit that referenced this pull request Oct 17, 2024
* Added dependencies check to venv

* Problem

* Problem2

* Fixed problem

* Cleanup

* Corrected github installs

* Corrected lib path

* added release notes

* fixes

* fixes

* fixes

* fixes

* Added native libraries option

* Added native libraries option

* Snapshot update

* Snapshot update

* Fixes

* After merge fixes

* Minor

* fixes

* Updates

* Performance update

* Test fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* fixed tests

* fixed tests

* Fixes after review

* Fixes after review

* Fixes

* Fixes

* Fixes

* Fixes

* Fixes

* Fixes

* Fixes

* Fixes

* Replaced deprecated flags

* Replaced deprecated flags

* Replaced deprecated flags

* Replaced deprecated flags

* Fix for encoding

* Fix for encoding

* Fix for encoding

* Fix for encoding

* Fix for encoding

* Started cleaning

* Cleanup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

SNOW-1053803: Second-chance Anaconda run suffers from version lag relative to PyPi
3 participants