Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dependency conflict with recent dbt versions #63

Open
Terroface opened this issue Oct 9, 2023 · 3 comments
Open

dependency conflict with recent dbt versions #63

Terroface opened this issue Oct 9, 2023 · 3 comments

Comments

@Terroface
Copy link
Collaborator

If you try to install these two package versions

dbt-snowflake==1.6.4
droughty==0.10.1

then you get this error.

image
@LewisCharlesBaker
Copy link
Collaborator

@Terroface This should be sorted with the last PR. Could you validate your side?

@Terroface
Copy link
Collaborator Author

Unfortunately it didn't work with the latest version of dbt-snowflake
image

I tested this in a brand new venv using python 3.11 with the following commands

pip3 install dbt-snowflake
time pip3 install droughty

full error:

Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [56 lines of output]
      /private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/Cython/Compiler/Main.py:381: FutureWarning: Cython directive 'language_level' not set, using '3str' for now (Py3). This has changed from earlier releases! File: /private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-install-x7kzxhli/pylbfgs_9cbbf6e6442f4573aed135d0ea76d308/lbfgs/_lowlevel.pyx
        tree = Parsing.p_module(s, pxd, full_module_name)
      
      Error compiling Cython file:
      ------------------------------------------------------------
      ...
      
              x_a = aligned_copy(x0.ravel())
      
              try:
                  callback_data = (f, progress, x0.shape, args)
                  r = lbfgs(n, x_a, fx_final, call_eval,
                                              ^
      ------------------------------------------------------------
      
      lbfgs/_lowlevel.pyx:395:40: Cannot assign type 'lbfgsfloatval_t (void *, lbfgsconst_p, lbfgsfloatval_t *, int, lbfgsfloatval_t) except? -1' to 'lbfgs_evaluate_t'. Exception values are incompatible. Suggest adding 'noexcept' to type 'lbfgsfloatval_t (void *, lbfgsconst_p, lbfgsfloatval_t *, int, lbfgsfloatval_t) except? -1'.
      
      Error compiling Cython file:
      ------------------------------------------------------------
      ...
              x_a = aligned_copy(x0.ravel())
      
              try:
                  callback_data = (f, progress, x0.shape, args)
                  r = lbfgs(n, x_a, fx_final, call_eval,
                            call_progress, <void *>callback_data, &self.params)
                            ^
      ------------------------------------------------------------
      
      lbfgs/_lowlevel.pyx:396:22: Cannot assign type 'int (void *, lbfgsconst_p, lbfgsconst_p, lbfgsfloatval_t, lbfgsfloatval_t, lbfgsfloatval_t, lbfgsfloatval_t, int, int, int) except? -1' to 'lbfgs_progress_t'. Exception values are incompatible. Suggest adding 'noexcept' to type 'int (void *, lbfgsconst_p, lbfgsconst_p, lbfgsfloatval_t, lbfgsfloatval_t, lbfgsfloatval_t, lbfgsfloatval_t, int, int, int) except? -1'.
      Compiling lbfgs/_lowlevel.pyx because it changed.
      [1/1] Cythonizing lbfgs/_lowlevel.pyx
      Traceback (most recent call last):
        File "/Users/amir/Clients/osprey_charging/analytics/.venv3.11_temp/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/Users/amir/Clients/osprey_charging/analytics/.venv3.11_temp/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/amir/Clients/osprey_charging/analytics/.venv3.11_temp/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 325, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 295, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 480, in run_setup
          super(_BuildMetaLegacyBackend, self).run_setup(setup_script=setup_script)
        File "/private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 311, in run_setup
          exec(code, locals())
        File "<string>", line 27, in <module>
        File "/private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/Cython/Build/Dependencies.py", line 1154, in cythonize
          cythonize_one(*args)
        File "/private/var/folders/fj/mgc8ny3d34q5j809tmmjgpyc0000gn/T/pip-build-env-v2lh58mt/overlay/lib/python3.11/site-packages/Cython/Build/Dependencies.py", line 1321, in cythonize_one
          raise CompileError(None, pyx_file)
      Cython.Compiler.Errors.CompileError: lbfgs/_lowlevel.pyx
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
pip3 install droughty  179.56s user 7.49s system 94% cpu 3:18.28 total

The CLI had some insight.
image

there were quite a few messages like these
image

@KeshavChaurasia
Copy link

@Terroface I am facing similar situation with dbt-core=1.7.3 and droughty==0.10.8. dbt-core has dependency for protobuf > 4 and droughty uses protobuf < 4.0. @LewisCharlesBaker can we loosen up the dependency for droughty and see if we can fix this issue.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants