Incompatible dependancies

[PauloHLemos]

I'm trying to get this repo up and running, but am getting incompatible dependencies, which I think are causing errors later on when trying to run the demo.

When trying to install vllm I get:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
blis 1.0.1 requires numpy<3.0.0,>=2.0.0, but you have numpy 1.26.4 which is incompatible.
thinc 8.3.2 requires numpy<2.1.0,>=2.0.0; python_version >= "3.9", but you have numpy 1.26.4 which is incompatible.

But these packages require an incompatible version of numpy:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
outlines 0.0.46 requires numpy<2.0.0, but you have numpy 2.1.0 which is incompatible.
vllm 0.6.3.post1 requires numpy<2.0.0, but you have numpy 2.1.0 which is incompatible.

I may be missing something really basic, but I've been stuck on this.
Any help is appreciated, thanks!

[PauloHLemos]

Edit: even though there's some incompatibilities, I got it running w numpy 1.26.4. I solved my issue by setting these flags explicitly:
export MKL_THREADING_LAYER=GNU and export MKL_SERVICE_FORCE_INTEL=True
solving an issue between MKL’s threading and libgomp.

(leaving it here in case it helps someone else)

[DaoD]

Thanks!

We also observe the package version conflict problem. Thanks for sharing your solution! We will try to fix it as soon as possible.

Best,
Z.