Loosen httpx version requirements?

[rohan-mehta]

Right now, in the pyproject.toml, the httpx version is restricted to versions greater or equal to 0.24.1 and less than 0.25.0

httpx = { version = "^0.24.1", extras = ["http2"] }

Wondering if it would be possible to loosen this requirement? Most of the other libraries we depend on (e.g. openai), do something like httpx<1 and >=0.21.0.

Thanks!

[sync-by-unito]

➤ Automation for Jira commented:

The link to the corresponding Jira issue is https://ably.atlassian.net/browse/SDK-4063

[sacOO7]

@rohan-mehta may I know what problem are you facing?

[rohan-mehta]

@sacOO7 a conflict in httpx versions with another library

[sacOO7]

Okay, I need to reproduce this from my side. Can you help me with it? You can create a dummy repo with this library as a dependency and I can try to reproduce from my side.

[sacOO7]

I want to know how python chooses the right library with given configuration. Issue also is that the other library should have been compatible with latest version of httpx

[rohan-mehta]

The other library uses a more recent version of httpx. Here's a minimal repro:
First, create a new virtual env:

mkdir my_project
cd my_project
virtualenv venv
source venv/bin/activate

Then, install this package:

pip install mistralai

Now try installing ably:

pip install ably

And you'll see an error:

...
Installing collected packages: httpcore, httpx, ably
  Attempting uninstall: httpcore
    Found existing installation: httpcore 1.0.2
    Uninstalling httpcore-1.0.2:
      Successfully uninstalled httpcore-1.0.2
  Attempting uninstall: httpx
    Found existing installation: httpx 0.25.2
    Uninstalling httpx-0.25.2:
      Successfully uninstalled httpx-0.25.2
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mistralai 0.0.12 requires httpx<0.26.0,>=0.25.2, but you have httpx 0.24.1 which is incompatible.
Successfully installed ably-2.0.3 httpcore-0.17.3 httpx-0.24.1

[sacOO7]

@rohan-mehta we will look into this 👍

[sacOO7]

Hi @rohan-mehta I feel you should rather use poetry for python project. It does smart package conflict resolution. You can check section Poetry’s Unique Ability to Resolve Dependency Conflicts under poetry-python

[sacOO7]

@rohan-mehta let me know if we have updates on this. I feel getting package-conflicts is common, and choosing best package manager is a best way to go!

[rohan-mehta]

@sac007 poetry doesn't help here - there's a conflict between the libraries, and poetry can't magically solve them. Here's proof:

[tool.poetry.dependencies]
python = "^3.11"
mistralai = "^0.0.12"
ably = "^2.0.3"

poetry install
Updating dependencies
Resolving dependencies... (1.2s)

Because no versions of ably match >2.0.3,<3.0.0
 and ably (2.0.3) depends on httpx (>=0.24.1,<0.25.0), ably (>=2.0.3,<3.0.0) requires httpx (>=0.24.1,<0.25.0).
And because no versions of httpx match >0.24.1,<0.25.0
 and httpx (0.24.1) depends on httpx (0.24.1), ably (>=2.0.3,<3.0.0) requires httpx (0.24.1).
And because mistralai (0.0.12) depends on httpx (>=0.25.2,<0.26.0)
 and no versions of mistralai match >0.0.12,<0.0.13, ably (>=2.0.3,<3.0.0) is incompatible with mistralai (>=0.0.12,<0.0.13).
So, because blah depends on both mistralai (^0.0.12) and ably (^2.0.3), version solving failed.

[sacOO7]

Okay, thanks for the updated @rohan-mehta . We will try to update lib. from our side 👍

[sacOO7]

Hi @rohan-mehta I have created a PR to fix your issue. May I know where are you planning to use the library? Is it a backend rest API? Are you planning to use sync api or async api?

[rohan-mehta]

Yeah using it in my backend, async

[sacOO7]

@rohan-mehta we have merged the fix, we will release the new version soon 👍
Meanwhile do star the repo : )