Dependency specification
Dependency specification #
Dependencies for a project can be specified in various forms, which depend on the type of the dependency and on the optional constraints that might be needed for it to be installed.
project.dependencies
and tool.poetry.dependencies
#
Prior Poetry 2.0, dependencies had to be declared in the tool.poetry.dependencies
section of the pyproject.toml
file.
[tool.poetry.dependencies]
requests = "^2.13.0"
With Poetry 2.0, you should consider using the project.dependencies
section instead.
[project]
# ...
dependencies = [
"requests (>=2.23.0,<3.0.0)"
]
While dependencies in tool.poetry.dependencies
are specified using toml tables,
dependencies in project.dependencies
are specified as strings according
to PEP 508.
In many cases, tool.poetry.dependencies
can be replaced with project.dependencies
.
However, there are some cases where you might still need to use tool.poetry.dependencies
.
For example, if you want to define additional information that is not required for building
but only for locking (for example an explicit source), you can enrich dependency
information in the tool.poetry
section.
[project]
# ...
dependencies = [
"requests>=2.13.0",
]
[tool.poetry.dependencies]
requests = { source = "private-source" }
When both are specified, project.dependencies
are used for metadata when building the project,
tool.poetry.dependencies
is only used to enrich project.dependencies
for locking.
Alternatively, you can add dependencies
to dynamic
and define your dependencies
completely in the tool.poetry
section. Using only the tool.poetry
section might
make sense in non-package mode when you will not build an sdist or a wheel.
[project]
# ...
dynamic = [ "dependencies" ]
[tool.poetry.dependencies]
requests = { version = ">=2.13.0", source = "private-source" }
tool.poetry.dependencies
are relative path dependencies
since project.dependencies
only support absolute paths.project
section.
Other Dependency groups
must still be specified in the tool.poetry
section.Version constraints #
Compatible release requirements #
Compatible release requirements specify a minimal version with the ability to update to later versions of the same level. For example, if you specify a major, minor, and patch version, only patch-level changes are allowed. If you only specify a major, and minor version, then minor- and patch-level changes are allowed.
~=1.2.3
is an example of a compatible release requirement.
Requirement | Versions allowed |
---|---|
~=1.2.3 | >=1.2.3 <1.3.0 |
~=1.2 | >=1.2.0 <2.0.0 |
Wildcard requirements #
Wildcard requirements allow for the latest (dependency dependent) version where the wildcard is positioned.
*
, 1.*
and 1.2.*
are examples of wildcard requirements.
Requirement | Versions allowed |
---|---|
* | >=0.0.0 |
1.* | >=1.0.0 <2.0.0 |
1.2.* | >=1.2.0 <1.3.0 |
Inequality requirements #
Inequality requirements allow manually specifying a version range or an exact version to depend on.
Here are some examples of inequality requirements:
>= 1.2.0
> 1
< 2
!= 1.2.3
Multiple requirements #
Multiple version requirements can also be separated with a comma, e.g. >= 1.2, < 1.5
.
Exact requirements #
You can specify the exact version of a package.
1.2.3
is an example of an exact version specification.
This will tell Poetry to install this version and this version only. If other dependencies require a different version, the solver will ultimately fail and abort any install or update procedures.
Exact versions can also be specified with ==
according to PEP 440.
==1.2.3
is an example of this.
Caret requirements #
Not supported in project.dependencies
.
When using poetry add
such constraints are automatically converted into an equivalent constraint.
Caret requirements allow SemVer compatible updates to a specified version. An update is allowed if the new version number does not modify the left-most non-zero digit in the major, minor, patch grouping. For instance, if we previously ran poetry add requests@^2.13.0
and wanted to update the library and ran poetry update requests
, poetry would update us to version 2.14.0
if it was available, but would not update us to 3.0.0
. If instead we had specified the version string as ^0.1.13
, poetry would update to 0.1.14
but not 0.2.0
. 0.0.x
is not considered compatible with any other version.
Here are some more examples of caret requirements and the versions that would be allowed with them:
Requirement | Versions allowed |
---|---|
^1.2.3 | >=1.2.3 <2.0.0 |
^1.2 | >=1.2.0 <2.0.0 |
^1 | >=1.0.0 <2.0.0 |
^0.2.3 | >=0.2.3 <0.3.0 |
^0.0.3 | >=0.0.3 <0.0.4 |
^0.0 | >=0.0.0 <0.1.0 |
^0 | >=0.0.0 <1.0.0 |
Tilde requirements #
Not supported in project.dependencies
.
When using poetry add
such constraints are automatically converted into an equivalent constraint.
Tilde requirements specify a minimal version with some ability to update. If you specify a major, minor, and patch version or only a major and minor version, only patch-level changes are allowed. If you only specify a major version, then minor- and patch-level changes are allowed.
~1.2.3
is an example of a tilde requirement.
Requirement | Versions allowed |
---|---|
~1.2.3 | >=1.2.3 <1.3.0 |
~1.2 | >=1.2.0 <1.3.0 |
~1 | >=1.0.0 <2.0.0 |
Using the @
operator #
When adding dependencies via poetry add
, you can use the @
operator.
This is understood similarly to the ==
syntax, but also allows prefixing any
specifiers that are valid in pyproject.toml
. For example:
poetry add "django@^4.0.0"
The above would translate to the following entry in pyproject.toml
:
[project]
# ...
dependencies = [
"django (>=4.0.0,<5.0.0)",
]
The special keyword latest
is also understood by the @
operator:
poetry add django@latest
The above would translate to the following entry in pyproject.toml
, assuming the latest release of django
is 5.1.3
:
[project]
# ...
dependencies = [
"django (>=5.1.3,<6.0.0)",
]
Extras #
Extras and @
can be combined as one might expect (package[extra]@version
):
poetry add django[bcrypt]@^4.0.0
git
dependencies #
To depend on a library located in a git
repository,
the minimum information you need to specify is the location of the repository:
[project]
# ...
dependencies = [
"requests @ git+https://github.com/requests/requests.git",
]
Since we haven’t specified any other information,
Poetry assumes that we intend to use the latest commit on the main
branch
to build our project.
You can explicit specify which branch, commit hash or tagged ref should be usd:
Append the information to the git url.
[project]
# ...
dependencies = [
"requests @ git+https://github.com/requests/requests.git@next",
"flask @ git+https://github.com/pallets/flask.git@38eb5d3b",
"numpy @ git+https://github.com/numpy/numpy.git@v0.13.2",
]
It’s possible to add a package that is located in a subdirectory of the VCS repository.
Provide the subdirectory as a URL fragment similarly to what pip provides.
[project]
# ...
dependencies = [
"subdir_package @ git+https://github.com/myorg/mypackage_with_subdirs.git#subdirectory=subdir"
]
The corresponding add
call looks like this:
poetry add "git+https://github.com/myorg/mypackage_with_subdirs.git#subdirectory=subdir"
To use an SSH connection, for example in the case of private repositories, use the following example syntax:
[project]
# ...
dependencies = [
"pendulum @ git+ssh://git@github.com/sdispater/pendulum.git"
]
To use HTTP basic authentication with your git repositories, you can configure credentials similar to how repository credentials are configured.
poetry config repositories.git-org-project https://github.com/org/project.git
poetry config http-basic.git-org-project username token
poetry add git+https://github.com/org/project.git
The default git client used is Dulwich.
We fall back to legacy system git client implementation in cases where
gitcredentials is used. This fallback will be removed in
a future release where gitcredentials
helpers can be better supported natively.
In cases where you encounter issues with the default implementation, you may wish to explicitly configure the use of the system git client via a shell subprocess call.
poetry config system-git-client true
path
dependencies #
In the project
section, you can only use absolute paths:
[project]
# ...
dependencies = [
"my-package @ file:///absolute/path/to/my-package/dist/my-package-0.1.0.tar.gz"
]
url
dependencies #
url
dependencies are libraries located on a remote archive.
[project]
# ...
dependencies = [
"my-package @ https://example.com/my-package-0.1.0.tar.gz"
]
The corresponding add
call is:
poetry add https://example.com/my-package-0.1.0.tar.gz
Dependency extras
#
You can specify PEP-508 Extras for a dependency as shown here.
[project]
# ...
dependencies = [
"gunicorn[gevent] (>=20.1,<21.0)"
]
extras
.source
dependencies #
project
section.To depend on a package from an alternate repository,
you can use the source
property:
[[tool.poetry.source]]
name = "foo"
url = "https://foo.bar/simple/"
priority = "supplemental"
[tool.poetry.dependencies]
my-cool-package = { version = "*", source = "foo" }
with the corresponding add
call:
poetry add my-cool-package --source foo
foo
to be configured correctly. See using a private repository
for further information.Python restricted dependencies #
You can also specify that a dependency should be installed only for specific Python versions:
[project]
# ...
dependencies = [
"tomli (>=2.0.1,<3.0) ; python_version < '3.11'",
"pathlib2 (>=2.2,<3.0) ; python_version >= '3.9' and python_version < '4.0'"
]
Using environment markers #
If you need more complex install conditions for your dependencies, Poetry supports environment markers:
[project]
# ...
dependencies = [
"pathlib2 (>=2.2,<3.0) ; python_version <= '3.4' or sys_platform == 'win32'"
]
extra
environment marker #
Poetry populates the extra
marker with each of the selected extras of the root package.
For example, consider the following dependency:
[project.optional-dependencies]
paths = [
"pathlib2 (>=2.2,<3.0) ; sys_platform == 'win32'"
]
pathlib2
will be installed when you install your package with --extras paths
on a win32
machine.
Exclusive extras #
The first example will only work completely if you configure Poetry to not re-resolve for installation:
poetry config installer.re-resolve false
This is a new feature of Poetry 2.0 that may become the default in a future version of Poetry.
Keep in mind that all combinations of possible extras available in your project need to be compatible with each other.
This means that in order to use differing or incompatible versions across different combinations, you need to make your
extra markers exclusive. For example, the following installs PyTorch from one source repository with CPU versions
when the cuda
extra is not specified, while the other installs from another repository with a separate version set
for GPUs when the cuda
extra is specified:
[project]
name = "torch-example"
requires-python = ">=3.10"
dependencies = [
"torch (==2.3.1+cpu) ; extra != 'cuda'",
]
[project.optional-dependencies]
cuda = [
"torch (==2.3.1+cu118)",
]
[tool.poetry]
package-mode = false
[tool.poetry.dependencies]
torch = [
{ markers = "extra != 'cuda'", source = "pytorch-cpu"},
{ markers = "extra == 'cuda'", source = "pytorch-cuda"},
]
[[tool.poetry.source]]
name = "pytorch-cpu"
url = "https://download.pytorch.org/whl/cpu"
priority = "explicit"
[[tool.poetry.source]]
name = "pytorch-cuda"
url = "https://download.pytorch.org/whl/cu118"
priority = "explicit"
For the CPU case, we have to specify "extra != 'cuda'"
because the version specified is not compatible with the
GPU (cuda
) version.
This same logic applies when you want either-or extras:
[project]
name = "torch-example"
requires-python = ">=3.10"
[project.optional-dependencies]
cpu = [
"torch (==2.3.1+cpu)",
]
cuda = [
"torch (==2.3.1+cu118)",
]
[tool.poetry]
package-mode = false
[tool.poetry.dependencies]
torch = [
{ markers = "extra == 'cpu' and extra != 'cuda'", source = "pytorch-cpu"},
{ markers = "extra == 'cuda' and extra != 'cpu'", source = "pytorch-cuda"},
]
[[tool.poetry.source]]
name = "pytorch-cpu"
url = "https://download.pytorch.org/whl/cpu"
priority = "explicit"
[[tool.poetry.source]]
name = "pytorch-cuda"
url = "https://download.pytorch.org/whl/cu118"
priority = "explicit"
Multiple constraints dependencies #
Sometimes, one of your dependency may have different version ranges depending on the target Python versions.
Let’s say you have a dependency on the package foo
which is only compatible
with Python 3.6-3.7 up to version 1.9, and compatible with Python 3.8+ from version 2.0:
you would declare it like so:
[project]
# ...
dependencies = [
"foo (<=1.9) ; python_version >= '3.6' and python_version < '3.8'",
"foo (>=2.0,<3.0) ; python_version >= '3.8'"
]
python
)
otherwise it will cause an error when resolving dependencies.Combining git / url / path dependencies with source repositories #
Direct origin (git
/ url
/ path
) dependencies can satisfy the requirement of a dependency that
doesn’t explicitly specify a source, even when mutually exclusive markers are used. For instance
in the following example the url package will also be a valid solution for the second requirement:
foo = [
{ platform = "darwin", url = "https://example.com/example-1.0-py3-none-any.whl" },
{ platform = "linux", version = "^1.0" },
]
Sometimes you may instead want to use a direct origin dependency for specific conditions
(i.e. a compiled package that is not available on PyPI for a certain platform/architecture) while
falling back on source repositories in other cases. In this case you should explicitly ask for your
dependency to be satisfied by another source
. For example:
foo = [
{ platform = "darwin", url = "https://example.com/foo-1.0.0-py3-none-macosx_11_0_arm64.whl" },
{ platform = "linux", version = "^1.0", source = "pypi" },
]
Expanded dependency specification syntax #
In the case of more complex dependency specifications, you may find that you end up with lines which are very long and difficult to read. In these cases, you can shift from using “inline table” syntax, to the “standard table” syntax.
An example where this might be useful is the following:
[tool.poetry.group.dev.dependencies]
black = {version = "19.10b0", allow-prereleases = true, python = "^3.7", markers = "platform_python_implementation == 'CPython'"}
As a single line, this is a lot to digest. To make this a bit easier to work with, you can do the following:
[tool.poetry.group.dev.dependencies.black]
version = "19.10b0"
allow-prereleases = true
python = "^3.7"
markers = "platform_python_implementation == 'CPython'"
The same information is still present, and ends up providing the exact same specification. It’s simply split into multiple, slightly more readable, lines.
Handling of pre-releases #
Per default, Poetry will prefer stable releases and only choose a pre-release if no stable release satisfies a version constraint. In some cases, this may result in a solution containing pre-releases even if another solution without pre-releases exists.
If you want to disallow pre-releases for a specific dependency,
you can set allow-prereleases
to false
. In this case, dependency resolution will
fail if there is no solution without choosing a pre-release.
If you want to prefer the latest version of a dependency even if it is a pre-release,
you can set allow-prereleases
to true
so that Poetry makes no distinction
between stable and pre-release versions during dependency resolution.