Exported requirements.txt does not include --extra-index-url

[fredrikaverpil]

• I am on the latest Poetry version.

• I have searched the issues of this repo and believe that this is not a duplicate.

• OS version and name: RHEL Linux 7.6, Python 3.7.4

• Poetry version: 1.0.9

Issue

I think I found a bug...
I have two internal repos (the second one requries credentials which I have stored in my pyproject.toml):

[[tool.poetry.source]]
name = "internal-mirror"
url = "https://server/artifactory/api/pypi/pypi-remote/simple"
default = true

[[tool.poetry.source]]
name = "myproject"
url = "https://server/artifactory/api/pypi/myproject-pypi-local/simple"
secondary = true

Poetry successfully installs using both repos, nice!
But when I export to requirements.txt, I only get the --index-url and not the --extra-index-url definitions, which makes this requirements file incomplete and pip is unable to find my secondary repo:

$ poetry export --format requirements.txt --without-hashes --output requirements.txt

--index-url https://server/artifactory/api/pypi/pypi-remote/simple

myproject==3.1.7

To me, this looks like a bug. I would expect that the --extra-index-url would also appear in the exported requirements.txt file, right?

[klintan]

I have a similar issue: running poetry export --without-hashes -f requirements.txt -o requirements.txt --with-credentials manually, and then using usePoetry: false it works, and my private secondary repo is defined like so in pyproject.toml

[[tool.poetry.source]]
name = "team-***"
url = "https://***.io/***/api/pypi/team-***/simple"
secondary = true

however it seems it doesn't export it correctly in the python-serverless poetry (or at least if using poetry directly it fails:

  Error: STDOUT: Looking in indexes: https://pypi.org/simple, https://***.jfrog.io/***/api/pypi/team-***/simple
  User for ***.jfrog.io:

  STDERR: ERROR: Exception:
  Traceback (most recent call last):
    File "/.pyenv/versions/3.7.8/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main

similar to what it says here:
pypa/pip#6318 however that is obviously not the issue since /simple is already added. It starts the interactive prompt so obviously it seems the basic-auth are not added.

The config is added to poetry config repositories etc, and again looking at the manually exported requirements.txt the index looks fine

--extra-index-url https://<username>:<password>@***.jfrog.io/***/api/pypi/team-***/simple

boto3==1.14.34; python_full_version >= "3.6.10" and python_full_version < "4.0.0"
botocore==1.17.44; python_full_version >= "3.6.10" and python_full_version < "4.0.0"
certifi==2020.6.20; python_full_version >= "3.6.10" and python_full_version < "4.0.0"
... etc

Any ideas ? (Let me know if you think I should create a separate issue for this, just thought it sounded like it could be related or if this is just about the secondary added index)

[sinoroc]

For the original ticket: @fredrikaverpil Does python-poetry/poetry#3251 or python-poetry/poetry#2640 change anything for that use case?

---

For @klintan I would say it belongs in a different ticket.

[fredrikaverpil]

@sinoroc hm, not sure really...

[klintan]

For the original ticket: @fredrikaverpil Does python-poetry/poetry#3251 or python-poetry/poetry#2640 change anything for that use case?

For @klintan I would say it belongs in a different ticket.

Ok I'll create new separate ticket for this.

[mikegit21]

Is this problem solved? I still have the same problem

[ejd]

I believe this is due to a bug here:

poetry-plugin-export/src/poetry_plugin_export/exporter.py

Line 170 in bb1264c

indexes_header = f"--index-url {url}\n"

This should instead be:

indexes_header += f"--index-url {url}\n"

(note the += instead of =)

Explanation:

Exporter._export_requirements_txt() finds the index URLs for all dependencies and iterates over them in sorted order to generate the --index-url and --extra-index-url lines of export output. In @fredrikaverpil 's case, the list of sorted indexes is:

['https://server/artifactory/api/pypi/myproject-pypi-local/simple', 'https://server/artifactory/api/pypi/pypi-remote/simple']

The method does append an --extra-index-url to indexes_header for the first repository (the secondary one with credentials) via this line:

poetry-plugin-export/src/poetry_plugin_export/exporter.py

Line 181 in bb1264c

indexes_header += f"--extra-index-url {url}\n"

But when the method handles the second repository, the default one, indexes_header gets overwritten due the problematic line I pointed out above.