Skip to content

Conversation

@ObadaS
Copy link
Collaborator

@ObadaS ObadaS commented Sep 19, 2024

@ mention of reviewers

@bbearce @Didayolo

A brief description of the purpose of the changes contained in this PR.

This should fix the recent poetry python error.
I also added a fixed version on the poetry installation script, instead of using the latest one (for now it is the latest one though)

Issues this PR resolves

#1586

Checklist

  • Code review by me
  • Hand tested by me
  • I'm proud of my work
  • Code review by reviewer
  • Hand tested by reviewer
  • CircleCi tests are passing
  • Ready to merge

@ObadaS
Copy link
Collaborator Author

ObadaS commented Sep 19, 2024

The site_worker is shutting down as soon as it launches :

2024-09-19 07:57:58,855: CRITICAL/MainProcess] Unrecoverable error: TypeError('_unpack_version() takes from 1 to 5 positional arguments but 6 were given')
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/celery/worker/worker.py", line 205, in start
    self.blueprint.start(self)
  File "/usr/local/lib/python3.9/site-packages/celery/bootsteps.py", line 119, in start
    step.start(parent)
  File "/usr/local/lib/python3.9/site-packages/celery/bootsteps.py", line 369, in start
    return self.obj.start()
  File "/usr/local/lib/python3.9/site-packages/celery/worker/consumer/consumer.py", line 317, in start
    blueprint.start(self)
  File "/usr/local/lib/python3.9/site-packages/celery/bootsteps.py", line 119, in start
    step.start(parent)
  File "/usr/local/lib/python3.9/site-packages/celery/worker/consumer/tasks.py", line 33, in start
    qos_global = not c.connection.qos_semantics_matches_spec
  File "/usr/local/lib/python3.9/site-packages/kombu/connection.py", line 833, in qos_semantics_matches_spec
    return self.transport.qos_semantics_matches_spec(self.connection)
  File "/usr/local/lib/python3.9/site-packages/kombu/transport/pyamqp.py", line 154, in qos_semantics_matches_spec
    return version_string_as_tuple(props['version']) < (3, 3)
  File "/usr/local/lib/python3.9/site-packages/kombu/utils/text.py", line 49, in version_string_as_tuple
    v = _unpack_version(*s.split('.'))
TypeError: _unpack_version() takes from 1 to 5 positional arguments but 6 were given
[2024-09-19 07:57:58,856: INFO/MainProcess] beat: Shutting down...

@ObadaS
Copy link
Collaborator Author

ObadaS commented Sep 19, 2024

It seems like the latest version of RabbitMQ produces the bug mentioned above.
Switching to the previous version, by using rabbitmq:3.13.7-management instead of rabbitmq:management fixes the problem.

Shouldn't we be using static versions instead of a "special" latest ?

@Didayolo Didayolo self-assigned this Sep 26, 2024
@Didayolo Didayolo linked an issue Sep 26, 2024 that may be closed by this pull request
@Didayolo
Copy link
Member

Didayolo commented Oct 1, 2024

@ObadaS

codabench-rabbit-1          | BOOT FAILED
codabench-rabbit-1          | ===========
codabench-rabbit-1          | Error during startup: {error,failed_to_initialize_feature_flags_registry}
codabench-rabbit-1          | 
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>   crasher:
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     initial call: application_master:init/4
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     pid: <0.253.0>
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     registered_name: []
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     exception exit: {failed_to_initialize_feature_flags_registry,
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>                         {rabbit,start,[normal,[]]}}
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>       in function  application_master:init/4 (application_master.erl, line 142)
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     ancestors: [<0.252.0>]
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     message_queue_len: 1
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     messages: [{'EXIT',<0.254.0>,normal}]
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     links: [<0.252.0>,<0.44.0>]
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     dictionary: []
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     trap_exit: true
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     status: running
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     heap_size: 376
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     stack_size: 28
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>     reductions: 169
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0>   neighbours:
codabench-rabbit-1          | 2024-10-01 15:58:05.527981+00:00 [error] <0.253.0> 
codabench-rabbit-1          | 2024-10-01 15:58:05.538831+00:00 [notice] <0.44.0> Application rabbit exited with reason: {failed_to_initialize_feature_flags_registry,{rabbit,start,[normal,[]]}}
codabench-rabbit-1          | Runtime terminating during boot (terminating)
codabench-rabbit-1          | 
codabench-rabbit-1          | Crash dump is being written to: erl_crash.dump...[os_mon] cpu supervisor port (cpu_sup): Erlang has closed
codabench-rabbit-1          | [os_mon] memory supervisor port (memsup): Erlang has closed
codabench-rabbit-1          | =INFO REPORT==== 1-Oct-2024::15:58:07.048064 ===
codabench-rabbit-1          |     alarm_handler: {set,{{disk_almost_full,"/var/lib/rabbitmq"},[]}}
codabench-rabbit-1          | =INFO REPORT==== 1-Oct-2024::15:58:07.051311 ===
codabench-rabbit-1          |     alarm_handler: {set,{system_memory_high_watermark,[]}}
codabench-site_worker-1     | [2024-10-01 15:58:07,249: ERROR/Beat] beat: Connection error: [Errno 111] Connection refused. Trying again in 10.0 seconds...
codabench-compute_worker-1  | [2024-10-01 15:58:07,491: ERROR/MainProcess] consumer: Cannot connect to amqp://rabbit-username:**@rabbit:5672//: [Errno 111] Connection refused.
codabench-compute_worker-1  | Trying again in 8.00 seconds...
codabench-compute_worker-1  | 

@Didayolo Didayolo merged commit 0b4f0a2 into develop Oct 1, 2024
@Didayolo Didayolo deleted the poetryFix branch October 1, 2024 16:20
Didayolo added a commit that referenced this pull request Oct 1, 2024
Didayolo added a commit that referenced this pull request Oct 1, 2024
Didayolo added a commit that referenced this pull request Oct 1, 2024
Didayolo added a commit that referenced this pull request Oct 1, 2024
Didayolo added a commit that referenced this pull request Oct 1, 2024
Didayolo added a commit that referenced this pull request Oct 11, 2024
* autorun collectstatic when django container starts, added caddy_data and caddy_config to gitignore

* programs and datasets bug fixed

* if condition format fixed

* Downloading submissions witha stream v1

* updated toml file with python version and bpython version, deleted lock file, update dockerfile to not copy lock file and to generate lock file in the docker build

* Change base image for Dockerfile.flower (#1520)

* Change base image for Dockerfile.flower

* Remove platform argument

* Resources bundles dumps (#1505)

* Add a Bundles tab in Resources view

* add dump single and multiple deletion mechanism

* add competition title in bundle name + add competition link in bundle resource tab

* Update datasets.py (flake8)

---------

Co-authored-by: OhMaley <tristanmary2@gmail.com>
Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* Improve formatting

* leaderboard api 500 error resolved (#1527)

* leaderboard api 500 error resolved

* flake issues resolved

* Changed submission name to add ID when downloading many submissions (#1565)

* changed submission name to add ID

* Flake8 white space fix

---------

Co-authored-by: Nicolas HOMBERG <nicolashomberg@gricad-nh.u-ga.fr>

* Server Status:  submissions limit removed (#1562)

* server status submissions limit removed, pagination added, monitor queues separated

* renamed server status title to recent submissions

* Email template fixes (#1567)

* email logo fixed, some changes in email text

* participant side email templates updated

* task dataset/program removal fixed

* Updated docker-compose to docker compose

* whiltelist emails leaking fixed (#1560)

* competition whitelist feature added

* updated whitelist

* Update whitelist note

* whiltelist emails leaking fixed

* Remove conflict

---------

Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* Updates to server_status and monitor_queues (#1568)

* server_status and monitor_queues pages secured

* Update monitor_queues.html

* [Feature] Delete orphan files (#1575)

* Add button for orphan files deletion + API routes and views

* Fix flake8 formatting

---------

Co-authored-by: OhMaley <tristanmary2@gmail.com>

* Fix string concat in case of no email in analytics api

* Poetry error tentative fix (#1588)

* Poetry error tentative fix

* RabbitMQ static image in Dockerfile.rabbitmq to fix a recent bug

* Reverted RabbitMQ image change

* Fix Rabbit version

---------

Co-authored-by: Obada Haddad <obada.haddad@lisn.fr>
Co-authored-by: didayolo <adrien.pavao@gmail.com>

* `Release PR#1` - Display release version in Codabench footer (#1583)

* release version added to header

* version moved to footer

* Minor UI change

---------

Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* `Release PR#2` Release version will load dynamically from version.json (#1592)

* release version added to header

* version moved to footer

* version on the website is now dynamic and will be loaded from the version.json file

---------

Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* `Release PR#3` created workflow for new releases (#1584)

* created workflow for new releases

* version json file added

* typo fix

* Update release-version-update.yml

* Included realease url to navigate user to the url on click on the website

* release json updated

---------

Co-authored-by: Obada Haddad <obada.haddad@lisn.fr>
Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* Updates Sept 15-22 2024 (#1593)

* jinja and pillow

* jinja and pillow

* Adding Versino_Bump_Instruction_README

* Version_Bumps file

* Version_Bumps file and req_treeFile updates

* gunicorn from 20.0.4 to 22.0.0

* Bump requests from 2.20.0 to 2.32.2

* Bump django from 2.2.17 to 2.2.18

* Bump django from 2.2.18 to 2.2.19 and to 3.2.25 eventually

* Bump django from 2.2.19 to 2.2.20

* Bump django from 2.2.20 to 2.2.25

* Bump django from 2.2.25 to 2.2.28

* Bump django from 2.2.25 to 2.2.28

* Version_Bumps.md text

* Update Dockerfile (upgrade Python)

* checking in some outstanding changes

* Remove Version Bumps

* removing version bumbs

---------

Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* organizers can now delete forum posts (#1613)

Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

* bundles renamed to competition bundles, swapped postions of bundles and tasks (#1591)

Co-authored-by: Adrien Pavão <adrien.pavao@gmail.com>

---------

Co-authored-by: Ihsan Ullah <ihsan2131@gmail.com>
Co-authored-by: Nicolas HOMBERG <nicolashomberg@gricad-nh.u-ga.fr>
Co-authored-by: OhMaley <tristanmary2@gmail.com>
Co-authored-by: Obada Haddad <obada.haddad@lisn.fr>
Co-authored-by: Obada Haddad-Soussac <osobada.03@hotmail.fr>
Co-authored-by: Benjamin Bearce <bbearce@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Poetry.lock python version error when building codabench

4 participants