Migrate BeamlineParameters to use config server #1773

jacob720 · 2025-12-09T10:44:45Z

Fixes DiamondLightSource/mx-bluesky#1504

Required by DiamondLightSource/mx-bluesky#1511

Instructions to reviewer on how to test:

Test beamline parameters files are not read from the file system in dodal

Checks for reviewer

Would the PR title make sense to a scientist on a set of release notes
If a new device has been added does it follow the standards
If changing the API for a pre-existing device, ensure that any beamlines using this device have updated their Bluesky plans accordingly
Have the connection tests for the relevant beamline(s) been run via dodal connect ${BEAMLINE}

codecov · 2026-01-12T16:42:11Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.07%. Comparing base (af74ac0) to head (9517b6a).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1773      +/-   ##
==========================================
- Coverage   99.07%   99.07%   -0.01%     
==========================================
  Files         294      295       +1     
  Lines       11207    11183      -24     
==========================================
- Hits        11103    11079      -24     
  Misses        104      104

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

DominicOram

Thanks, this looks good, some comments in code. This also means that we are now reliant on the config server so I think we need to do DiamondLightSource/mx-bluesky#478 before we put this on the beamline. Would you be able to pick that up and put in a meeting with Neil, Mark, Rob and Myself?

DominicOram · 2026-01-20T08:31:40Z

src/dodal/common/beamlines/beamline_parameters.py

-from dodal.log import LOGGER
 from dodal.utils import get_beamline_name

 BEAMLINE_PARAMETER_KEYWORDS = ["FB", "FULL", "deadtime"]


Should: This list is no longer used, can we remove it?

DominicOram · 2026-01-20T08:34:16Z

src/dodal/common/beamlines/beamline_parameters.py

+        )


 def get_beamline_parameters(beamline_param_path: str | None = None):


Could: This is a bit of scope creep but the way we're doing this is a bit messy. I think we can do it like we do

dodal/src/dodal/beamlines/i03.py

Line 92 in d245f0a

def daq_configuration_path() -> str:

and load it in as part of the beamline file. If that makes sense? Can you either do here or make a new issue?

This makes sense. So when devices need beamline parameters and before would have called get_beamline_parameters(), I'm guessing now they'd be passed in when the device is constructed.

How would this work when we need to get beamline parameters inside common plans? Or should these params always be attached to devices by that point?

So when devices need beamline parameters and before would have called get_beamline_parameters(), I'm guessing now they'd be passed in when the device is constructed.

Yes

How would this work when we need to get beamline parameters inside common plans? Or should these params always be attached to devices by that point?

Yh, that is a bit harder. I think we would need to have a look at it, which maybe means it should be in another issue

Maybe a similar thing can be done for the config server itself? So have a get_config_server() in every ixx.py that returns a config client set up for that beamline

DominicOram · 2026-01-20T08:35:15Z

src/dodal/common/beamlines/beamline_parameters.py

-        return cls(params=dict(config_pairs))
-
    @classmethod
    def from_file(cls, path: str):


Nit: It's a little misleading that this is still called from_file when it's not reading directly from the file

DominicOram · 2026-01-20T08:40:04Z

src/dodal/common/beamlines/beamline_parameters.py

-    @classmethod
-    def parse_value(cls, value: str):
-        return ast.literal_eval(value.replace("Yes", "True").replace("No", "False"))
+        config_server = ConfigServer(url="https://daq-config.diamond.ac.uk")


Should: Can you pull the URL into a constant? From DiamondLightSource/mx-bluesky#478 (comment) it may be that we will need it to be beamline specific too

DominicOram · 2026-01-20T08:59:21Z

tests/conftest.py

+        print(contents)
+        if desired_return_type is str:
+            return contents
+        elif desired_return_type is dict:
+            print("return type is dict")


Should: Remove print statements

DominicOram · 2026-01-20T09:04:37Z

tests/conftest.py

+        elif desired_return_type is dict:
+            print("return type is dict")
+            return json.loads(contents)
+        elif issubclass(desired_return_type, ConfigModel):  # type: ignore


Should: As far as I can see we're never trying to return a ConfigModel so why do we need this bit? Or is it for later PRs?

Yeah this is for later PRs. We either get a dict or a ConfigModel depending on what we request from the server, other config like LUTs or display config will be returned as a subclass of ConfigModel, this fixture emulates that

jacob720 requested a review from a team as a code owner December 9, 2025 10:44

jacob720 marked this pull request as draft December 9, 2025 10:44

jacob720 mentioned this pull request Dec 10, 2025

Read beamline parameters through config server DiamondLightSource/mx-bluesky#1511

Open

1 task

jacob720 marked this pull request as ready for review January 12, 2026 16:45

DominicOram requested changes Jan 20, 2026

View reviewed changes

DominicOram mentioned this pull request Jan 20, 2026

Use config server for undulator config #1768

Open

4 tasks

jacob720 mentioned this pull request Jan 23, 2026

Get beamline params from beamline files #1855

Open

jacob720 added 11 commits January 23, 2026 17:27

Add mock config server fixture

b4dbd8e

Use config server to read beamlineParmaeters

bf08ced

Remove tests for removed functions

91fc322

Convert test beamlineParameters files

386b521

Fix test

acd5805

Fix lint

28b7823

Fix

84f0836

Require latest daq-config-server

afd4fbc

PR comments WIP

2d92790

Parameterise config server URL

e3f6fad

Refactor get_beamline_parameters

3dbb881

jacob720 force-pushed the mx_bluesky_1504_migrate_beamline_parameters_to_config_server branch from c87a30e to 3dbb881 Compare January 23, 2026 17:33

Update lockfile

9517b6a

jacob720 requested a review from DominicOram January 26, 2026 09:59

		)


		def get_beamline_parameters(beamline_param_path: str \| None = None):

Migrate BeamlineParameters to use config server #1773

Are you sure you want to change the base?

Migrate BeamlineParameters to use config server #1773

Uh oh!

Conversation

jacob720 commented Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Instructions to reviewer on how to test:

Checks for reviewer

Uh oh!

codecov bot commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

DominicOram left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jacob720 Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jacob720 commented Dec 9, 2025 •

edited

Loading

codecov bot commented Jan 12, 2026 •

edited

Loading

jacob720 Jan 20, 2026 •

edited

Loading