Skip to content

Refactor test helpers#241

Merged
leynos merged 3 commits intomainfrom
codex/add-shared-helpers-module-for-tests
Aug 3, 2025
Merged

Refactor test helpers#241
leynos merged 3 commits intomainfrom
codex/add-shared-helpers-module-for-tests

Conversation

@leynos
Copy link
Copy Markdown
Owner

@leynos leynos commented Aug 1, 2025

Summary

  • centralize test fixtures in tests/common/mod.rs
  • use common factory and unused_port helpers across tests
  • update preamble and cucumber world to reference the shared module

Testing

  • make lint
  • make test
  • make markdownlint

https://chatgpt.com/codex/tasks/task_e_688bf55eae1c83228070b5d4ae1185f4

Summary by Sourcery

Centralise test fixtures by moving the factory and port-binding helpers into a shared common module and update existing tests to import and use these shared fixtures, removing their local definitions.

Tests:

  • Move factory and unused_port fixtures into tests/common module
  • Update server.rs, preamble.rs, and world.rs to use shared factory and unused_port helpers and remove duplicate code

@sourcery-ai
Copy link
Copy Markdown
Contributor

sourcery-ai Bot commented Aug 1, 2025

Reviewer's Guide

This PR centralizes test fixtures by introducing a shared tests/common module with rstest fixtures (factory and unused_port) and refactors existing server, preamble, and world tests to leverage these shared helpers instead of inline closures and hard-coded port bindings.

File-Level Changes

Change Details Files
Add shared test fixtures
  • create factory rstest fixture returning a WireframeApp factory closure
  • create unused_port rstest fixture binding a TCP listener to port 0 and returning its address
  • centralize these utilities in tests/common/mod.rs
tests/common/mod.rs
Refactor server tests to use common fixtures
  • import common::{factory, unused_port}
  • replace inline WireframeApp closures with factory() calls
  • replace hard-coded socket binds with unused_port()
tests/server.rs
Update preamble and world modules to reference shared fixtures
  • remove local factory fixture in preamble.rs
  • import and use unused_port for binding servers in preamble.rs
  • add mod common import and use unused_port in world.rs
tests/preamble.rs
tests/world.rs

Possibly linked issues


Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Aug 1, 2025

Summary by CodeRabbit

  • New Features

    • Added the ability for the server to bind to an existing TCP listener, providing more flexibility in server setup.
  • Tests

    • Introduced shared test utilities and fixtures for easier and less repetitive test setup.
    • Updated tests to use the new listener-based server binding for improved reliability and consistency.

Walkthrough

Introduce a new bind_listener method to WireframeServer for binding to an existing TCP listener. Refactor integration tests to use shared fixtures for app instantiation and listener creation, replacing direct address binding with listener-based binding. Centralise test utilities in a new common module, updating test modules to use these shared resources.

Changes

Cohort / File(s) Change Summary
Server Listener Enhancement
src/server.rs
Add bind_listener method to WireframeServer, allowing binding to an existing StdTcpListener instead of creating one from a socket address.
Test Utilities and Fixtures
tests/common/mod.rs
Introduce shared fixtures: unused_listener, factory, and unused_port for integration tests, reducing duplication and standardising test setup.
Preamble Test Refactor
tests/preamble.rs
Remove local fixtures, import shared ones from common, and switch server binding from address-based to listener-based using bind_listener.
Server Test Refactor
tests/server.rs
Refactor to use shared factory and unused_listener from common; update server instantiation and binding logic to use the new listener-based approach.
World Test Refactor
tests/world.rs
Import unused_listener from common and update server binding in PanicServer::spawn to use bind_listener with a provided listener instead of a socket address.

Sequence Diagram(s)

sequenceDiagram
    participant Test as Test Module
    participant Common as common/mod.rs
    participant Server as WireframeServer

    Test->>Common: Request unused_listener()
    Common-->>Test: Return StdTcpListener
    Test->>Server: Call bind_listener(listener)
    Server-->>Test: Return server bound to listener
Loading

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~15 minutes

Possibly related PRs

  • Add WireframeServer skeleton #6: Extends WireframeServer with the original bind method; this PR directly complements it by adding bind_listener for existing listeners.

Poem

A server now binds with a listener in hand,
No more hardcoded ports across the test land.
Fixtures unite, duplication takes flight,
Common code shared, the setup feels right.
With a socket in tow, integration flows—
Let the wireframes run, as the test suite grows!

✨ Finishing Touches
  • 📝 Generate Docstrings
🧪 Generate unit tests
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch codex/add-shared-helpers-module-for-tests

🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Explain this complex logic.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai explain this code block.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and explain its main purpose.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR.
  • @coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
  • @coderabbitai generate unit tests to generate unit tests for this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link
Copy Markdown
Contributor

@sourcery-ai sourcery-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @leynos - I've reviewed your changes - here's some feedback:

  • The unused_port helper drops the listener before the server bind, which can introduce a race—consider binding the server directly on the listener or holding it until the server is bound.
Prompt for AI Agents
Please address the comments from this code review:
## Overall Comments
- Consider renaming tests/common to something like tests/fixtures or tests/helpers to make its purpose clearer and avoid ambiguity with other common code.
- The unused_port helper drops the listener before the server bind, which can introduce a race—consider binding the server directly on the listener or holding it until the server is bound.

Sourcery is free for open source - if you like our reviews please consider sharing them ✨
Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.

@leynos
Copy link
Copy Markdown
Owner Author

leynos commented Aug 1, 2025

@coderabbitai review

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Aug 1, 2025

✅ Actions performed

Review triggered.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

Copy link
Copy Markdown

@codescene-delta-analysis codescene-delta-analysis Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Health Improved (1 files improve in Code Health)

Gates Passed
6 Quality Gates Passed

See analysis details in CodeScene

View Improvements
File Code Health Impact Categories Improved
push.rs 9.69 → 10.00 Complex Conditional

Quality Gate Profile: Pay Down Tech Debt
Want more control? Customize Code Health rules or catch issues early with our IDE extension and CLI tool.

@leynos leynos force-pushed the codex/add-shared-helpers-module-for-tests branch from c8611a5 to 802519a Compare August 3, 2025 17:33
Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

📜 Review details

Configuration used: CodeRabbit UI
Review profile: ASSERTIVE
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 03b951b and 802519a.

📒 Files selected for processing (5)
  • src/server.rs (1 hunks)
  • tests/common/mod.rs (1 hunks)
  • tests/preamble.rs (2 hunks)
  • tests/server.rs (2 hunks)
  • tests/world.rs (2 hunks)
🧰 Additional context used
📓 Path-based instructions (1)
**/*.rs

📄 CodeRabbit Inference Engine (AGENTS.md)

**/*.rs: Function documentation must include clear examples demonstrating the usage and outcome of the function. Test documentation should omit examples where the example serves only to reiterate the test logic.
No single code file may be longer than 400 lines. Long switch statements or dispatch tables should be broken up by feature and constituents colocated with targets. Large blocks of test data should be moved to external data files.
Clippy warnings MUST be disallowed.
Fix any warnings emitted during tests in the code itself rather than silencing them.
Where a function is too long, extract meaningfully named helper functions adhering to separation of concerns and CQRS.
Where a function has too many parameters, group related parameters in meaningfully named structs.
Where a function is returning a large error consider using Arc to reduce the amount of data returned.
Write unit and behavioural tests for new functionality. Run both before and after making any change.
Every module must begin with a module level (//! ) comment explaining the module's purpose and utility.
Document public APIs using Rustdoc comments (///) so documentation can be generated with cargo doc.
Prefer immutable data and avoid unnecessary mut bindings.
Handle errors with the Result type instead of panicking where feasible.
Avoid unsafe code unless absolutely necessary and document any usage clearly.
Place function attributes after doc comments.
Do not use return in single-line functions.
Use predicate functions for conditional criteria with more than two branches.
Lints must not be silenced except as a last resort.
Lint rule suppressions must be tightly scoped and include a clear reason.
Prefer expect over allow.
Prefer .expect() over .unwrap().
Use concat!() to combine long string literals rather than escaping newlines with a backslash.
Prefer semantic error enums. Derive std::error::Error (via the thiserror crate) for any condition the caller might inspect, retry, or map to an HTTP status....

Files:

  • tests/server.rs
  • src/server.rs
  • tests/world.rs
  • tests/preamble.rs
  • tests/common/mod.rs

⚙️ CodeRabbit Configuration File

**/*.rs: * Seek to keep the cyclomatic complexity of functions no more than 12.

  • Adhere to single responsibility and CQRS

  • Place function attributes after doc comments.

  • Do not use return in single-line functions.

  • Move conditionals with >2 branches into a predicate function.

  • Avoid unsafe unless absolutely necessary.

  • Every module must begin with a //! doc comment that explains the module's purpose and utility.

  • Comments and docs must follow en-GB-oxendict (-ize / -our) spelling and grammar

  • Lints must not be silenced except as a last resort.

    • #[allow] is forbidden.
    • Only narrowly scoped #[expect(lint, reason = "...")] is allowed.
    • No lint groups, no blanket or file-wide suppression.
    • Include FIXME: with link if a fix is expected.
  • Use rstest fixtures for shared setup and to avoid repetition between tests.

  • Replace duplicated tests with #[rstest(...)] parameterised cases.

  • Prefer mockall for mocks/stubs.

  • Prefer .expect() over .unwrap()

  • Ensure that any API or behavioural changes are reflected in the documentation in docs/

  • Ensure that any completed roadmap steps are recorded in the appropriate roadmap in docs/

  • Files must not exceed 400 lines in length

    • Large modules must be decomposed
    • Long match statements or dispatch tables should be decomposed by domain and collocated with targets
    • Large blocks of inline data (e.g., test fixtures, constants or templates) must be moved to external files and inlined at compile-time or loaded at run-time.

Files:

  • tests/server.rs
  • src/server.rs
  • tests/world.rs
  • tests/preamble.rs
  • tests/common/mod.rs
🧬 Code Graph Analysis (3)
tests/server.rs (1)
tests/common/mod.rs (2)
  • factory (22-24)
  • unused_listener (9-12)
tests/world.rs (1)
tests/common/mod.rs (1)
  • unused_listener (9-12)
tests/preamble.rs (1)
tests/common/mod.rs (2)
  • factory (22-24)
  • unused_listener (9-12)
⏰ Context from checks skipped due to timeout of 240000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: build-test
🔇 Additional comments (9)
tests/world.rs (2)

12-14: Excellent refactoring to use shared test utilities.

The import of unused_listener from the common module properly centralises test setup and eliminates hardcoded addresses.


31-35: Proper implementation of listener-based binding.

The switch from .bind("127.0.0.1:0") to using unused_listener() with .bind_listener() correctly utilises the new server method whilst maintaining the same functional behaviour.

tests/preamble.rs (1)

7-8: Good refactoring to shared test utilities.

Using the common module's factory and unused_listener properly eliminates code duplication across test files.

src/server.rs (1)

277-286: Well-implemented listener binding method.

The bind_listener method properly mirrors the existing bind method's pattern whilst accepting a pre-created listener. The error handling and non-blocking configuration are correctly implemented.

tests/common/mod.rs (3)

1-4: Excellent module documentation.

The module comment clearly explains the purpose and utility of the shared test fixtures, following the coding guidelines requirement for module-level documentation.


8-12: Clean implementation of unused listener utility.

The function correctly binds to localhost with an ephemeral port (0) and handles the binding error appropriately.


17-24: Proper rstest fixture implementation.

The factory fixture correctly returns a closure that creates WireframeApp instances, and the allow attribute is properly justified for the rustc false positive.

tests/server.rs (2)

3-4: Good adoption of shared test utilities.

Importing and using the common module's factory and unused_listener properly eliminates duplication of test setup code.


9-9: Consistent refactoring to shared factory.

All test functions now properly use the shared factory() instead of inline WireframeApp::new() closures, improving consistency across the test suite.

Also applies to: 16-16, 22-22, 28-28, 44-44

Comment thread tests/common/mod.rs
Comment on lines +26 to +35
#[fixture]
#[allow(
unused_braces,
reason = "rustc false positive for single line rstest fixtures"
)]
pub fn unused_port() -> SocketAddr {
unused_listener()
.local_addr()
.expect("failed to obtain local addr")
}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Potential race condition in unused_port fixture.

The unused_port fixture creates a listener, extracts its address, then drops the listener. This introduces a race condition where another process could bind to the same port before the test uses it.

Replace the fixture with direct usage of unused_listener() in tests that need a bound listener, or ensure the listener remains alive until the test binds to it.

-#[fixture]
-#[allow(
-    unused_braces,
-    reason = "rustc false positive for single line rstest fixtures"
-)]
-pub fn unused_port() -> SocketAddr {
-    unused_listener()
-        .local_addr()
-        .expect("failed to obtain local addr")
-}

Committable suggestion skipped: line range outside the PR's diff.

🤖 Prompt for AI Agents
In tests/common/mod.rs around lines 26 to 35, the unused_port fixture creates a
listener, extracts its address, and then drops the listener, causing a race
condition where the port may be taken before use. To fix this, modify tests to
use unused_listener() directly so the listener stays alive during the test, or
change the fixture to return the listener itself instead of just the address,
ensuring the port remains bound until the test completes.

Comment thread tests/preamble.rs
Comment on lines +68 to +70
let listener = unused_listener();
let _addr = listener.local_addr().expect("addr");
let server = server.bind_listener(listener).expect("bind");
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick (assertive)

Remove unused variable assignment.

Line 69 assigns listener.local_addr() to _addr but this value is never used. The actual server address is obtained from server.local_addr() on line 71.

-    let listener = unused_listener();
-    let _addr = listener.local_addr().expect("addr");
-    let server = server.bind_listener(listener).expect("bind");
+    let listener = unused_listener();
+    let server = server.bind_listener(listener).expect("bind");
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
let listener = unused_listener();
let _addr = listener.local_addr().expect("addr");
let server = server.bind_listener(listener).expect("bind");
let listener = unused_listener();
let server = server.bind_listener(listener).expect("bind");
🤖 Prompt for AI Agents
In tests/preamble.rs around lines 68 to 70, the variable _addr is assigned the
value of listener.local_addr() but never used. Remove the assignment to _addr on
line 69 to eliminate the unused variable, since the server address is correctly
obtained later from server.local_addr().

Comment thread tests/server.rs
Comment on lines +42 to +47
let listener = unused_listener();
let _addr = listener.local_addr().unwrap();
let server = WireframeServer::new(factory())
.workers(1)
.bind(
"127.0.0.1:0"
.parse()
.expect("hard-coded socket address must be valid"),
)
.expect("bind failed");
.bind_listener(listener)
.unwrap();
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick (assertive)

Remove unused variable assignment.

Line 43 assigns listener.local_addr() to _addr but this value is never used. The server address is obtained from server.local_addr() on line 49.

-    let listener = unused_listener();
-    let _addr = listener.local_addr().unwrap();
-    let server = WireframeServer::new(factory())
+    let listener = unused_listener();
+    let server = WireframeServer::new(factory())
         .workers(1)
         .bind_listener(listener)
-        .unwrap();
+        .unwrap();
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
let listener = unused_listener();
let _addr = listener.local_addr().unwrap();
let server = WireframeServer::new(factory())
.workers(1)
.bind(
"127.0.0.1:0"
.parse()
.expect("hard-coded socket address must be valid"),
)
.expect("bind failed");
.bind_listener(listener)
.unwrap();
let listener = unused_listener();
let server = WireframeServer::new(factory())
.workers(1)
.bind_listener(listener)
.unwrap();
🤖 Prompt for AI Agents
In tests/server.rs around lines 42 to 47, the variable _addr is assigned the
value of listener.local_addr() but is never used later. Remove the assignment to
_addr on line 43 to clean up the code, as the server address is correctly
obtained from server.local_addr() on line 49.

@leynos leynos merged commit e6fff3c into main Aug 3, 2025
5 checks passed
@leynos leynos deleted the codex/add-shared-helpers-module-for-tests branch August 3, 2025 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant