Skip to content

Replace connection panic integration test with unit test#296

Merged
leynos merged 3 commits intomainfrom
codex/replace-async-test-with-unit-test
Aug 12, 2025
Merged

Replace connection panic integration test with unit test#296
leynos merged 3 commits intomainfrom
codex/replace-async-test-with-unit-test

Conversation

@leynos
Copy link
Copy Markdown
Owner

@leynos leynos commented Aug 9, 2025

Summary

  • remove TCP-heavy test for connection panic metrics
  • add focused unit test ensuring inc_connection_panics increments the panic counter

Testing

  • make fmt
  • make lint
  • make test

https://chatgpt.com/codex/tasks/task_e_689686c68b6c8322834b0fa5f6723cb3

Summary by Sourcery

Tests:

  • Replace the TCP-based connection panic integration test with a focused unit test that installs a debugging recorder, calls inc_connection_panics, and asserts the counter increments

@sourcery-ai
Copy link
Copy Markdown
Contributor

sourcery-ai Bot commented Aug 9, 2025

Reviewer's guide (collapsed on small PRs)

Reviewer's Guide

This PR replaces the heavy TCP-based integration test for connection panics with a concise unit test that directly invokes the inc_connection_panics function and asserts the counter increments.

Class diagram for updated connection panic metric test

classDiagram
    class TestModule {
        +test_connection_panic_metric_increments() [REMOVED]
        +test_inc_connection_panics_increments_counter() [ADDED]
    }
    class DebuggingRecorder {
        +new()
        +install()
        +snapshotter()
    }
    class WireframeApp {
        +on_connection_setup()
    }
    class TaskTracker {
        +new()
        +close()
        +wait()
    }
    TestModule --> DebuggingRecorder : used in removed test
    TestModule --> WireframeApp : used in removed test
    TestModule --> TaskTracker : used in removed test
Loading

Flow diagram for simplified connection panic metric test

flowchart TD
    A[Start unit test] --> B[Call inc_connection_panics]
    B --> C[Assert counter incremented]
    C --> D[Test complete]
Loading

File-Level Changes

Change Details Files
Removed TCP-based integration test for connection panic metrics
  • Deleted the connection_panic_metric_increments integration test function
  • Removed related DebuggingRecorder import and TaskTracker setup
src/server/connection.rs
Added focused unit test for inc_connection_panics
  • Renamed test to inc_connection_panics_increments_counter
  • Set up DebuggingRecorder, invoked inc_connection_panics directly
  • Asserted that the CONNECTION_PANICS counter equals one
tests/metrics.rs

Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Aug 9, 2025

Note

Other AI code review bot(s) detected

CodeRabbit has detected other AI code review bot(s) in this pull request and will avoid duplicating their findings in the review comments. This may lead to a less comprehensive review.

Warning

Rate limit exceeded

@leynos has exceeded the limit for the number of commits or files that can be reviewed per hour. Please wait 8 minutes and 49 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

📥 Commits

Reviewing files that changed from the base of the PR and between b49923a and ac08b14.

📒 Files selected for processing (1)
  • tests/metrics.rs (2 hunks)

Summary by CodeRabbit

  • Tests
    • Improved and renamed the test for incrementing the connection panic counter.
    • Added a new test to verify the connection panic counter accumulates with multiple calls.

Walkthrough

Remove the connection_panic_metric_increments test from src/server/connection.rs and its related imports. Rename and refactor the corresponding test in tests/metrics.rs to inc_connection_panics_increments_counter, update its implementation to use a global metrics recorder, and simplify the assertion logic. Add a new test to verify accumulation of multiple increments for the connection panic metric.

Changes

Cohort / File(s) Change Summary
Remove test from server connection
src/server/connection.rs
Deleted the connection_panic_metric_increments test and removed related imports (DebugValue, DebuggingRecorder).
Refactor and rename metrics test
tests/metrics.rs
Renamed the test to inc_connection_panics_increments_counter, updated metrics recorder setup, simplified assertions, and added a new test for multiple increments accumulation.

Sequence Diagram(s)

sequenceDiagram
    participant TestRunner
    participant MetricsRecorder

    TestRunner->>MetricsRecorder: Install DebuggingRecorder globally
    TestRunner->>MetricsRecorder: Call inc_connection_panics()
    TestRunner->>MetricsRecorder: Retrieve and assert CONNECTION_PANICS == 1
    TestRunner->>MetricsRecorder: Call inc_connection_panics() twice
    TestRunner->>MetricsRecorder: Retrieve and assert CONNECTION_PANICS == 2
Loading

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~7 minutes

Possibly related PRs

Poem

A metric test was sent away,
Its sibling earned a brand new name.
Assertions now are clean and neat,
With counters checked—a tidy feat!
Metrics march on, code refined,
Reviewers, keep this change in mind.
🛠️✨

✨ Finishing Touches
  • 📝 Generate Docstrings
🧪 Generate unit tests
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch codex/replace-async-test-with-unit-test

🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Explain this complex logic.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai explain this code block.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and explain its main purpose.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR.
  • @coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
  • @coderabbitai generate unit tests to generate unit tests for this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link
Copy Markdown
Contributor

@sourcery-ai sourcery-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @leynos - I've reviewed your changes and they look great!

Prompt for AI Agents
Please address the comments from this code review:
## Individual Comments

### Comment 1
<location> `tests/metrics.rs:77` </location>
<code_context>
-        })
-        .unwrap_or(0);
-    assert_eq!(1, count, "panic metric not recorded");
+    assert!(
+        metrics.iter().any(|(key, _, _, value)| {
+            key.key().name() == wireframe::metrics::CONNECTION_PANICS
+                && matches!(value, DebugValue::Counter(c) if *c == 1)
+        }),
+        "expected CONNECTION_PANICS == 1, got {metrics:#?}"
+    );
 }
</code_context>

<issue_to_address>
Consider adding a test for multiple increments.

Adding a test that calls inc_connection_panics multiple times will ensure the counter correctly accumulates values and help detect issues with repeated increments.
</issue_to_address>

Sourcery is free for open source - if you like our reviews please consider sharing them ✨
Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.

Comment thread tests/metrics.rs Outdated
Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

📜 Review details

Configuration used: CodeRabbit UI
Review profile: ASSERTIVE
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between bd5bf50 and 0049c59.

📒 Files selected for processing (2)
  • src/server/connection.rs (0 hunks)
  • tests/metrics.rs (1 hunks)
💤 Files with no reviewable changes (1)
  • src/server/connection.rs
🧰 Additional context used
📓 Path-based instructions (1)
**/*.rs

📄 CodeRabbit Inference Engine (AGENTS.md)

**/*.rs: Function documentation must include clear examples demonstrating the usage and outcome of the function. Test documentation should omit examples where the example serves only to reiterate the test logic.
No single code file may be longer than 400 lines. Long switch statements or dispatch tables should be broken up by feature and constituents colocated with targets. Large blocks of test data should be moved to external data files.
Clippy warnings MUST be disallowed.
Fix any warnings emitted during tests in the code itself rather than silencing them.
Where a function is too long, extract meaningfully named helper functions adhering to separation of concerns and CQRS.
Where a function has too many parameters, group related parameters in meaningfully named structs.
Where a function is returning a large error consider using Arc to reduce the amount of data returned.
Write unit and behavioural tests for new functionality. Run both before and after making any change.
Every module must begin with a module level (//! ) comment explaining the module's purpose and utility.
Document public APIs using Rustdoc comments (///) so documentation can be generated with cargo doc.
Prefer immutable data and avoid unnecessary mut bindings.
Handle errors with the Result type instead of panicking where feasible.
Avoid unsafe code unless absolutely necessary and document any usage clearly.
Place function attributes after doc comments.
Do not use return in single-line functions.
Use predicate functions for conditional criteria with more than two branches.
Lints must not be silenced except as a last resort.
Lint rule suppressions must be tightly scoped and include a clear reason.
Prefer expect over allow.
Prefer .expect() over .unwrap().
Use concat!() to combine long string literals rather than escaping newlines with a backslash.
Prefer semantic error enums. Derive std::error::Error (via the thiserror crate) for any condition the caller might inspect, retry, or map to an HTTP status....

Files:

  • tests/metrics.rs

⚙️ CodeRabbit Configuration File

**/*.rs: * Seek to keep the cyclomatic complexity of functions no more than 12.

  • Adhere to single responsibility and CQRS

  • Place function attributes after doc comments.

  • Do not use return in single-line functions.

  • Move conditionals with >2 branches into a predicate function.

  • Avoid unsafe unless absolutely necessary.

  • Every module must begin with a //! doc comment that explains the module's purpose and utility.

  • Comments and docs must follow en-GB-oxendict (-ize / -our) spelling and grammar

  • Lints must not be silenced except as a last resort.

    • #[allow] is forbidden.
    • Only narrowly scoped #[expect(lint, reason = "...")] is allowed.
    • No lint groups, no blanket or file-wide suppression.
    • Include FIXME: with link if a fix is expected.
  • Use rstest fixtures for shared setup and to avoid repetition between tests.

  • Replace duplicated tests with #[rstest(...)] parameterised cases.

  • Prefer mockall for mocks/stubs.

  • Prefer .expect() over .unwrap()

  • Ensure that any API or behavioural changes are reflected in the documentation in docs/

  • Ensure that any completed roadmap steps are recorded in the appropriate roadmap in docs/

  • Files must not exceed 400 lines in length

    • Large modules must be decomposed
    • Long match statements or dispatch tables should be decomposed by domain and collocated with targets
    • Large blocks of inline data (e.g., test fixtures, constants or templates) must be moved to external files and inlined at compile-time or loaded at run-time.

Files:

  • tests/metrics.rs
🧬 Code Graph Analysis (1)
tests/metrics.rs (1)
src/metrics.rs (2)
  • inc_connection_panics (108-108)
  • inc_connection_panics (111-111)
🔍 MCP Research (1 server)

Deepwiki:

  • The connection panic resilience test (connection_panic_is_caught) is implemented as a behavioral test using the Cucumber BDD framework. It uses a PanicWorld test context that starts a WireframeServer configured to panic during connection setup. The test establishes two TCP connections, both triggering panics, and verifies that both connections succeed without crashing the server. It asserts that the logs contain an error entry indicating the connection task panicked with the specific panic message. (Source: Behavioral Testing page)

  • The connection actor model uses an actor-per-connection pattern where each TCP connection is managed by a dedicated async task. Connection tasks are wrapped with panic recovery using std::panic::AssertUnwindSafe(...).catch_unwind() to catch panics and log them without crashing the server or worker tasks. This design ensures that panics in connection handlers increment the panic metric and do not affect other connections. (Source: ConnectionActor page, WireframeServer page)

  • The wireframe_testing crate provides utilities for testing WireframeApp instances with in-memory streams, enabling unit and integration tests without real network I/O. The metrics test in tests/metrics.rs uses this infrastructure to verify metric increments. (Source: Testing Utilities page)

⏰ Context from checks skipped due to timeout of 120000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: build-test
🔇 Additional comments (1)
tests/metrics.rs (1)

66-84: Retain behavioural tests for connection panic resilience
Keep the PanicWorld scenario and related BDD tests alongside the new unit test to verify the recovery path and ensure panics don’t crash the server.

Locations to preserve:

  • src/server/connection.rs – async fn connection_panic_is_caught
  • tests/world.rs – PanicWorld context
  • tests/features/connection_panic.feature
  • tests/steps/panic_steps.rs – Given/When/Then steps for PanicWorld

Comment thread tests/metrics.rs Outdated
@leynos
Copy link
Copy Markdown
Owner Author

leynos commented Aug 10, 2025

@coderabbitai review

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Aug 10, 2025

✅ Actions performed

Review triggered.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

📜 Review details

Configuration used: CodeRabbit UI
Review profile: ASSERTIVE
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 0049c59 and b49923a.

📒 Files selected for processing (1)
  • tests/metrics.rs (1 hunks)
🧰 Additional context used
📓 Path-based instructions (1)
**/*.rs

⚙️ CodeRabbit Configuration File

**/*.rs: * Seek to keep the cyclomatic complexity of functions no more than 12.

  • Adhere to single responsibility and CQRS

  • Place function attributes after doc comments.

  • Do not use return in single-line functions.

  • Move conditionals with >2 branches into a predicate function.

  • Avoid unsafe unless absolutely necessary.

  • Every module must begin with a //! doc comment that explains the module's purpose and utility.

  • Comments and docs must follow en-GB-oxendict (-ize / -our) spelling and grammar

  • Lints must not be silenced except as a last resort.

    • #[allow] is forbidden.
    • Only narrowly scoped #[expect(lint, reason = "...")] is allowed.
    • No lint groups, no blanket or file-wide suppression.
    • Include FIXME: with link if a fix is expected.
  • Use rstest fixtures for shared setup and to avoid repetition between tests.

  • Replace duplicated tests with #[rstest(...)] parameterised cases.

  • Prefer mockall for mocks/stubs.

  • Prefer .expect() over .unwrap()

  • Ensure that any API or behavioural changes are reflected in the documentation in docs/

  • Ensure that any completed roadmap steps are recorded in the appropriate roadmap in docs/

  • Files must not exceed 400 lines in length

    • Large modules must be decomposed
    • Long match statements or dispatch tables should be decomposed by domain and collocated with targets
    • Large blocks of inline data (e.g., test fixtures, constants or templates) must be moved to external files and inlined at compile-time or loaded at run-time.

Files:

  • tests/metrics.rs
🧬 Code Graph Analysis (1)
tests/metrics.rs (1)
src/metrics.rs (2)
  • inc_connection_panics (108-108)
  • inc_connection_panics (111-111)
🔍 MCP Research (2 servers)

Deepwiki:

  • The server’s panic recovery code in src/server.rs spawns connection tasks wrapped with catch_unwind to catch panics, log the panic message and peer address, and prevent server crashes, ensuring resilience to panics in connection handlers (ENG-2040).

  • The behavioral test connection_panic.feature verifies that connection panics do not crash the server, allowing subsequent connections to succeed, using a PanicWorld test context that starts a server configured to panic during connection setup and verifies multiple connection attempts succeed (ENG-2040).

  • The metrics system uses the metrics crate to track operational metrics including connection panics; the function inc_connection_panics increments the CONNECTION_PANICS counter metric, and tests in tests/metrics.rs verify that calling inc_connection_panics increments the counter exactly once and accumulates over multiple calls (ENG-2040).

  • The removal of the integration test in src/server/connection.rs and replacement with unit tests in tests/metrics.rs aligns with the architecture where connection panics are caught and logged in the worker task spawning code in src/server.rs, and the metric increment function is tested in isolation (ENG-2040).

Context7:

  • Document /metrics-rs/metrics: The metrics::with_local_recorder function is used to temporarily override the global metrics recorder within a closure, enabling thread-safe and deterministic testing or localized metric collection without affecting global state. This is demonstrated by creating a DebuggingRecorder, using metrics::with_local_recorder to run code that increments a counter metric, and then asserting the snapshot contains the expected metric increment. This pattern aligns with the new unit test approach in tests/metrics.rs where the panic counter increment is tested using a local debugging recorder and snapshotter. (Source: /metrics-rs/metrics RELEASES.md snippet "Using Scoped Metrics Recorder in Rust")

  • Document /metrics-rs/metrics: The increment_counter! macro is the standard way to increment a counter metric by one, which is the underlying operation tested by the new unit tests that call inc_connection_panics to increment the CONNECTION_PANICS counter. (Source: /metrics-rs/metrics RELEASES.md snippet "Incrementing Counter in Rust")

🔇 Additional comments (2)
tests/metrics.rs (2)

66-74: Use a local recorder; eliminate global-state flakiness.

Adopt metrics::with_local_recorder and drop global installation. This aligns with our guidance and avoids single-recorder panics in parallel test runs. LGTM.


86-105: Add accumulation test; improve coverage.

Validate that multiple invocations accumulate correctly. This closes the gap flagged earlier and hardens the metric’s contract. LGTM.

Comment thread tests/metrics.rs Outdated
@leynos leynos merged commit 8284f16 into main Aug 12, 2025
5 checks passed
@leynos leynos deleted the codex/replace-async-test-with-unit-test branch August 12, 2025 01:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant