Skip to content

Review TT-CONFIDENCE#118

Closed
aschemmel-tech wants to merge 1 commit intomainfrom
aschemmel-tech-patch-2
Closed

Review TT-CONFIDENCE#118
aschemmel-tech wants to merge 1 commit intomainfrom
aschemmel-tech-patch-2

Conversation

@aschemmel-tech
Copy link

no impact on nlohman/json

modified assertions and evidences and SME scores

@github-actions github-actions bot added the S label Nov 5, 2025
@coveralls
Copy link

coveralls commented Nov 5, 2025

Coverage Status

coverage: 99.186%. remained the same
when pulling 4cbc59a on aschemmel-tech-patch-2
into 5542b4c on main.

Signed-off-by: aschemmel-tech <aschemmel_job@arcor.de>
@github-actions github-actions bot added M and removed S M labels Nov 5, 2025

Evidence

1. Manual process documentation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reference to nlohmann/json contribution guidelines


1. Manual process documentation

2. References to methodologies applied as part of these processes
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Revisit (clarify what this means)


2. References to methodologies applied as part of these processes

3. Results of applying the processes
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Revisit (clarify what this means)


3. Results of applying the processes

4. Criteria used to confirm that the processes were applied correctly
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review process, branch protection rules, etc?


aschemmel-tech: it is not clear what the integrator has to do, it should be added that the integrator shall review the SME scores and add his scores where necessary,
for example for his fulfilllment of AoUs. AOUs are supposed to be linked to TA-CONSTRAINTS instead. Propose to add another statement (in TA-CONSTRAINTS) about the
S-CORE scoring of trust based on correctness and completeness of AoUs created. No newline at end of file
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do the same as in TT-CHANGES

Each statement is scored based on SME reviews or automatic validation functions. (TODO) No newline at end of file
Each statement is scored based on SME reviews or automatic validation functions.

aschemmel-tech: Propose to add here as reference a link to the accumulated score. Some scores are already present, so added also a score for this No newline at end of file
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add reference to total TSF score

Scores are reasonably, systematically and repeatably accumulated. (TODO) No newline at end of file
Scores are reasonably, systematically and repeatably accumulated.

aschemmel-tech: Propose to add here as reference a link to the algorithm description (which should be updated based on last feedback/review). No newline at end of file
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing to do at the moment (concept page will be updated after merging erikhu1-review_round_3)

aschemmel-tech: As already agreed, we need separate statements on the processes/manual reviews applied for nlohman and for S-CORE.
For nlohman part we could refer to the github reviews of every PR before merge, is there some guideline/checklist to do this?
How many people do this review (e.g. does Mr. Lohman approve all?) How do we judge the quality of the review (comments)?
For S-CORE we need to describe how those are used to verify the nlohman lib, e.g. if we add tests these are reviewed with S-CORE checklists. No newline at end of file
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

split statement into two:

  • One for nlohmann/json
    • Refer CODEOWNERS (showing that Niels Lohmann is the only reviewer, which makes it consistent)
    • Refer to contribution guidelines and github reviews (specifically filter for push to master, which should be empty)
  • one for S-CORE
    • Reference the update process and release management (already in TSF/README)

A github workflow saves the history of scores in the trustable graph to derive trends. No newline at end of file
A github workflow saves the history of scores in the trustable graph to derive trends.

aschemmel-tech: do we also have some display of the historical data planned (to use for analyses)? Is this already provided/automated by TSF? No newline at end of file
Copy link
Collaborator

@Erikhu1 Erikhu1 Nov 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

display of historical data is already provided by TSF.

  • The persistent storage of data already exists (implemented by us) but is just a proof of concept, and should be updated to a more sophisticated version by the integrator (as stated in AOU-29).
    • TO-DO: check if AOU-29 needs to be clarified more.

@aschemmel-tech
Copy link
Author

Topics taken into account in eclipse-score#9

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants