Skip to content

[CLIENT-3541] CI/CD: Add workflows to run QE bob tests for performance regression targeting the Python / C client #930

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
juliannguyen4 wants to merge 165 commits into
base: dev
Choose a base branch
from
Draft

[CLIENT-3541] CI/CD: Add workflows to run QE bob tests for performance regression targeting the Python / C client #930

juliannguyen4 wants to merge 165 commits into from

Conversation

@juliannguyen4
Copy link
Collaborator

@juliannguyen4 juliannguyen4 commented Jan 22, 2026 •
edited
Loading

Old PR: #798

juliannguyen4 and others added 30 commits June 25, 2025 13:10
@juliannguyen4
finish step 1
3990aec
@juliannguyen4
fix
8874083
@juliannguyen4
do this way
cb602a9
@juliannguyen4
2nd repo probably needs to be cd'd into
af6406e
@juliannguyen4
forgot yaml
1a0bc99
@juliannguyen4
install testctl
48b3360
@juliannguyen4
fix
c221ab7
@juliannguyen4
use jf cli instead
ad02e19
@juliannguyen4
+x
89a502a
@juliannguyen4
chmod inside new shell
c383595
@juliannguyen4
.local/bin doesnt exist in PATH?
47f93c9
@juliannguyen4
just install in default loc
97d75f1
@juliannguyen4
just install in qe-tools/bin
46b25fc
@juliannguyen4
debug
e1a8f44
@juliannguyen4
action only supports env, but we need the cred file
7b3950a
@juliannguyen4
fix
7c34a09
@juliannguyen4
debug
01cb334
@juliannguyen4
show version
41165de
@juliannguyen4
add qe section
5b14066
@juliannguyen4
print out test runs
276537a
@juliannguyen4 @github-advanced-security
Potential fix for code scanning alert no. 76: Workflow does not conta…
1518ff3 
…in permissions

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
@juliannguyen4
try running custom test now
07c701a
@juliannguyen4
use test definition registered in bob
a2060f1
@juliannguyen4
use env var to always get the right test run id
a10524a
@juliannguyen4
poll test run, then download and print test results
6b8cab4
@juliannguyen4
print cmds for debugging
a661af2
@juliannguyen4
fix
81005fe
@juliannguyen4
wrong output name
0b20963
@juliannguyen4
rm debug step
e8f9b3b
@juliannguyen4
disable color to fix
7278491
@juliannguyen4
rm
ab66a65
@juliannguyen4
debug
29e72ff
@juliannguyen4
Add proper attributes
832a3f0
@juliannguyen4
Merge remote-tracking branch 'origin/dev' into cicd-performance-regre…
30ca2a9 
…ssion-tests-using-asmikas-qe-env
@juliannguyen4
Add title so we can more easily identify workflow inputs
47357c7
@juliannguyen4
Add intermediate step to print stdout while also saving stdout to var…
3a4b470 
…iable
@juliannguyen4
Workaround: use intermediate file
010ea1b
@juliannguyen4
debug
0b1c04e
@juliannguyen4
Log into tailscale
eeb50fb
@juliannguyen4
Reuse ACMS's credentials for tailscale login. Make exit node a variable
c68af95
@juliannguyen4
Merge remote-tracking branch 'origin/dev' into cicd-performance-regre…
31a3830 
…ssion-tests-using-asmikas-qe-env
@juliannguyen4
Add stepsecurity steps
a7c7ecc
@juliannguyen4
Devops team has now set up OIDC
58e8377
@juliannguyen4
Merge remote-tracking branch 'origin/dev' into cicd-performance-regre…
3b6a034 
…ssion-tests-using-asmikas-qe-env
@juliannguyen4
Merge remote-tracking branch 'origin/dev' into cicd-performance-regre…
e16f8b3 
…ssion-tests-using-asmikas-qe-env
@juliannguyen4
fix permissions
bd85ec1
@juliannguyen4
Merge remote-tracking branch 'origin/dev' into cicd-performance-regre…
0911c05 
…ssion-tests-using-asmikas-qe-env
@juliannguyen4
Temporary workaround until test-register returns an error code when i…
e8c15a2 
…t fails
@juliannguyen4
Fail if error str not found
5e42215
@juliannguyen4
Pipe has higher precedence than or operator
c8a5257
@juliannguyen4
Just wait for Minting to add a fix to test-register
b2864d7
@juliannguyen4 juliannguyen4 force-pushed the CLIENT-3541-cicd-performance-regression-tests-using-asmikas-qe-env branch from 5b3b948 to b2864d7 Compare January 22, 2026 23:51
@codecov-commenter
Copy link

codecov-commenter commented Jan 23, 2026 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 83.31%. Comparing base (b658400) to head (3bcea64).
⚠️ Report is 9 commits behind head on dev.

Additional details and impacted files 
@@            Coverage Diff             @@
##              dev     #930      +/-   ##
==========================================
+ Coverage   83.30%   83.31%   +0.01%     
==========================================
  Files          99       99              
  Lines       14402    14422      +20     
==========================================
+ Hits        11997    12016      +19     
- Misses       2405     2406       +1

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@juliannguyen4 @codecov-commenter