Skip to content

Add Prime sandbox benchmark adapter and results #73

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
DawgZter wants to merge 3 commits into
base: master
Choose a base branch
from
Draft

Add Prime sandbox benchmark adapter and results #73

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
d44f3d6
Add Prime benchmark adapter and results
DawgZter Apr 11, 2026
46bbd23
Optimize Prime benchmark startup path
DawgZter Apr 11, 2026
dfd9d41
Tune Prime benchmark sandbox defaults
DawgZter Apr 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .github/workflows/sandbox-benchmarks.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,7 @@ jobs:
- e2b
- hopx
- modal
- prime
- namespace
- runloop
- vercel
Expand Down Expand Up @@ -89,6 +90,9 @@ jobs:
HOPX_API_KEY: ${{ secrets.HOPX_API_KEY }}
MODAL_TOKEN_ID: ${{ secrets.MODAL_TOKEN_ID }}
MODAL_TOKEN_SECRET: ${{ secrets.MODAL_TOKEN_SECRET }}
PRIME_API_KEY: ${{ secrets.PRIME_API_KEY }}
PRIME_TEAM_ID: ${{ secrets.PRIME_TEAM_ID }}
PRIME_API_BASE_URL: ${{ secrets.PRIME_API_BASE_URL }}
NSC_TOKEN: ${{ secrets.NSC_TOKEN }}
RUNLOOP_API_KEY: ${{ secrets.RUNLOOP_API_KEY }}
VERCEL_TOKEN: ${{ secrets.VERCEL_TOKEN }}
Expand Down
5 changes: 5 additions & 0 deletions env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,11 @@ E2B_API_KEY=your_e2b_api_key
MODAL_TOKEN_ID=your_modal_token_id
MODAL_TOKEN_SECRET=your_modal_token_secret

######### PRIME ########
PRIME_API_KEY=your_prime_api_key
PRIME_TEAM_ID=your_prime_team_id
PRIME_API_BASE_URL=https://api.primeintellect.ai

######### DAYTONA ########
DAYTONA_API_KEY=your_daytona_api_key

Expand Down
1 change: 1 addition & 0 deletions package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@
"bench:e2b": "tsx src/run.ts --provider e2b",
"bench:hopx": "tsx src/run.ts --provider hopx",
"bench:modal": "tsx src/run.ts --provider modal",
"bench:prime": "tsx src/run.ts --provider prime",
"bench:namespace": "tsx src/run.ts --provider namespace",
"bench:railway": "tsx src/run.ts --provider railway",
"bench:render": "tsx src/run.ts --provider render",
Expand Down
Loading