fix(evals): add typecheck coverage for evals, integration-tests, and memory-tests

[SandyTao520]

Summary

Add typecheck coverage for evals/, integration-tests/, and memory-tests/ directories, which were previously never typechecked — allowing type errors like invalid suiteType literals to slip through undetected.

Details

The root npm run typecheck only ran workspace-level typechecks (packages/*), each scoped to src/**/*.ts. The evals/, integration-tests/, and memory-tests/ directories are not npm workspaces, so they were never type-checked anywhere — not in CI, not in pre-commit, not in preflight.

This PR:

• Creates evals/tsconfig.json extending the root config with @google/gemini-cli-core path alias and references to packages/core and packages/cli.
• Updates the root typecheck script to chain tsc --noEmit for evals/, integration-tests/, and memory-tests/ after workspace typechecks.

This surfaces ~24 pre-existing type errors across these directories (e.g. missing suiteName/suiteType fields, string | null not assignable to string). These are all pre-existing on main and will need separate follow-up fixes.

Related Issues

Refs #18007

How to Validate

1. Run npm run typecheck — it should now also check evals/, integration-tests/, and memory-tests/ (and surface pre-existing errors in those directories).
2. Verify workspace-level typechecks still pass independently: npm run typecheck --workspaces --if-present.

Pre-Merge Checklist

• Updated relevant documentation and README (if needed)
• Noted breaking changes (if any)
• Validated on required platforms/methods:
  • MacOS
    • npm run
    • npx
    • Docker
    • Podman
    • Seatbelt
  • Windows
    • npm run
    • npx
    • Docker
  • Linux
    • npm run
    • npx
    • Docker

[gemini-code-assist]

Summary of Changes

Hello, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request improves the project's static analysis by ensuring that directories previously ignored by the build process are now included in the type-checking pipeline. By updating the root configuration and adding necessary TypeScript project files, the changes help surface existing type inconsistencies that were previously hidden from CI and local development workflows.

Highlights

• Typecheck Coverage Expansion: Extended the root typecheck script to include the evals, integration-tests, and memory-tests directories, which were previously excluded from static analysis.
• Configuration Setup: Added a new tsconfig.json for the evals directory to correctly resolve path aliases and package references.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description
Code Review	/gemini review	Performs a code review for the current pull request in its current state.
Pull Request Summary	/gemini summary	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help	/gemini help	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

[gemini-cli]

Hi @SandyTao520, thank you so much for your contribution to Gemini CLI! We really appreciate the time and effort you've put into this.

We're making some updates to our contribution process to improve how we track and review changes. Please take a moment to review our recent discussion post: Improving Our Contribution Process & Introducing New Guidelines.

Key Update: Starting January 26, 2026, the Gemini CLI project will require all pull requests to be associated with an existing issue. Any pull requests not linked to an issue by that date will be automatically closed.

Thank you for your understanding and for being a part of our community!

[gemini-code-assist]

Code Review

This pull request adds a TypeScript configuration for the evals directory and updates the root typecheck script to include checks for evals, integration-tests, and memory-tests. Feedback highlights that integration-tests/tsconfig.json is missing, which will cause CI failures. Furthermore, existing type errors need resolution before enabling these checks, and typescript should be explicitly declared as a root dependency. Improvements were also suggested for evals/tsconfig.json, including adding a path mapping for @google/gemini-cli and using tsc -b to correctly handle project references.

_{Note: Security Review has been skipped due to the limited scope of the PR.}

[github-actions]

Size Change: -4 B (0%)

Total Size: 33.6 MB

Filename	Size	Change
./bundle/chunk-6CESRP7K.js	0 B	-3.43 MB (removed)	🏆
./bundle/chunk-OVMG6YSM.js	0 B	-14.5 MB (removed)	🏆
./bundle/chunk-RKU2DIXY.js	0 B	-3.8 kB (removed)	🏆
./bundle/core-5BLUDLRO.js	0 B	-46.6 kB (removed)	🏆
./bundle/devtoolsService-4PGKYZEB.js	0 B	-28.4 kB (removed)	🏆
./bundle/gemini-WWA3G5E5.js	0 B	-553 kB (removed)	🏆
./bundle/interactiveCli-IXK4CHTO.js	0 B	-1.29 MB (removed)	🏆
./bundle/oauth2-provider-HWAOH4OS.js	0 B	-9.16 kB (removed)	🏆
./bundle/chunk-U3SLYWJM.js	3.43 MB	+3.43 MB (new file)	🆕
./bundle/chunk-WZ77Z7NM.js	3.8 kB	+3.8 kB (new file)	🆕
./bundle/chunk-YC26VW4Z.js	14.5 MB	+14.5 MB (new file)	🆕
./bundle/core-4GBCHOJI.js	46.6 kB	+46.6 kB (new file)	🆕
./bundle/devtoolsService-6ZHM2JVW.js	28.4 kB	+28.4 kB (new file)	🆕
./bundle/gemini-72AI5UAT.js	553 kB	+553 kB (new file)	🆕
./bundle/interactiveCli-LZSD364X.js	1.29 MB	+1.29 MB (new file)	🆕
./bundle/oauth2-provider-SY3MBLS5.js	9.16 kB	+9.16 kB (new file)	🆕

ℹ️ View Unchanged

Filename	Size	Change
./bundle/bundled/third_party/index.js	8 MB	0 B
./bundle/chunk-34MYV7JD.js	2.45 kB	0 B
./bundle/chunk-5AUYMPVF.js	858 B	0 B
./bundle/chunk-5PS3AYFU.js	1.18 kB	0 B
./bundle/chunk-664ZODQF.js	124 kB	0 B
./bundle/chunk-DAHVX5MI.js	206 kB	0 B
./bundle/chunk-IUUIT4SU.js	56.5 kB	0 B
./bundle/chunk-PC3Y4R7E.js	1.97 MB	0 B
./bundle/chunk-RJTRUG2J.js	39.8 kB	0 B
./bundle/cleanup-5MIWI7XH.js	0 B	-932 B (removed)	🏆
./bundle/devtools-36NN55EP.js	696 kB	0 B
./bundle/dist-T73EYRDX.js	356 B	0 B
./bundle/events-XB7DADIJ.js	418 B	0 B
./bundle/gemini.js	4.97 kB	0 B
./bundle/getMachineId-bsd-TXG52NKR.js	1.55 kB	0 B
./bundle/getMachineId-darwin-7OE4DDZ6.js	1.55 kB	0 B
./bundle/getMachineId-linux-SHIFKOOX.js	1.34 kB	0 B
./bundle/getMachineId-unsupported-5U5DOEYY.js	1.06 kB	0 B
./bundle/getMachineId-win-6KLLGOI4.js	1.72 kB	0 B
./bundle/memoryDiscovery-R4AKKXHF.js	980 B	0 B
./bundle/multipart-parser-KPBZEGQU.js	11.7 kB	0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/client/main.js	222 kB	0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/_client-assets.js	229 kB	0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/index.js	13.4 kB	0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/types.js	132 B	0 B
./bundle/sandbox-macos-permissive-open.sb	890 B	0 B
./bundle/sandbox-macos-permissive-proxied.sb	1.31 kB	0 B
./bundle/sandbox-macos-restrictive-open.sb	3.36 kB	0 B
./bundle/sandbox-macos-restrictive-proxied.sb	3.56 kB	0 B
./bundle/sandbox-macos-strict-open.sb	4.82 kB	0 B
./bundle/sandbox-macos-strict-proxied.sb	5.02 kB	0 B
./bundle/src-QVCVGIUX.js	47 kB	0 B
./bundle/tree-sitter-7U6MW5PS.js	274 kB	0 B
./bundle/tree-sitter-bash-34ZGLXVX.js	1.84 MB	0 B
./bundle/cleanup-PKUALLBQ.js	932 B	+932 B (new file)	🆕

_{compressed-size-action}

[gundermanc]

Do we have to use an additional tsconfig or can we use the root one?

[SandyTao520]

In this monorepo, the root tsconfig.json doesn't actually compile any code itself. It only acts as a shared configuration that other projects extend. It doesn't use "include" or "files" because we don't want a single massive compilation unit.

[gundermanc]

note that && syntax isn't supported by powershell. Will this still work on Windows?

[SandyTao520]

NPM uses cmd.exe on Windows by default for executing scripts, not PowerShell, so the && operator is natively supported and cross-platform safe in package.json scripts!

[gundermanc]

Approved with some suggestions.

[github-actions]

✅ 58 tests passed successfully on gemini-3-flash-preview.

---

This is an automated guidance message triggered by steering logic signatures.