feat: Integrate Penguin env

[bxyu-nvidia]

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Issues

List issues that this PR closes (syntax):

Usage

• You can potentially add a usage example below

# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

• Make sure you read and followed Contributor guidelines
• Did you write any new necessary tests?
• Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
• Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

• ...

[terrykong]

i think eventually these should make their way into examples/configs/recipes/llm which enforces there must be a nightly test for each yaml config

i think it would be good to have one base penguin config, like examples/configs/grpo_penguin.yaml and then all the other ones are based on that. since the environment is slightly different b/c it's penguin and not our openmathinstruct ones, you should probably update the precommit here:

https://github.com/NVIDIA-NeMo/RL/blob/main/.pre-commit-config.yaml#L71-L73

to also enforce minimization of these recipes

[terrykong]

wdyt about examples/penguin/run_grpo_penguin.py -> examples/run_grpo_penguin.py? i kind of think it should be higher and more easily discoverable.

i guess also related, wdyt about moving your configs like examples/penguin/grpo_workbench_qwen3_4binstruct.yaml to examples/configs/recipes/llm/grpo_penguin_workbench_qwen3_4binstruct.yaml?

[terrykong]

maybe this should go to tests/functional/run_penguin_single_node_sanity_tests.sh and then added to https://github.com/NVIDIA-NeMo/RL/blob/main/tests/functional/L1_Functional_Tests_GPU.sh to get auto picked up by our CI. You probably need to guard this test though so that it gets skipped if penguin doesn't exist

[terrykong]

btw, does this use 8 gpus? we only have 2 A100 gpus in the CI

[terrykong]

is it possible to statically type the return results: SomeStruct so the IDE can help us understand how to deal with this object and go-to-definition? It's hard from reading the code to understand what I should expect to be inside "results"

[bxyu-nvidia]

Closed in favor of #1450