Support for Rune defined functions by dschwartznyc · Pull Request #184 · finos/rune-python-generator

dschwartznyc · 2026-04-10T14:53:24Z

PR Summary

This PR delivers comprehensive function and expression generation support

Runtime Dependency: this release requires rune-python-runtime v2.0.0, which is available on PyPI. The generated pyproject.toml declares rune.runtime>=2.0.0,<3.0.0

What's new

Function support
- Comprehensive support for Rune defined functions, including stepwise object construction (ObjectBuilder), enum-based dispatch, and pre/post conditions.
- Integration of externally defined native "hand-crafted" functions where the Rune definition specifies [codeImplementation] or is empty.
- Support for side-effect-free pass-by-value function inputs.
Completion of support for all Rune defined expressions
- Closed the gap of missing collection and list operators (sort, min, max, reduce, distinct, flatten, reverse, sum, one-of).
- Support for implicit closure parameters and closure-based keys for collection operations.
- Correct null / "nothing" propagation through expression chains.
- Support for with-meta and as-key.
Circular reference support
- Closed gaps and resolved issues in the handling of inheritance and attributes.
Significant load performance improvement
- Load time reduced by approximately 98% (~120 s → ~2 s).
- Mutually recursive elements partitioned into a small cyclic bundle (~6% of CDM types) with the remainder emitted as standalone files
Completion of support for Type Aliases — type aliases are resolved with flattened naming conventions and collision handling.
Refactored object, attribute, and expression generation — introduced PythonExpressionScope and companion blocks to simplify code and support reuse across the generator.

Test suite

Improved testing rigor and coverage.
JUnit suite reorganized from 54 to 22 classes with consistent Python* naming and less fragile assertions.
Python unit tests restructured so Rune filename, namespace, and pytest filename correspond without exception.

Known gaps

See RUNE_LANGUAGE_GAPS.md

For full details see RELEASE.md.

… reusing virtual environments, and enable conditional CDM builds.

…nd improve CDM development environment setup scripts.

…to be updated and 3 Python Unit Tests failing

…tion and tests, and refactor JUnit tests.

…d clean up generators.

…essor

…owed by all rebuilds

… functions

…y use of Draft objects

…dd symbol shadowing for lambda parameters. Refactor expression generation to maintain its own levels

… update expression generators to utilize it, and refactor related tests.

… variable initialization and enhancing `add` operation handling for many-cardinality attributes and nested paths.

…s with expressions, add a test for `add` operations with aliases, and update the Python runtime setup.

…ities;

…ine length warnings in test files.

…y method, and track native function names.

…hat needs to be updated once the runtime changes

…irectories

…-prefixed packages - fix for the native function registration and invocation when installed in a prefixed package

… is set.

…cumentation

…pment overrides have not been set

…of the runtime

hugohills-regnosys · 2026-04-21T16:14:21Z

One general comment about the namespace prefixing for python. Prefixing CDM namespaces with FINOS makes sense, however for the rune-fpml project, it's not on FINOS and is owned by ISDA, so perhaps that should be prefixed with ISDA (or something).

Resolves all merge conflicts taking the feature branch as the source of truth for all Java source and test files. Updates rosetta.dsl.version to 9.78.0 from the renovate PR on main.

dschwartznyc · 2026-04-21T20:15:43Z

@hugohills-regnosys a sensible suggestion. unfortunately CDM and Rune FpML rune definitions have to be processed together and the generator does not currently support multiple namespace prefixes.

dschwartz-ftadvisory added 30 commits February 8, 2026 16:08

Refactor test scripts to centralize common functions, add options for…

5e508ea

… reusing virtual environments, and enable conditional CDM builds.

feat: Add incomplete object tests

13838cd

test: Add unit tests for circular dependencies and inheritance cycles

02a0407

feat: Add Python generation and testing for with-meta expressions a…

2cf1e24

…nd improve CDM development environment setup scripts.

Feat: Incomplete update for Circular Dependency Support. JUnit tests …

804f908

…to be updated and 3 Python Unit Tests failing

feat: Update JUnit tests to new less fragile testing strategy

8317bbb

feat: Implement circular reference handling, add key reference genera…

2eb0e9d

…tion and tests, and refactor JUnit tests.

chore: restore test_entity_reuse.py to fail. remove extraneous tests

530d169

feat: Implement support for externally defined functions. Refactor an…

e32be6a

…d clean up generators.

chore: add junit-platform.properties

6ba276f

chore: remove checkstyle warnings

51e3aed

chore: clean up Python env setup

5e5e214

defect and refactor: resolved defect in and refactored attribute proc…

145efbb

…essor

fix: atrribute processing now groups all _annotations__ together foll…

43daf56

…owed by all rebuilds

feat: remove invalid test and add analysis of CDM use of Java defined…

274d479

… functions

chore: rename CDM_JAVA_MIGRATION

8dfe018

chore: rename docs

02c91d2

feat: Refactor Python code generation to support Lazy instantiation b…

cf7ead2

…y use of Draft objects

fix: use ObjectBuilder instead of Draft

c2bd5bc

feat: Add test for list processing.

2950c18

chore: remove cdm-java-migration.md

bc1c97d

feat: add release notes for the attribute refactoring

79dcbe2

fix: sync PythonGeneratorTestUtils.java with main

faeb28c

feat: Update Python list accumulation and filtering generation, and a…

f7f9786

…dd symbol shadowing for lambda parameters. Refactor expression generation to maintain its own levels

feat: introduce PythonExpressionScope to manage expression context,…

27d2b26

… update expression generators to utilize it, and refactor related tests.

refactor: Improve Python function generation by adding a preamble for…

812570c

… variable initialization and enhancing `add` operation handling for many-cardinality attributes and nested paths.

feat: Refactor Python expression generation to return companion block…

07dc82b

…s with expressions, add a test for `add` operations with aliases, and update the Python runtime setup.

docs: Add Javadoc to generator records, builder fields, and test util…

6bed3d2

…ities;

refactor: Update Checkstyle configuration for ParenPad and suppress l…

ca7079b

…ine length warnings in test files.

refactor: update Python expression generator lifecycle, rename utilit…

6b4fde4

…y method, and track native function names.

dschwartz-ftadvisory and others added 16 commits April 15, 2026 16:05

chore: cleanup cdm unit test scripts

3a5b4dd

feat: first cut of native functions revisions

94a05c2

feat: revised native function support. uses an interim runtime call t…

e8e61d6

…hat needs to be updated once the runtime changes

feat: Add license header to generated files

224771d

fix: change native function processing

c5632ef

fix: move native source directory and add __init__.py to all copied d…

198bf65

…irectories

fix: native function __init__.py generation

73ff45d

- fix for the native function import - it works in a prefixed and non…

c27a2d6

…-prefixed packages - fix for the native function registration and invocation when installed in a prefixed package

- fixed the copy of the native function implementations when a prefix…

1b500b0

… is set.

feat: cdm test takes version as input

bae6cd5

chore: pre-release cleanup. remove compilation warnings and update do…

ab47e71

…cumentation

feat: update setup python env to pull the runtime from PyPI if develo…

4990284

…pment overrides have not been set

fix: restore defaults in setup_python_env

795b712

chore: clean up setup cdm env

a57f005

chore: ensure that repo builds find a fallback to the proper version …

867cc13

…of the runtime

feat: pre-release cleanup taking into account the new runtime release

f32dd2f

dschwartznyc marked this pull request as ready for review April 17, 2026 21:24

hugohills-regnosys approved these changes Apr 21, 2026

View reviewed changes

Merge origin/main into feature/function_support

d9eb349

Resolves all merge conflicts taking the feature branch as the source of truth for all Java source and test files. Updates rosetta.dsl.version to 9.78.0 from the renovate PR on main.

dschwartznyc merged commit 7e7e903 into main Apr 21, 2026
3 checks passed

dschwartznyc mentioned this pull request Apr 21, 2026

01: Generate Python Functions from Rune #108

Closed

dschwartznyc deleted the feature/function_support branch April 21, 2026 20:33

This was referenced Apr 24, 2026

Re-enable Python generation and shift to PyPI releases finos/common-domain-model#4630

Closed

Feature/master python update finos/common-domain-model#4631

Closed

dschwartz-ftadvisory mentioned this pull request Apr 24, 2026

Re-enable Python generation and shift to PyPI releases finos/common-domain-model#4635

Draft

plamen-neykov mentioned this pull request May 12, 2026

Re-enables CDM's Python code generation using the new generator/runtime finos/common-domain-model#4710

Closed

dschwartznyc mentioned this pull request May 12, 2026

Re-enables CDM's Python code generation using the new generator/runtime finos/common-domain-model#4711

Closed

plamen-neykov mentioned this pull request May 12, 2026

[6.x.x] Re-enables CDM's Python code generation using the new python generator/runtime finos/common-domain-model#4712

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Support for Rune defined functions#184

Support for Rune defined functions#184
dschwartznyc merged 118 commits into
mainfrom
feature/function_support

dschwartznyc commented Apr 10, 2026 •

edited

Loading

Uh oh!

hugohills-regnosys commented Apr 21, 2026

Uh oh!

Uh oh!

dschwartznyc commented Apr 21, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

dschwartznyc commented Apr 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Summary

What's new

Test suite

Known gaps

Uh oh!

hugohills-regnosys commented Apr 21, 2026

Uh oh!

Uh oh!

dschwartznyc commented Apr 21, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

dschwartznyc commented Apr 10, 2026 •

edited

Loading