Skip to content

rocAL Serialize python support#429

Merged
kiritigowda merged 232 commits intoROCm:developfrom
fiona-gladwin:fg/serialize_python
Jan 9, 2026
Merged

rocAL Serialize python support#429
kiritigowda merged 232 commits intoROCm:developfrom
fiona-gladwin:fg/serialize_python

Conversation

@fiona-gladwin
Copy link
Copy Markdown
Contributor

Motivation

Adds pipeline serialization functionality to the Python API.

Technical Details

  • Implements pipeline serialization to string and file formats
  • Adds C++ bindings for serialization functions
  • Introduce python file to test serialization functionality

Test Plan

Execute the pipeline_serialize_test.py file which should execute without any errors

NOTE:
To be merged after PR #412

fiona-gladwin and others added 30 commits September 22, 2025 02:30
Remove the usage of API enums in internal node files
Add support to register all internal enums
Creates an argument instance for each arg passed in the Node
Handles different argument types i.e parameters, vectors, enums and predefined types
Add support to serialize the args and pipeline details
Add support to serialize the tensors.
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Create single constructor with check for different data types in Argument class
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Comment thread tests/cpp_api/serialization_test/CMakeLists.txt Outdated
Comment thread tests/cpp_api/serialization_test/serialization_test.cpp Outdated
Comment thread tests/cpp_api/serialization_test/serialization_test.cpp
Copy link
Copy Markdown
Collaborator

@rrawther rrawther left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please address the review comments

@fiona-gladwin
Copy link
Copy Markdown
Contributor Author

please address the review comments

@rrawther Addressed all review comments

LakshmiKumar23
LakshmiKumar23 previously approved these changes Jan 7, 2026
@LakshmiKumar23
Copy link
Copy Markdown
Contributor

@codecov
Copy link
Copy Markdown

codecov Bot commented Jan 7, 2026

Codecov Report

❌ Patch coverage is 94.11765% with 1 line in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
rocAL/source/pipeline/pipeline_serializer.cpp 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           develop     #429      +/-   ##
===========================================
+ Coverage    79.62%   80.31%   +0.70%     
===========================================
  Files          281      281              
  Lines        21577    21593      +16     
===========================================
+ Hits         17179    17342     +163     
+ Misses        4398     4251     -147     
Files with missing lines Coverage Δ
...ude/loaders/image/node_image_loader_single_shard.h 33.33% <100.00%> (+33.33%) ⬆️
rocAL/include/pipeline/master_graph.h 97.41% <100.00%> (+0.53%) ⬆️
...e/loaders/image/node_image_loader_single_shard.cpp 92.00% <100.00%> (+3.11%) ⬆️
rocAL/source/pipeline/pipeline_serializer.cpp 47.52% <0.00%> (+47.52%) ⬆️

... and 6 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

rrawther
rrawther previously approved these changes Jan 8, 2026
@fiona-gladwin fiona-gladwin dismissed stale reviews from rrawther and LakshmiKumar23 via 50c4cc5 January 8, 2026 19:05
@LakshmiKumar23
Copy link
Copy Markdown
Contributor

LakshmiKumar23 commented Jan 9, 2026

@kiritigowda kiritigowda merged commit 60e6145 into ROCm:develop Jan 9, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants