Skip to content

Ability to call transform functions within a runtime #2015

@binarylogic

Description

@binarylogic

This has been discussed, and clarifies the intent behind #2012. It is becoming clear that runtimes will likely replace the entire transform pipeline, at least for operations that cross the fundamental boundary. We can further encourage this by allowing users to call other "function" transforms from within runtimes.

Note, this should be limited to transforms that do not aggregate, only simple input/output transforms. For example, we should not allow users to call the merge, dedupe, or transaction transforms within a runtime since this would complicate the runtime APIs. I'm open to solutions for these, but I'm not sure they are worth it.

Finally, I do not think we should address this in #2000. We should defer this and follow up with this addition, assuming it is possible.

Metadata

Metadata

Assignees

No one assigned

    Labels

    domain: parsingAnything related to parsing within Vectordomain: processingAnything related to processing Vector's events (parsing, merging, reducing, etc.)domain: transformsAnything related to Vector's transform componentsdomain: vrlAnything related to the Vector Remap Languagehave: niceThis feature is nice to have. It is low priority.needs: approvalNeeds review & approval before work can begin.needs: more demandNeeds more demand before work can begin, +1 or comment to support.needs: requirementsNeeds a a list of requirements before work can be begintype: enhancementA value-adding code change that enhances its existing functionality.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions