-
Notifications
You must be signed in to change notification settings - Fork 2k
Description
This has been discussed, and clarifies the intent behind #2012. It is becoming clear that runtimes will likely replace the entire transform pipeline, at least for operations that cross the fundamental boundary. We can further encourage this by allowing users to call other "function" transforms from within runtimes.
Note, this should be limited to transforms that do not aggregate, only simple input/output transforms. For example, we should not allow users to call the merge, dedupe, or transaction transforms within a runtime since this would complicate the runtime APIs. I'm open to solutions for these, but I'm not sure they are worth it.
Finally, I do not think we should address this in #2000. We should defer this and follow up with this addition, assuming it is possible.