[Feature Request]: Managed transforms Java API

[chamikaramj]

What would you like to happen?

Add an API that allows easily configuring and managing Java transforms.

The initial target will be I/O connectors but this can be extended to other transforms in the future.

Pipeline authors will be able to configure such transforms in a generic way, for example using a URN/identifier and a config. Config might be available locally or in an external storage system / repository.

Runners will be able to dynamically add to/update functionality of the transforms or replace transforms with updated implementations.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner