Up until now the kafka source examples have been pretty basic, only including:
This needs to be expanded to support any configuration option a kafka consumer supports.
I think 2 primary approaches exist?
- Create 1:1 SQLFlow configuration options for each kafka consumer option
- Create a generic SQLFlow configuration that will just pass through configuration from yaml to kafka
- ??
The latter is preferable because it minimizes SQLFlows involvement and doesn't force SQLFlow to change on account of kafka cofiguration values
Up until now the kafka source examples have been pretty basic, only including:
This needs to be expanded to support any configuration option a kafka consumer supports.
I think 2 primary approaches exist?
The latter is preferable because it minimizes SQLFlows involvement and doesn't force SQLFlow to change on account of kafka cofiguration values