KafkaIndexTask is currently too complicated. One thing making it complicated is that it should support the legacy mode (without incremental publishing) for rolling update. The doc is saying "the legacy mode should be remove from versions greater than 0.12.x", but I think it's worth to keep this for at least one more major release to support rolling update from earlier than 0.12.0 (like 0.11.0 -> 0.13.).
So, it makes sense for me to separate the codes for two modes of KafkaIndexTask into two different classes even though
- It might be a huge change.
- The class for the legacy mode will be removed once we stop supporting backward compatibility for rolling update.
Any thoughts?
KafkaIndexTask is currently too complicated. One thing making it complicated is that it should support the legacy mode (without incremental publishing) for rolling update. The doc is saying "the legacy mode should be remove from versions greater than 0.12.x", but I think it's worth to keep this for at least one more major release to support rolling update from earlier than 0.12.0 (like 0.11.0 -> 0.13.).
So, it makes sense for me to separate the codes for two modes of KafkaIndexTask into two different classes even though
Any thoughts?