KAFKA-7632: Allow fine-grained configuration for compression#5927

Closed

dongjinleekr wants to merge 19 commits intoapache:trunkfrom

dongjinleekr:feature/KAFKA-7632

Commits on Jun 22, 2019

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long)
dongjinleekr
committed
Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, int)
dongjinleekr
committed
Remove MemoryRecords#builder(ByteBuffer, CompressionType, long, long, short, int, boolean)
dongjinleekr
committed
Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int)
dongjinleekr
committed
Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int, boolean, int)
dongjinleekr
committed
Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int, boolean, boolean, int)
dongjinleekr
committed
Refactor MemoryRecords#writeEndTransactionalMarker to use MemoryRecords#builder, instead of instantiating MemoryRecordsBuilder directly
dongjinleekr
committed
Refactor MemoryRecords#withRecords to use MemoryRecords#builder, instead of instantiating MemoryRecordsBuilder directly
dongjinleekr
committed
Add BrokerCompressionTest#testGetTargetCompressionCodec: validates BrokerCompressionCodec#getTargetCompressionCodec(String, CompressionCodec)
dongjinleekr
committed
BrokerCompressionCodec#getTargetCompressionCodec -> BrokerCompressionCodec#getTargetCompressionType. (returns CompressionType)
dongjinleekr
committed
Refactor KafkaLZ4BlockOutputStream, KafkaLZ4Test + Add support to compression level, block size configuration for lz4.
dongjinleekr
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

KAFKA-7632: Allow fine-grained configuration for compression#5927

KAFKA-7632: Allow fine-grained configuration for compression#5927
dongjinleekr wants to merge 19 commits intoapache:trunkfrom
dongjinleekr:feature/KAFKA-7632

Commits on Jun 21, 2019

Remove MemoryRecordsBuilder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int, boolean, boolean, int, int): test-only method.

a builder to build MemoryRecordsBuilder with a fluent method call, also can support more than 13 parameters.

Remove MemoryRecords#builder(ByteBuffer, CompressionType, TimestampType, long)

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long)

Commits on Jun 22, 2019

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long)

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, int)

Remove MemoryRecords#builder(ByteBuffer, CompressionType, long, long, short, int, boolean)

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int)

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int, boolean, int)

Remove MemoryRecords#builder(ByteBuffer, byte, CompressionType, TimestampType, long, long, long, short, int, boolean, boolean, int)

Refactor MemoryRecords#writeEndTransactionalMarker to use MemoryRecords#builder, instead of instantiating MemoryRecordsBuilder directly

Refactor MemoryRecords#withRecords to use MemoryRecords#builder, instead of instantiating MemoryRecordsBuilder directly

Add BrokerCompressionTest#testGetTargetCompressionCodec: validates BrokerCompressionCodec#getTargetCompressionCodec(String, CompressionCodec)

BrokerCompressionCodec#getTargetCompressionCodec -> BrokerCompressionCodec#getTargetCompressionType. (returns CompressionType)

Refactor KafkaLZ4BlockOutputStream, KafkaLZ4Test + Add support to compression level, block size configuration for lz4.

Commits on Jun 24, 2019

Add GZipOutputStream to support compression level, block size for Gzip

Add CompressionConfig + expand CompressionType#wrapForOutput

Make broker to use CompressionConfig

Make RecordAccumulator to use CompressionConfig