Skip to content

KAFKA-7918: Inline generic parameters Pt. III: in-memory window store#6328

Merged
guozhangwang merged 2 commits intoapache:trunkfrom
ableegoldman:InlineByteStoreTypes_Part_III
Mar 1, 2019
Merged

KAFKA-7918: Inline generic parameters Pt. III: in-memory window store#6328
guozhangwang merged 2 commits intoapache:trunkfrom
ableegoldman:InlineByteStoreTypes_Part_III

Conversation

@ableegoldman
Copy link
Copy Markdown
Member

Third (and final) PR in series to inline the generic parameters of the following bytes stores:

[Pt. I] InMemoryKeyValueStore
[Pt. II] RocksDBWindowStore
[Pt. II] RocksDBSessionStore
[Pt. II] MemoryLRUCache
[Pt. II] MemoryNavigableLRUCache
[x] InMemoryWindowStore

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@ableegoldman
Copy link
Copy Markdown
Member Author

Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM just a couple of minor formatting comments.

@Deprecated
@Override
public KeyValueIterator<Windowed<K>, V> fetch(final K from, final K to, final long timeFrom, final long timeTo) {
public KeyValueIterator<Windowed<Bytes>, byte[]> fetch(final Bytes from, final Bytes to, final long timeFrom, final long timeTo) {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: parameters on a separate line


private KeyValue<Windowed<K>, V> getWindowedKeyValue(final K key, final long startTimestamp, final V value) {
final Windowed<K> windowedK = new Windowed<>(key, new TimeWindow(startTimestamp, startTimestamp + windowSize));
private KeyValue<Windowed<Bytes>, byte[]> getWindowedKeyValue(final Bytes key, final long startTimestamp, final byte[] value) {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: parameters on a separate line

@ableegoldman
Copy link
Copy Markdown
Member Author

JDK 11 failed on kafka.api.PlaintextConsumerTest.testAutoCommitIntercept
JDK 8 failed on kafka.api.SaslSslAdminClientIntegrationTest.testMinimumRequestTimeouts

Failures unrelated. Retest this, please

@bbejeck
Copy link
Copy Markdown
Member

bbejeck commented Feb 27, 2019

Java 11 passed, Java 8 failure unrelated

kafka.api.AuthorizerIntegrationTest.testSendOffsetsWithNoConsumerGroupWriteAccess
kafka.api.AuthorizerIntegrationTest.testDeleteGroupApiWithDeleteGroupAcl

retest this please

@bbejeck
Copy link
Copy Markdown
Member

bbejeck commented Feb 28, 2019

Java 11 passed,
Java 8 failed results already cleaned up

retest this please

Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@guozhangwang
Copy link
Copy Markdown
Contributor

The jenkins machine seems failed. I've ran the tests locally and they pass, will merge now.

@guozhangwang guozhangwang merged commit b03e8c2 into apache:trunk Mar 1, 2019
jarekr pushed a commit to confluentinc/kafka that referenced this pull request Apr 18, 2019
* apache/trunk:
  KAFKA-7880:Naming worker thread by task id (apache#6275)
  improve some logging statements (apache#6078)
  KAFKA-7312: Change broker port used in testMinimumRequestTimeouts and testForceClose
  KAFKA-7997: Use automatic RPC generation in SaslAuthenticate
  KAFKA-8002; Log dir reassignment stalls if future replica has different segment base offset (apache#6346)
  KAFKA-3522: Add TimestampedKeyValueStore builder/runtime classes (apache#6152)
  HOTFIX: add igore import to streams_upgrade_test
  MINOR: ConsumerNetworkClient does not need to send the remaining requests when the node is not ready (apache#6264)
  KAFKA-7922: Return authorized operations in describe consumer group responses (KIP-430 Part-1)
  KAFKA-7918: Inline generic parameters Pt. III: in-memory window store (apache#6328)
  KAFKA-8012; Ensure partitionStates have not been removed before truncating. (apache#6333)
  KAFKA-8011: Fix for race condition causing concurrent modification exception (apache#6338)
  KAFKA-7912: Support concurrent access in InMemoryKeyValueStore (apache#6336)
  MINOR: Skip quota check when replica is in sync (apache#6344)
  HOTFIX: Change header back to http instead of https to path license header test (apache#6347)
  MINOR: fix release.py script (apache#6317)
  MINOR: Remove types from caching stores (apache#6331)
  MINOR: Improve logging for alter log dirs (apache#6302)
  MINOR: state.cleanup.delay.ms default is 600,000 ms (10 minutes). (apache#6345)
  MINOR: disable Streams system test for broker upgrade/downgrade (apache#6341)
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
…apache#6328)

Third (and final) PR in series to inline the generic parameters of the following bytes stores:

[Pt. I] InMemoryKeyValueStore
[Pt. II] RocksDBWindowStore
[Pt. II] RocksDBSessionStore
[Pt. II] MemoryLRUCache
[Pt. II] MemoryNavigableLRUCache
[x] InMemoryWindowStore

Reviewers: Bill Bejeck <bill@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants