Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
575 commits
Select commit Hold shift + click to select a range
e8ffbd0
KAFKA-1812 Allow IpV6 in configuration with parseCsvMap patch by Jeff…
joestein Dec 12, 2014
0ef631b
kafka-1815; ServerShutdownTest fails in trunk; patched by Chris Cope;…
Dec 12, 2014
523b365
kafka-1813; Build fails for scala 2.9.2; patched by Anatoly Fayngeler…
fanatoly Dec 12, 2014
ae0bb84
KAFKA-742: Existing directories under the Kafka data directory withou…
Dec 17, 2014
92d1d4c
kafka-1797; add the serializer/deserializer api to the new java clien…
junrao Dec 18, 2014
8452187
KAFKA-1824 - fix ConsoleProducer so parse.key and key.separator will …
gwenshap Dec 19, 2014
10c6dec
KAFKA-1650; (Follow-up patch) to support no data loss in mirror maker…
becketqin Dec 24, 2014
4471dc0
kafka-1642; (followup patch) [Java New Producer Kafka Trunk] CPU Usag…
ewencp Jan 6, 2015
50b7346
kafka-1797; (follow-up patch) add the serializer/deserializer api to …
junrao Jan 6, 2015
517503d
kafka-1797; (delta follow-up patch) add the serializer/deserializer a…
junrao Jan 6, 2015
f82518a
KAFKA-1512 Fixes for limit the maximum number of connections per ip a…
joestein Jan 7, 2015
a93ef19
kafka-1797; (addressing Manikumar Reddy's comment) add the serializer…
junrao Jan 9, 2015
e52a618
kafka-1851; OffsetFetchRequest returns extra partitions when input on…
junrao Jan 9, 2015
b1b8086
KAFKA-1070 Auto assign broker id; reviewed by Neha Narkhede
Jan 12, 2015
ad4883a
KAFKA-1836 metadata.fetch.timeout.ms set to zero blocks forever; revi…
jaiforums Jan 12, 2015
14779dd
KAFKA-1819 Cleaner gets confused about deleted and re-created topics;…
gwenshap Jan 13, 2015
6f4dea9
kafka-1797; (missed parametric in a few files) add the serializer/des…
junrao Jan 13, 2015
688e38c
KAFKA-1723; make the metrics name in new producer more standard; patc…
omkreddy Jan 13, 2015
e79ebdf
KAFKA-1854 Allow JIRA username and password to be prompted in the abs…
jaiforums Jan 13, 2015
bfb2da3
trivial change to add byte serializer to ProducerPerformance; patched…
junrao Jan 13, 2015
a611178
KAFKA-1723 (delta patch to fix javadoc); make the metrics name in new…
omkreddy Jan 14, 2015
1c8f89b
KAFKA-1499; Broker-side compression configuration; reviewed by Joel K…
omkreddy Jan 14, 2015
45697ed
KAFKA-1499; Trivial follow-up (fix comments and whitespace)
jjkoshy Jan 15, 2015
602d572
kafka-1868; ConsoleConsumer shouldn't override dual.commit.enabled to…
junrao Jan 16, 2015
1769642
kafka-1870; Cannot commit with simpleConsumer on Zookeeper only with …
junrao Jan 17, 2015
5174df5
kafka-1864; Revisit defaults for the internal offsets topic; patched …
junrao Jan 17, 2015
09234f0
trivial change to remove -UseCompressedOops option from script
junrao Jan 17, 2015
49d7f8e
KAFKA-1723; num.partitions documented default is 1 while actual defau…
omkreddy Jan 19, 2015
07cff76
KAFKA-1878; ProducerFailureHandlingTest.testCannotSendToInternalTopic…
jaiforums Jan 19, 2015
5d648cf
KAFKA-1876; pom file for scala 2.11 should reference a specific versi…
junrao Jan 19, 2015
fcc2521
KAFKA-1823; Fix transient failure in PartitionAssignorTest; reviewed …
jjkoshy Jan 20, 2015
a0852d4
KAFKA-1848; check consumer shutting down flag inside retry loop; revi…
auradkar Jan 22, 2015
54e53b7
KAFKA-1891 MirrorMaker hides consumer exception - making troubleshoot…
joestein Jan 23, 2015
8cff911
KAFKA-1890 Fix bug preventing Mirror Maker from successful rebalance;…
becketqin Jan 23, 2015
ff5cbca
KAFKA-1896; Record size function should check if value is null; revie…
becketqin Jan 24, 2015
995d0d3
KAFKA-1109 Need to fix GC log configuration code, not able to overrid…
omkreddy Jan 26, 2015
4aa3dab
KAFKA-1883 Fix NullPointerException in RequestSendThread; reviewed by…
jaiforums Jan 26, 2015
0b171de
KAFKA-1885 Upgrade junit dependency in core to 4.6 version to allow r…
jaiforums Jan 26, 2015
0f6cc0a
KAFKA-1818 KAFKA-1818 clean up code to more idiomatic scala usage; re…
olandere Jan 26, 2015
f689e9b
KAFKA-1902; fix MetricName so that Yammer reporter can work correctly…
junrao Jan 29, 2015
11ec9bf
KAFKA-1861; Publishing kafka-client:test in order to utilize the help…
omkreddy Jan 29, 2015
0699ff2
KAFKA-1760: New consumer.
jkreps Jan 11, 2015
75a286e
KAFKA-1760 Follow-up: fix compilation issue with Scala 2.11
jkreps Jan 30, 2015
f1ba4ff
KAFKA-1729; Add constructor to javaapi to allow constructing explicit…
jjkoshy Feb 3, 2015
1c6d5bb
KAFKA-1915: Add checkstyle for java code.
jkreps Feb 3, 2015
0839def
KAFKA-1925; Fix coordinator broker id stuck with INT_MIN; reviewed by…
guozhangwang Feb 9, 2015
39cd48d
KAFKA-1333; Add the consumer coordinator to server; reviewed by Onur …
guozhangwang Feb 9, 2015
71602de
KAFKA-1333 follow-up; Add missing files for the coordinator folder
guozhangwang Feb 9, 2015
9fe9913
KAFKA-1476 Added a ConsumerCommand tool that will replace other consu…
onurkaraman Feb 10, 2015
a3d6dca
KAFKA-1948; Fix ConsumerTest.testPartitionReassignmentCallback handli…
guozhangwang Feb 13, 2015
eab4f4c
KAFKA-1697; Remove support for producer ack > 1 on the broker; review…
gwenshap Feb 13, 2015
5b949c7
KAFKA-1805; ProducerRecord should implement equals and hashCode; revi…
Feb 18, 2015
b8be314
KAFKA-1943; MessageSizeTooLarge and MessageSetSizeTooLarge should not…
auradkar Feb 18, 2015
cb40ec2
KAFKA-1914; Include total produce/fetch stats in broker topic metrics.
auradkar Feb 18, 2015
cdf0656
KAFKA-1959; Rename group to groupId in TestOffsetManager due to colli…
Feb 18, 2015
d5fbba6
KAFKA-1960; .gitignore does not exclude test generated files and fold…
Feb 18, 2015
f568436
kafka-1952; High CPU Usage in 0.8.2 release; patched by Jun Rao; revi…
junrao Feb 18, 2015
8d72816
KAFKA-1914; follow-up to address unit test failure
jjkoshy Feb 18, 2015
f7f8ac1
KAFKA-1914; follow-up to fix SimpleFetchTest; reviewed by Joel Koshy
auradkar Feb 19, 2015
4c8817e
KAFKA-1729; (followup patch)Add constructor to javaapi to allow
jjkoshy Feb 19, 2015
38346fb
Minor typo in KafkaConfig; reviewed by Gwen Shapira
zhouyaguo Feb 20, 2015
8c1b932
KAFKA-1867 liveBroker list not updated on a cluster with no topics; r…
Feb 21, 2015
fbb1154
Leaner DelayedItem; reviewed by Neha Narkhede and Joel Koshy
ymatsuda Feb 21, 2015
1903182
KAFKA-1919: Always update the metadata, when a metadata response is r…
jkreps Feb 5, 2015
62c7e0e
KAFKA-1947 can't explicitly set replica-assignment when add partition…
Feb 22, 2015
3f1e088
KAFKA-1757 Unmap file prior to delete on windows.
jkreps Feb 22, 2015
41189ea
kafka-1971; starting a broker with a conflicting id will delete the p…
junrao Feb 23, 2015
7c82afd
Added script for bin/kafka-consumer-groups.sh that was mistakenly dro…
onurkaraman Feb 24, 2015
10311c1
kafka-1984; java producer may miss an available partition; patched by…
junrao Feb 24, 2015
b8904e9
KAFKA-1953; KAFKA-1962; Disambiguate purgatory metrics; restore delay…
jjkoshy Feb 25, 2015
ef252de
kafka-1881; transient unit test failure in testDeleteTopicWithCleaner…
ewencp Feb 26, 2015
e39373d
kafka-1400; transient unit test failure in SocketServerTest; patched …
junrao Feb 27, 2015
a864172
Deleting the ConsumerTest until the issue with the hanging test is re…
nehanarkhede Feb 27, 2015
b56f597
KAFKA-1664 Kafka does not properly parse multiple ZK nodes with non-r…
Feb 27, 2015
687abc9
KAFKA-1866 LogStartOffset gauge throws exceptions after log.delete();…
Feb 28, 2015
22ff9e9
KAFKA-1824 ConsoleProducer - properties key.separator and parse.key n…
gwenshap Feb 28, 2015
0636928
KAFKA-1865 Add a flush() method to the producer.
jkreps Feb 7, 2015
1cd6ed9
KAFKA-1755; Reject compressed and unkeyed messages sent to compacted …
jjkoshy Mar 3, 2015
616987d
KAFKA-1852; Reject offset commits to unknown topics; reviewed by Joel…
Mar 3, 2015
c5d654a
KAFKA-1499; trivial follow-up (remove unnecessary parentheses)
jjkoshy Mar 3, 2015
57d38f6
KAFKA-1986; Request failure rate should not include invalid message s…
auradkar Mar 3, 2015
61f02fa
KAFKA-2001; Trivial commit to prevent OffsetCommitTest from hanging
jjkoshy Mar 4, 2015
4c9ad9b
KAFKA-2001; Trivial commit to fix OffsetCommitTest
jjkoshy Mar 4, 2015
151ae42
kafka-1999; Fix failing unit-test: kafka.api.ProducerFailureHandlingT…
gwenshap Mar 4, 2015
00c643e
KAFKA-1755; trivial follow-up to fix comment in CleanerTest
jjkoshy Mar 4, 2015
3a9f4b8
KAFKA-1988; Fix org.apache.kafka.common.utils.Utils.abs and add Parti…
Mar 4, 2015
8f0003f
KAFKA-1845 KafkaConfig should use ConfigDef patch by Andrii Biletskyi…
joestein Mar 5, 2015
67940c4
KAFKA-2009 Fix two minor bugs in mirror maker.
becketqin Mar 8, 2015
0b92cec
KAFKA-1910; Refactor new consumer and fixed a bunch of corner cases /…
guozhangwang Mar 10, 2015
01d2a25
KAFKA-1910; follow-up on fixing buffer.flip on produce requests
guozhangwang Mar 10, 2015
1eb5f53
KAFKA-1910; missed follow-up changes
guozhangwang Mar 11, 2015
01f20e0
KAFKA-1910 Follow-up again; fix ListOffsetResponse handling for the e…
guozhangwang Mar 11, 2015
b7439c8
kafka-1461; Replica fetcher thread does not implement any back-off be…
Mar 12, 2015
c41c7b4
KAFKA-1997; Refactor MirrorMaker based on KIP-3; reviewed by Joel Kos…
becketqin Mar 13, 2015
1caaf6d
KAFKA-1863; Add docs for possible thrown exception in Callback; revie…
guozhangwang Mar 13, 2015
5bbbb7f
KAFKA-1997; Follow-up to add the shutdown hook before starting the co…
becketqin Mar 17, 2015
82789e7
KAFKA-1997; Hopefully last follow-up fix to get messageHandlerArgs right
becketqin Mar 18, 2015
b2c833a
KAFKA-1910; Fix two bugs on MemoryRecords and KafkaConsumer; reviewed…
guozhangwang Mar 19, 2015
c62cff3
trivial fix on coding style
guozhangwang Mar 19, 2015
9911954
KAFKA-2042; Update topic list of the metadata regardless of cluster i…
becketqin Mar 24, 2015
4e0da49
KAFKA-2048; Change lock synchronized to inLock() for partitionMapCond…
xiaotao183 Mar 25, 2015
eb21008
KAFKA-1856 Add PreCommit Patch Testing patch by Ashish K Singh review…
joestein Mar 25, 2015
a74688d
kafka-527; Compression support does numerous byte copies; patched by …
ymatsuda Mar 25, 2015
5b42b53
KAFKA-2047; Move the stream creation into concurrent mirror maker thr…
becketqin Mar 25, 2015
d2f50fc
KAFKA-527; Use in-place decompression enabled inner iterator to repla…
guozhangwang Mar 26, 2015
c5df2a8
KAFKA-1634; Bump up Offset Commit Request to v2 to add global retenti…
guozhangwang Mar 27, 2015
d8fe98e
kafka-2044; Support requests and responses from o.a.k.common in Kafka…
gwenshap Mar 28, 2015
66c6f9b
kafka-2039; Update Scala to 2.10.5 and 2.11.6; patched by Ismael Juma…
ijuma Apr 1, 2015
619d78e
kafka-2013; benchmark test for the purgatory; patched by Yasuhiro Mat…
ymatsuda Apr 1, 2015
ad72253
kafka-2016; RollingBounceTest takes long; patched by Ted Malaska; rev…
Apr 3, 2015
48f9970
KAFKA-1961 Prevent deletion of _consumer_offsets topic; reviewed by N…
Apr 3, 2015
15b93a4
KAFKA-1546; Automate replica lag tuning; reviewed by Joel Koshy, Neha
auradkar Apr 4, 2015
6adaffd
KAFKA-1501 Let the OS choose the port in unit tests to avoid collisio…
ewencp Apr 4, 2015
70e5c92
KAFKA-2050 Avoid calling .size() on linked list.
Apr 4, 2015
a686a67
KAFKA-2002: Mx4JLoader doesn't disable when kafka_mx4jenable=false.
zhouyaguo Apr 4, 2015
7acfa92
KAFKA-2024 Log compaction can generate unindexable segments.
rajinisivaram Apr 4, 2015
9a07101
KAFKA-1996 Fix scaladoc error.
zhouyaguo Apr 4, 2015
07598ad
KAFKA-1005 Shutdown consumer at the end of consumer performance test.
pmackles Apr 5, 2015
53f3143
kafka-1809; Refactor brokers to allow listening on multiple ports and…
gwenshap Apr 6, 2015
9c23d93
kafka-1926; Replace kafka.utils.Utils with o.a.k.common.utils.Utils; …
Apr 6, 2015
75e1cc8
kafka-2043; CompressionType is passed in each RecordAccumulator appen…
granthenke Apr 6, 2015
04fce48
kafka-2099; BrokerEndPoint file, methods and object names should matc…
gwenshap Apr 7, 2015
b1cc725
kafka-2033; Small typo in documentation; patched by Pierre-Yves Ritsc…
pyr Apr 7, 2015
d9ab917
kafka-1992; checkEnoughReplicasReachOffset doesn't need to get requir…
gwenshap Apr 7, 2015
79f7cca
KAFKA-1461; Implement per-partition back-off for replica fetcher; rev…
Apr 7, 2015
013cda2
KAFKA-1910 Follow-up; Revert the no-offset-committed error code; revi…
guozhangwang Apr 7, 2015
06a2665
kafka-1973; Remove the accidentally created LogCleanerManager.scala.o…
granthenke Apr 8, 2015
fef709d
kafka-1517; Messages is a required argument to Producer Performance T…
danielcompton Apr 8, 2015
b47f811
kafka-2104; testDuplicateListeners() has a typo; patched by Gwen Shap…
gwenshap Apr 8, 2015
d3aa99c
kafka-2109; Support retries in KafkaLog4jAppender; patched by Dave Be…
Apr 8, 2015
6880f66
kafka-1989; New purgatory design; patched by Yasuhiro Matsuda; review…
ymatsuda Apr 8, 2015
194d1fc
kafka-2096; Enable keepalive socket option for broker to prevent sock…
Apr 9, 2015
2490b1c
kafka-2090; Remove duplicate check to metadataFetchInProgress; patche…
Tim-Brooks Apr 9, 2015
26673f9
kafka-2112; make overflowWheel volatile; patched by Yasuhiro Matsuda;…
ymatsuda Apr 9, 2015
fb86cf6
trivial fix for compilation error in scala 2.9.1
ewencp Apr 10, 2015
aa36563
kafka-2115; Error updating metrics in RequestChannel; patched by Gwen…
gwenshap Apr 13, 2015
157fba8
KAFKA-2117; Use the correct metadata field for reading offset struct;…
guozhangwang Apr 14, 2015
9e5d481
KAFKA-1416; Unify sendMessages in TestUtils; reviewed by Guozhang Wang
futtre Apr 14, 2015
bfbd3ac
KAFKA-2056; Fix transient testRangePartitionAssignor failure; reviewe…
lvfangmin Apr 15, 2015
5397d3c
kafka-2113; TestPurgatoryPerformance does not compile using IBM JDK; …
rajinisivaram Apr 16, 2015
813c423
kafka-2119; ConsumerRecord key() and value() methods should not have …
ewencp Apr 18, 2015
35297a8
kafka-2088; kafka-console-consumer.sh should not create zookeeper pat…
Zhiqiang-He Apr 18, 2015
185eb9b
kafka-1994; Evaluate performance effect of chroot check on Topic crea…
Apr 18, 2015
5408931
kafka-1982; change kafka.examples.Producer to use the new java produc…
Apr 19, 2015
7c5b240
kafka-1982; (add missing files) change kafka.examples.Producer to use…
Apr 19, 2015
761711e
kafka-2131; Update new producer javadocs with correct documentation l…
omkreddy Apr 19, 2015
3139cc3
kafka-1990; Add unlimited time-based log retention; patched by Jeff H…
jholoman Apr 19, 2015
ed11e17
TopicConfigManager javadoc references incorrect paths; reviewed by Ne…
auradkar Apr 20, 2015
6b96446
DelayedOperationTest.testRequestExpiry transient failure; reviewed by…
rajinisivaram Apr 20, 2015
01e94e2
KAFKA-2121; Close internnal modules upon client shutdown; reviewed by…
stevenzwu Apr 22, 2015
2166104
KAFKA-2138; Fix producer to honor retry backoff; reviewed by Joel Kos…
becketqin Apr 24, 2015
622e707
KAFKA-2034 sourceCompatibility not set in Kafka build.gradle; reviewe…
nehanarkhede Apr 25, 2015
ed1a548
KAFKA-2140 Improve code readability; reviewed by Neha Narkhede
ijuma Apr 26, 2015
ae79746
KAFKA-2122 Remove controller.message.queue.size Config; reviewed by N…
Apr 26, 2015
4c010fc
KAFKA-2140 follow up, checking in newly renamed file ConsumerRebalanc…
ijuma Apr 26, 2015
1000bb6
KAFKA-2128 kafka.Kafka should return non-zero exit code when caught e…
sasakitoa Apr 26, 2015
ba3e089
KAFKA-2114 Unable to change min.insync.replicas default; reviewed by …
gwenshap Apr 26, 2015
dbfe8c0
kafka-2118; Cleaner cannot clean after shutdown during replaceSegment…
rajinisivaram Apr 27, 2015
9735841
KAFKA-2121 Follow-up: minor bug fix as pointed out by Sean Lydon
guozhangwang Apr 28, 2015
22b3db4
kafka-1940; Initial checkout and build failing; patched by Martin Lem…
Apr 28, 2015
2e90f5e
KAFKA-1054; Eliminate Scala Compilation Warnings
Sep 5, 2014
f148d86
KAFKA-1621 : Standardize --messages option. Closes #58
rekhajoshm Apr 27, 2015
161b1aa
KAFKA-2068 Phase 1; Merge in KAFKA-1841; reviewed by Jun Rao
guozhangwang May 4, 2015
e40ebcf
KAFKA-1886 SimpleConsumer swallowing ClosedByInterruptException; revi…
auradkar May 4, 2015
944628b
KAFKA-2153 kafka-patch-review tool uploads a patch even if it is empt…
May 4, 2015
31dadf0
KAFKA-1884; Add logging upon metadata response errors; reviewed by Gu…
omkreddy May 7, 2015
5a47ef8
KAFKA-2121; Fix Closeable backward-compatibility; reviewed by Guozhan…
stevenzwu May 8, 2015
4328aa0
KAFKA-2121; add missing file
guozhangwang May 8, 2015
af50619
KAFKA-2150; move partitionMapCond.await into partitionMapLock; review…
May 12, 2015
9b57fe4
KAFKA-2175; Change INFO to DEBUG for socket close on no error; and pa…
May 12, 2015
2d5e0f0
KAFKA-2163; The offsets manager's stale-offset-cleanup and offset loa…
jjkoshy May 12, 2015
33af0cb
KAFKA-1660; Add API to the producer to support close with a timeout; …
becketqin May 12, 2015
49026f1
KAFKA-1334; Add the heartbeat logic to consumer coordinator; reviewed…
onurkaraman May 14, 2015
41ba262
kafka-2169; Upgrade to zkclient-0.5; patched by Parth Brahmbhatt; rev…
May 18, 2015
0ad6466
KAFKA-2160; remove watcher list if empty in purgatory; remove join-gr…
guozhangwang May 20, 2015
2941958
KAFKA-2196; Remove identical topic constraint in round-robin assignor…
onurkaraman May 20, 2015
bb133c6
KAFKA-1374; Log cleaner should be able to handle compressed messages;…
jjkoshy May 20, 2015
b4f2391
KAFKA-2190; Flush mirror maker before commiting offsets; abort the
becketqin May 21, 2015
23ff851
KAFKA-2186; Follow-up to KAFKA-1650 - add selective offset commit to
becketqin May 21, 2015
467736c
Revert "KAFKA-2186; Follow-up to KAFKA-1650 - add selective offset co…
jjkoshy May 21, 2015
43b92f8
KAFKA-1737; Enforce ZKSerializer while creating ZkClient; reviewed by…
vivekpm May 24, 2015
c60f325
kafka-2189; Snappy compression of message batches less efficient in 0…
ijuma May 28, 2015
05e8a78
KAFKA-2186; Follow-up to KAFKA-1650 - add selective offset commit to …
becketqin May 28, 2015
d6c45c7
KAFKA-2091; Expose a partitioner interface in the new producer
May 28, 2015
3836c57
kafka-2185; Update to Gradle 2.4; patched by Ismael Juma; reviewed by…
ijuma May 29, 2015
3d8494b
KAFKA-2199 Make signing artifacts optional and disabled by
ewencp May 29, 2015
9e894aa
kafka-2226; NullPointerException in TestPurgatoryPerformance; patched…
ymatsuda Jun 1, 2015
48edeca
KAFKA-2161; Fix a few copyrights
ewencp Jun 3, 2015
d22987f
KAFKA-2208; add consumer side error handling upon coordinator failure…
guozhangwang Jun 3, 2015
78ba492
kafka-1928; Move kafka.network over to using the network classes in o…
gwenshap Jun 4, 2015
ca6d01b
KAFKA-2246; UnknownTopicOrPartitionException should be an instance of…
becketqin Jun 5, 2015
9f80665
KAFKA-2253; fix deadlock between removeWatchersLock and watcher opera…
guozhangwang Jun 10, 2015
ab76dbd
kafka-2005; Generate html report for system tests; patched by Ashish …
Jun 11, 2015
017c00c
kafka-2266; Client Selector can drop idle connections without notifyi…
Jun 12, 2015
d31a2c2
kafka-2232; make MockProducer generic; patched by Alexander Pakulov; …
apakulov Jun 12, 2015
719f2bd
kafka-2164; ReplicaFetcherThread: suspicious log message on reset off…
resetius Jun 13, 2015
20a31a2
kafka-2101; Metric metadata-age is reset on a failed update; patched …
Tim-Brooks Jun 16, 2015
54e54f0
kafka-2195; Add versionId to AbstractRequest.getErrorResponse and Abs…
abiletskyi Jun 16, 2015
395716e
kafka-2270; incorrect package name in unit tests; patched by Proneet …
proneetv Jun 16, 2015
28ecea4
kafka-2272; listeners endpoint parsing fails if the hostname has capi…
Jun 16, 2015
7009f1d
kafka-2264; SESSION_TIMEOUT_MS_CONFIG in ConsumerConfig should be int…
omkreddy Jun 16, 2015
4785056
kafka-2252; Socket connection closing is logged, but not correspondin…
gwenshap Jun 16, 2015
9650e12
kafka-2262; LogSegmentSize validation should be consistent; patched b…
omkreddy Jun 16, 2015
ba86f0a
trivial fix for stylecheck error on Jenkins
junrao Jun 16, 2015
5c90407
kafka-2249; KafkaConfig does not preserve original Properties; patche…
gwenshap Jun 18, 2015
d9c0ad6
kafka-2265; creating a topic with large number of partitions takes a …
omkreddy Jun 18, 2015
5c2ca30
kafka-2234; Partition reassignment of a nonexistent topic prevents fu…
omkreddy Jun 18, 2015
1c93bb1
trivial change to fix unit test failure introduced in kafka-2234
junrao Jun 19, 2015
19c98cb
kafka-1758; corrupt recovery file prevents startup; patched by Maniku…
omkreddy Jun 19, 2015
ca75825
kafka-1646; Improve consumer read performance for Windows; patched by…
Jun 19, 2015
16ecf98
kafka-2012; Broker should automatically handle corrupt index files; …
omkreddy Jun 19, 2015
cf28f89
kafka-2290; OffsetIndex should open RandomAccessFile consistently; pa…
Jun 22, 2015
dc54055
kafka-2235; LogCleaner offset map overflow; patched by Ivan Simoneko;…
isimonenko Jun 22, 2015
1eac3ce
KAFKA-2245; Add response tests for consumer coordinator; reviewed by …
onurkaraman Jun 22, 2015
2270a75
KAFKA-2293; Fix incorrect format specification in Partition.scala; re…
auradkar Jun 22, 2015
b6d326b
kafka-2168; New consumer poll() can block other calls like position()…
Jun 23, 2015
6d4991e
KAFKA-2294; javadoc compile error due to illegal <p/> , build failing…
jmax01 Jun 23, 2015
9ff5b27
KAFKA-2281: avoid unnecessary value copying if logAsString is false; …
xiaotao183 Jun 30, 2015
14e0ce0
KAFKA-2168: minor follow-up patch; reviewed by Guozhang Wang
hachikuji Jul 1, 2015
3f8480c
KAFKA-1740: merge offset manager into consumer coordinator; reviewed …
guozhangwang Jul 2, 2015
fd612a2
kafka-2248; Use Apache Rat to enforce copyright headers; patched by E…
ewencp Jul 6, 2015
2d96da0
kafka-2132; Move Log4J appender to a separate module; patched by Ashi…
Jul 6, 2015
271b18d
KAFKA-2314: proper MirrorMaker's message handler help message; review…
lazyval Jul 7, 2015
f77dc38
kafka-1367; Broker topic metadata not kept in sync with ZooKeeper; pa…
Jul 7, 2015
ad485e1
KAFKA-2304 Supported enabling JMX in Kafka Vagrantfile patch by Stevo…
joestein Jul 7, 2015
a99f70f
KAFKA-2306: add another metric for buffer exhausted; reviewed by Guoz…
lindong28 Jul 7, 2015
826276d
KAFKA-2317: follow-up of KAFKA1367; reviewed by Guozhang Wang
Jul 7, 2015
f13dd80
KAFKA-2313: javadoc fix for KafkaConsumer deserialization; reviewed b…
onurkaraman Jul 7, 2015
23d72bc
KAFKA-2298; Client Selector can drop connections on InvalidReceiveExc…
lindong28 Jul 8, 2015
4204f4a
Trivial commit - explicitly exclude build/rat-report.xml from rat check
jjkoshy Jul 8, 2015
67b6b9a
KAFKA-2308: make MemoryRecords idempotent; reviewed by Guozhang Wang
gwenshap Jul 8, 2015
7df39e0
KAFKA-2316: Drop java 1.6 support; patched by Sriharsha Chintalapani …
Jul 8, 2015
ee88dbb
KAFKA-2327; broker doesn't start if config defines advertised.host bu…
Jul 9, 2015
9ca61d1
KAFKA-1740 follow-up: add state checking in handling heartbeat reques…
hachikuji Jul 10, 2015
4aba4bc
Trivial commit - explicitly exclude build/** from rat check
jjkoshy Jul 10, 2015
69b451e
KAFKA-2312: use atomic long for thread id reference; reviewed by Ewen…
Tim-Brooks Jul 13, 2015
bdbb967
kafka-972; MetadataRequest returns stale list of brokers; patched by …
Jul 14, 2015
a7e0ac3
KAFKA-2198: kafka-topics.sh exits with 0 status on failures; patched …
omkreddy Jul 14, 2015
99c0686
KAFKA-2123: add callback in commit api and use a delayed queue for as…
hachikuji Jul 15, 2015
4fcb7ac
KAFKA-2335; fix comment about thread safety
hachikuji Jul 15, 2015
83d17e5
[MINOR] fix new consumer heartbeat reschedule bug
hachikuji Jul 16, 2015
fa03a7c
KAFKA-2032: validate consumer's partition-assignment config; reviewed…
Jul 16, 2015
458ebeb
kafka-2323; Simplify ScalaTest dependency versions; patched by Ismael…
ijuma Jul 16, 2015
8fa24a6
kafka-2241; AbstractFetcherThread.shutdown() should not block on Read…
lindong28 Jul 16, 2015
1e0ed7a
kafka-2174; Wrong TopicMetadata deserialization; patched by Alexey Oz…
resetius Jul 17, 2015
5033b96
kafka-2271; transient unit test failure in KafkaConfigConfigDefTest.t…
Jul 17, 2015
31f6217
kafka-2103; kafka.producer.AsyncProducerTest failure; patched by Ewen…
ewencp Jul 17, 2015
15cba9f
KAFKA-2324; Update to Scala 2.11.7
ijuma Jul 17, 2015
a5b1188
KAFKA-2345; Attempt to delete a topic already marked for deletion th…
Jul 17, 2015
8463627
Adding a file missed while committing KAFKA-2345
gwenshap Jul 17, 2015
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
17 changes: 16 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,11 +1,13 @@
dist
*classes
target/
build/
.gradle/
lib_managed/
src_managed/
project/boot/
project/plugins/project/
project/sbt_project_definition.iml
patch-process/*
.idea
.svn
.classpath
Expand All @@ -14,3 +16,16 @@ project/sbt_project_definition.iml
.#*
rat.out
TAGS
*.iml
.project
.settings
.gradle
kafka.ipr
kafka.iws
.vagrant
Vagrantfile.local

config/server-*
config/zookeeper-*
core/data/*
gradle/wrapper/*
26 changes: 0 additions & 26 deletions .rat-excludes

This file was deleted.

31 changes: 0 additions & 31 deletions LICENSE
Original file line number Diff line number Diff line change
Expand Up @@ -200,34 +200,3 @@
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

-----------------------------------------------------------------------

SBT LICENSE

Copyright (c) 2008, 2009, 2010 Mark Harrah, Jason Zaugg
All rights reserved.

Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
1. Redistributions of source code must retain the above copyright
notice, this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright
notice, this list of conditions and the following disclaimer in the
documentation and/or other materials provided with the distribution.
3. The name of the author may not be used to endorse or promote products
derived from this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE AUTHOR ``AS IS'' AND ANY EXPRESS OR
IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES
OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED.
IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT,
INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT
NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF
THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

-----------------------------------------------------------------------
60 changes: 0 additions & 60 deletions README-sbt.md

This file was deleted.

152 changes: 94 additions & 58 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,81 +1,117 @@
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# Apache Kafka #
Apache Kafka
=================
See our [web site](http://kafka.apache.org) for details on the project.

## Building a jar and running it ##
1. ./gradlew copyDependantLibs
2. ./gradlew jar
3. Follow instuctions in http://kafka.apache.org/documentation.html#quickstart
You need to have [gradle](http://www.gradle.org/installation) installed.

## Running unit tests ##
./gradlew test
### First bootstrap and download the wrapper ###
cd kafka_source_dir
gradle

## Forcing re-running unit tests w/o code change ##
./gradlew cleanTest test
Now everything else will work

## Running a particular unit test ##
./gradlew -Dtest.single=RequestResponseSerializationTest core:test
### Building a jar and running it ###
./gradlew jar

Follow instuctions in http://kafka.apache.org/documentation.html#quickstart

### Building source jar ###
./gradlew srcJar

### Building javadocs and scaladocs ###
./gradlew javadoc
./gradlew javadocJar # builds a jar from the javadocs
./gradlew scaladoc
./gradlew scaladocJar # builds a jar from the scaladocs
./gradlew docsJar # builds both javadoc and scaladoc jar

### Running unit tests ###
./gradlew test

### Forcing re-running unit tests w/o code change ###
./gradlew cleanTest test

### Running a particular unit test ###
./gradlew -Dtest.single=RequestResponseSerializationTest core:test

### Running a particular test method within a unit test ###
./gradlew core:test --tests kafka.api.test.ProducerFailureHandlingTest.testCannotSendToInternalTopic
./gradlew clients:test --tests org.apache.kafka.clients.producer.MetadataTest.testMetadataUpdateWaitTime


### Running a particular unit test with log4j output ###
change the log4j setting in either clients/src/test/resources/log4j.properties or core/src/test/resources/log4j.properties
./gradlew -i -Dtest.single=RequestResponseSerializationTest core:test

### Building a binary release gzipped tar ball ###
./gradlew clean
./gradlew releaseTarGz
The above command will fail if you haven't set up the signing key. To bypass signing the artifact, you can run
./gradlew releaseTarGz -x signArchives

## Building a binary release gzipped tar ball ##
./gradlew clean
./gradlew releaseTarGz
The release file can be found inside ./core/build/distributions/.

## Cleaning the build ##
./gradlew clean
### Cleaning the build ###
./gradlew clean

### Running a task on a particular version of Scala (either 2.9.1, 2.9.2, 2.10.5 or 2.11.7) ###
#### (If building a jar with a version other than 2.10, need to set SCALA_BINARY_VERSION variable or change it in bin/kafka-run-class.sh to run quick start.) ####
./gradlew -PscalaVersion=2.9.1 jar
./gradlew -PscalaVersion=2.9.1 test
./gradlew -PscalaVersion=2.9.1 releaseTarGz

### Running a task for a specific project ###
This is for 'core', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples' and 'clients'
./gradlew core:jar
./gradlew core:test

### Listing all gradle tasks ###
./gradlew tasks

### Building IDE project ####
./gradlew eclipse
./gradlew idea

### Building the jar for all scala versions and for all projects ###
./gradlew jarAll

## Running a task on a particular version of Scala (either 2.8.0, 2.8.2, 2.9.1, 2.9.2 or 2.10.1) ##
## (If building a jar with a version other than 2.8.0, the scala version variable in bin/kafka-run-class.sh needs to be changed to run quick start.) ##
./gradlew -PscalaVersion=2.9.1 jar
./gradlew -PscalaVersion=2.9.1 test
./gradlew -PscalaVersion=2.9.1 releaseTarGz
### Running unit tests for all scala versions and for all projects ###
./gradlew testAll

## Running a task for a specific project in 'core', 'perf', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples', 'clients' ##
./gradlew core:jar
./gradlew core:test
### Building a binary release gzipped tar ball for all scala versions ###
./gradlew releaseTarGzAll

## Listing all gradle tasks ##
./gradlew tasks
### Publishing the jar for all version of Scala and for all projects to maven ###
./gradlew uploadArchivesAll

# Building IDE project ##
./gradlew eclipse
./gradlew idea
Please note for this to work you should create/update `~/.gradle/gradle.properties` and assign the following variables

# Building the jar for all scala versions and for all projects ##
./gradlew jarAll
mavenUrl=
mavenUsername=
mavenPassword=
signing.keyId=
signing.password=
signing.secretKeyRingFile=

## Running unit tests for all scala versions and for all projects ##
./gradlew testAll
### Publishing the jars without signing to a local repository ###
./gradlew -Dorg.gradle.project.skipSigning=true -Dorg.gradle.project.mavenUrl=file://path/to/repo uploadArchivesAll

## Building a binary release gzipped tar ball for all scala versions ##
./gradlew releaseTarGzAll
### Building the test jar ###
./gradlew testJar

## Publishing the jar for all version of Scala and for all projects to maven (To test locally, change mavenUrl in gradle.properties to a local dir.) ##
./gradlew uploadArchivesAll
### Determining how transitive dependencies are added ###
./gradlew core:dependencies --configuration runtime

### Running checkstyle on the java code ###
./gradlew checkstyleMain checkstyleTest

## Building the test jar ##
./gradlew testJar
### Running in Vagrant ###

## Determining how transitive dependencies are added ##
./gradlew core:dependencies --configuration runtime
See [vagrant/README.md](vagrant/README.md).

## Contribution ##
### Contribution ###

Kafka is a new project, and we are interested in building the community; we would welcome any thoughts or [patches](https://issues.apache.org/jira/browse/KAFKA). You can reach us [on the Apache mailing lists](http://kafka.apache.org/contact.html).
Apache Kafka is interested in building the community; we would welcome any thoughts or [patches](https://issues.apache.org/jira/browse/KAFKA). You can reach us [on the Apache mailing lists](http://kafka.apache.org/contact.html).

To contribute follow the instructions here:
* http://kafka.apache.org/contributing.html
Expand Down
Loading