Apache Kafka is an publish-subscribe messaging broker rethought as a distributed commit log http://kafka.apache.org/