Sending custom kafka messages?

[daluu]

Hi, it looks like DemandSpike can publish messages into kafka for load generation against system that uses kafka. But looking at the readme, I was wondering if there's a way to specify the exact message (format/content) to send to kafka with DemandSpike. Or is it just a basic simple boilerplate message that gets sent only?

[tuan08]

Hi,

The message is a wapper object, you can serialize any object to bytes, create a message with your bytes data

[smorin]

David,
What kind of test are you looking to run? What would be the goal?
-Steve

On Sun, Sep 20, 2015 at 7:58 PM, David Luu notifications@github.com wrote:

Hi, it looks like DemandSpike can publish messages into kafka for load
generation against system that uses kafka. But looking at the readme, I was
wondering if there's a way to specify the exact message (format/content) to
send to kafka with DemandSpike. Or is it just a basic simple boilerplate
message that gets sent only?

—
Reply to this email directly or view it on GitHub
#21.

Steve Morin | Managing Partner - CTO

Nvent

O 800-407-1156 ext 803 <800-407-1156;803> | M 347-453-5579

smorin@nventdata.com smorin@nventdata.com

Executive Assistant

Caitlyn Fontes

T 774-328-1242 <774-328-1242>

cfontes@nventdata.com

Enabling the Data Driven Enterprise
(Ask us how we can setup scalable open source realtime billion+ event/data
collection/analytics infrastructure in weeks)

Service Areas: Management & Strategy Consulting | Data Engineering | Data
Science & Visualization

BigData Technologies: Hadoop & Ecosystem | NoSql| Hbase | Cassandra | Storm
| Spark | Kafka | Mesos | Docker | & More

Industries: IoT | Advertising | Retail | Manufacturing | TV & Cable |
Energy | Oil & Gas | Insurance | Finance | Telecom

[daluu]

(End to end) system wide load testing, for a system that relies on kafka as messaging bus. And we send unique JSON payloads into kafka for consumption by our system's consumers. So we can't just send simple/dummy data messages, that's why I asked about this.

The goal would be to see how the overall system behaves under load, and how much load it can support with a given configuration (system is composed of microservices that we can scale, so we'd be testing with a certain scalability configuration to start with).

[smorin]

We can work with you on that we have a new version of DemandSpike coming
out.
-Steve

On Tue, Sep 22, 2015 at 7:14 PM, David Luu notifications@github.com wrote:

(End to end) system wide load testing, for a system that relies on kafka
as messaging bus. And we send unique JSON payloads into kafka for
consumption by our system's consumers. So we can't just send simple/dummy
data messages, that's why I asked about this.

The goal would be to see how the overall system behaves under load, and
how much load it can support with a given configuration (system is composed
of microservices that we can scale, so we'd be testing with a certain
scalability configuration to start with).

—
Reply to this email directly or view it on GitHub
#21 (comment)
.

Steve Morin | Hacker, Entrepreneur, Startup Advisor
twitter.com/SteveMorin | stevemorin.com
Live the dream start a startup. Make the world ... a better place.

[daluu]

Great, looking forward to that. We haven't started working on the load testing yet. I'm just exploring options right now.

On a related note, you have any thoughts on how this tool/framework compares to other more general purpose load test tools (with kafka specific plugins)? Like:

JMeter
https://github.com/BrightTag/kafkameter

Gatling
https://github.com/mnogu/gatling-kafka

[smorin]

Guess what's the specific need? Because there are few specific use-cases where demands pike excels

On Sep 22, 2015, at 20:57, David Luu notifications@github.com wrote:

Great, looking forward to that. We haven't started working on the load testing yet. I'm just exploring options right now.

On a related note, you have any thoughts on how this tool/framework compares to other more general purpose load test tools (with kafka specific plugins)? Like:

JMeter
https://github.com/BrightTag/kafkameter

Gatling
https://github.com/mnogu/gatling-kafka

—
Reply to this email directly or view it on GitHub.