Skip to content

KAFKA-18343: Use java_pids to implement pids#18312

Merged
jolshan merged 1 commit intoapache:trunkfrom
brandboat:KAFKA-18343
Dec 24, 2024
Merged

KAFKA-18343: Use java_pids to implement pids#18312
jolshan merged 1 commit intoapache:trunkfrom
brandboat:KAFKA-18343

Conversation

@brandboat
Copy link
Copy Markdown
Member

related to KAFKA-18343,

Currently, there is an issue that the ps ax output is truncated, which causes the Kafka process ID to be unavailable. This issue can be mitigated by replacing ps ax with jcmd (i.e. using java_pids in ducktape), as it does not suffer from the truncation problem.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@github-actions github-actions bot added tests Test fixes (including flaky tests) small Small PRs labels Dec 24, 2024
@brandboat
Copy link
Copy Markdown
Member Author

Ran ducktape tests/kafkatest/tests/core/transactions_upgrade_test.py and all passed

SESSION REPORT (ALL TESTS)
ducktape version: 0.12.0
session_id:       2024-12-24--015
run time:         63 minutes 36.810 seconds
tests run:        9
passed:           9
flaky:            0
failed:           0
ignored:          0

Test Result
[INFO:2024-12-24 22:46:51,731]: starting test run with session id 2024-12-24--015...
[INFO:2024-12-24 22:46:51,731]: running 9 tests...
[INFO:2024-12-24 22:46:51,731]: Triggering test 1 of 9...
[INFO:2024-12-24 22:46:51,736]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.1.2', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 22:46:51,737]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 22:46:51,738]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 22:46:51,738]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 22:52:06,870]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 22:55:02,182]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 22:55:02,182]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 22:55:02,284]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 22:55:02,285]: Triggering test 2 of 9...
[INFO:2024-12-24 22:55:02,290]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.2.3', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 22:55:02,293]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 22:55:02,293]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 22:55:02,293]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 22:58:49,326]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:01:42,617]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:01:42,618]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:01:42,720]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:01:42,720]: Triggering test 3 of 9...
[INFO:2024-12-24 23:01:42,725]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.3.2', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:01:42,728]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:01:42,728]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:01:42,728]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:05:44,497]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:08:38,403]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:08:38,404]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:08:38,506]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:08:38,506]: Triggering test 4 of 9...
[INFO:2024-12-24 23:08:38,510]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.4.1', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:08:38,512]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:08:38,512]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:08:38,512]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:12:15,364]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:15:08,834]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:15:08,834]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:15:08,937]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:15:08,937]: Triggering test 5 of 9...
[INFO:2024-12-24 23:15:08,942]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.5.2', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:15:08,944]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:15:08,944]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:15:08,944]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:18:58,026]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:21:51,520]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:21:51,521]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:21:51,623]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:21:51,623]: Triggering test 6 of 9...
[INFO:2024-12-24 23:21:51,627]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.6.2', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:21:51,629]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:21:51,629]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:21:51,629]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:25:37,525]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:28:31,477]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:28:31,478]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:28:31,580]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:28:31,580]: Triggering test 7 of 9...
[INFO:2024-12-24 23:28:31,585]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.7.2', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:28:31,587]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:28:31,587]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:28:31,587]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:32:49,996]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:35:44,136]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:35:44,136]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:35:44,239]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:35:44,239]: Triggering test 8 of 9...
[INFO:2024-12-24 23:35:44,243]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.8.1', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:35:44,246]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:35:44,247]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:35:44,247]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:39:54,154]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:42:47,828]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:42:47,828]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
[INFO:2024-12-24 23:42:47,931]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2024-12-24 23:42:47,931]: Triggering test 9 of 9...
[INFO:2024-12-24 23:42:47,935]: RunnerClient: Loading test {'directory': '/home/brandboat/Code/kafka/kafka/tests/kafkatest/tests/core', 'file_name': 'transactions_upgrade_test.py', 'cls_name': 'TransactionsUpgradeTest', 'method_name': 'test_transactions_upgrade', 'injected_args': {'from_kafka_version': '3.9.0', 'metadata_quorum': 'ISOLATED_KRAFT', 'use_new_coordinator': False, 'group_protocol': None}}
[INFO:2024-12-24 23:42:47,937]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: on run 1/1
[INFO:2024-12-24 23:42:47,937]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Setting up...
[INFO:2024-12-24 23:42:47,937]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Running...
[INFO:2024-12-24 23:47:34,378]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Tearing down...
[INFO:2024-12-24 23:50:28,437]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: PASS
[INFO:2024-12-24 23:50:28,438]: RunnerClient: kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None: Data: None
=======================================================================================================================================================================================
SESSION REPORT (ALL TESTS)
ducktape version: 0.12.0
session_id:       2024-12-24--015
run time:         63 minutes 36.810 seconds
tests run:        9
passed:           9
flaky:            0
failed:           0
ignored:          0
=======================================================================================================================================================================================
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.1.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   8 minutes 10.445 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.2.3.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   6 minutes 40.324 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.3.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   6 minutes 55.675 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.4.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   6 minutes 30.322 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.5.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   6 minutes 42.576 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.6.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   6 minutes 39.849 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.7.2.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   7 minutes 12.549 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.8.1.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   7 minutes 3.581 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_id:    kafkatest.tests.core.transactions_upgrade_test.TransactionsUpgradeTest.test_transactions_upgrade.from_kafka_version=3.9.0.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False.group_protocol=None
status:     PASS
run time:   7 minutes 40.500 seconds
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

@jolshan
Copy link
Copy Markdown
Member

jolshan commented Dec 24, 2024

Yay it worked! https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2024-12-24--001.6bf694c9-7478-494e-94f3-efb7620b7069--1735064470--brandboat--KAFKA-18343--5cff5e559e/report.html

I also started a build for all the tests, but that will take a few more hours. Not sure if we want to wait for that to complete too.

@jolshan
Copy link
Copy Markdown
Member

jolshan commented Dec 24, 2024

@jolshan
Copy link
Copy Markdown
Member

jolshan commented Dec 24, 2024

I will merge and cherry-pick to 4.0

@jolshan jolshan merged commit 4567f39 into apache:trunk Dec 24, 2024
jolshan pushed a commit that referenced this pull request Dec 24, 2024
Related to KAFKA-18343,

Currently, there is an issue that the ps ax output is truncated, which causes the Kafka process ID to be unavailable. This issue can be mitigated by replacing ps ax with jcmd (i.e. using java_pids in ducktape), as it does not suffer from the truncation problem.

Reviewers: Justine Olshan <jolshan@confluent.io>
@brandboat brandboat deleted the KAFKA-18343 branch December 24, 2024 23:05
tedyu pushed a commit to tedyu/kafka that referenced this pull request Jan 6, 2025
Related to KAFKA-18343,

Currently, there is an issue that the ps ax output is truncated, which causes the Kafka process ID to be unavailable. This issue can be mitigated by replacing ps ax with jcmd (i.e. using java_pids in ducktape), as it does not suffer from the truncation problem.

Reviewers: Justine Olshan <jolshan@confluent.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

small Small PRs tests Test fixes (including flaky tests)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants