Upgrade to PebbleDB v2 + Add DefaultComparer Config Option by Kbhat1 · Pull Request #2695 · sei-protocol/sei-chain

Kbhat1 · 2026-01-12T23:17:45Z

Describe your changes and provide context

PebbleDB v2 Upgrade:

Benchmarks show significant improvements in write/read throughput and latency
Updated imports across sei-db/db_engine/pebbledb/ and sei-db/db_engine/pebbledb/mvcc/
Added required v2 comparer functions (ComparePointSuffixes, CompareRangeSuffixes)
Updated metrics API to use v2 field names

DefaultComparer Option:

UseDefaultComparer config enables Pebble's default lexicographic comparer instead of custom MVCCComparer
Only available programmatically via StateStoreConfig - intentionally NOT exposed in TOML
Useful for modules like EVM where MVCC iteration isn't needed
MVCC key encoding already uses BigEndian for versions, so ordering is compatible

Testing performed to validate your change

Added unit tests
Tested on node to verify state sync + queries worked

github-actions · 2026-01-12T23:18:28Z

The latest Buf updates on your PR. Results from workflow Buf / buf (pull_request).

Build	Format	Lint	Breaking	Updated (UTC)
`✅ passed`	`✅ passed`	`✅ passed`	`✅ passed`	Jan 20, 2026, 3:04 PM

codecov · 2026-01-12T23:25:39Z

Codecov Report

❌ Patch coverage is 61.70213% with 18 lines in your changes missing coverage. Please review.
✅ Project coverage is 44.00%. Comparing base (7d1130e) to head (c59e1a9).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
sei-db/state_db/ss/test/storage_test_suite.go	0.00%	13 Missing ⚠️
sei-db/db_engine/pebbledb/mvcc/db.go	80.95%	4 Missing ⚠️
sei-db/config/config.go	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2695      +/-   ##
==========================================
- Coverage   44.00%   44.00%   -0.01%     
==========================================
  Files        1980     1980              
  Lines      162718   162724       +6     
==========================================
- Hits        71612    71607       -5     
- Misses      84590    84595       +5     
- Partials     6516     6522       +6

Flag	Coverage Δ
sei-chain	`46.19% <61.70%> (+<0.01%)`	⬆️
sei-cosmos	`38.20% <ø> (-0.01%)`	⬇️
sei-db	`68.72% <ø> (ø)`
sei-tendermint	`47.27% <ø> (-0.03%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
sei-db/db_engine/pebbledb/batch.go	`100.00% <ø> (ø)`
sei-db/db_engine/pebbledb/db.go	`90.41% <100.00%> (+0.27%)`	⬆️
sei-db/db_engine/pebbledb/iterator.go	`100.00% <ø> (ø)`
sei-db/db_engine/pebbledb/mvcc/batch.go	`77.90% <ø> (ø)`
sei-db/db_engine/pebbledb/mvcc/comparator.go	`60.00% <ø> (ø)`
sei-db/db_engine/pebbledb/mvcc/iterator.go	`54.20% <ø> (ø)`
sei-db/config/config.go	`0.00% <0.00%> (ø)`
sei-db/db_engine/pebbledb/mvcc/db.go	`55.80% <80.95%> (+0.55%)`	⬆️
sei-db/state_db/ss/test/storage_test_suite.go	`0.00% <0.00%> (ø)`

... and 11 files with indirect coverage changes

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

blindchaser · 2026-01-13T15:47:07Z

sei-db/db_engine/pebbledb/mvcc/db.go


+	// Select comparer based on config. Note: UseDefaultComparer is NOT backwards compatible
+	// with existing databases created with MVCCComparer - Pebble will refuse to open due to
+	// comparer name mismatch. Only use UseDefaultComparer for NEW databases.


if mismatch happens, is there a way we can show some errors to the user?

or the pebble already has the error inside?

It will fail to open the db @blindchaser , so error will show up

Will paste snippet of the error

Kbhat1 · 2026-01-14T20:28:22Z

@yzang2019 @yzang2019 @jewei1997 please take a look again

sei-db/db_engine/pebbledb/mvcc/db_test.go

sei-db/db_engine/pebbledb/mvcc/comparator.go

Kbhat1 · 2026-01-16T16:11:40Z

sei-db/db_engine/pebbledb/mvcc/db_test.go

+// instead of MVCCComparer. This is useful for new databases that don't need backwards compatibility.
+// Note: Iterator tests are skipped because DefaultComparer doesn't have the Split function
+// configured for MVCC key encoding, so NextPrefix/SeekLT operations won't work correctly.
+func TestStorageTestSuiteDefaultComparer(t *testing.T) {


@masih likely a cleaner way to do this, but we want to eventually remove all iteration from state store. Right now its an artifact of cosmos (iteration) in v2

Kbhat1 · 2026-01-16T16:11:59Z

sei-db/state_db/ss/test/storage_test_suite.go

 }

 func (s *StorageTestSuite) TestDatabaseIteratorEmptyDomain() {
+	if slices.Contains(s.SkipTests, s.T().Name()) {


@masih again, likely a cleaner way to do this, but we want to eventually remove all iteration from state store. Right now its an artifact of cosmos (iteration) in v2

sei-db/db_engine/pebbledb/mvcc/comparator.go

masih · 2026-01-16T16:31:13Z

sei-db/db_engine/pebbledb/mvcc/db.go

@@ -83,15 +83,24 @@ func OpenDB(dataDir string, config config.StateStoreConfig) (*Database, error) {
 	cache := pebble.NewCache(1024 * 1024 * 32)


Unrelated to this PR: we probably should bump this value. It seems small for seid?

sei-db/db_engine/pebbledb/mvcc/db.go

sei-db/db_engine/pebbledb/mvcc/db_test.go

## Describe your changes and provide context PebbleDB v2 Upgrade: - Benchmarks show significant improvements in write/read throughput and latency - Updated imports across sei-db/db_engine/pebbledb/ and sei-db/db_engine/pebbledb/mvcc/ - Added required v2 comparer functions (ComparePointSuffixes, CompareRangeSuffixes) - Updated metrics API to use v2 field names DefaultComparer Option: - UseDefaultComparer config enables Pebble's default lexicographic comparer instead of custom MVCCComparer - Only available programmatically via StateStoreConfig - intentionally NOT exposed in TOML - Useful for modules like EVM where MVCC iteration isn't needed - MVCC key encoding already uses BigEndian for versions, so ordering is compatible ## Testing performed to validate your change - Added unit tests - Tested on node to verify state sync + queries worked

PebbleDB v2 Upgrade: - Benchmarks show significant improvements in write/read throughput and latency - Updated imports across sei-db/db_engine/pebbledb/ and sei-db/db_engine/pebbledb/mvcc/ - Added required v2 comparer functions (ComparePointSuffixes, CompareRangeSuffixes) - Updated metrics API to use v2 field names DefaultComparer Option: - UseDefaultComparer config enables Pebble's default lexicographic comparer instead of custom MVCCComparer - Only available programmatically via StateStoreConfig - intentionally NOT exposed in TOML - Useful for modules like EVM where MVCC iteration isn't needed - MVCC key encoding already uses BigEndian for versions, so ordering is compatible - Added unit tests - Tested on node to verify state sync + queries worked

Support default mvcccomparer

d2039fc

Set default

7ab6584

Kbhat1 requested review from blindchaser and yzang2019 and removed request for yzang2019 January 12, 2026 23:56

Kbhat1 added the non-app-hash-breaking label Jan 12, 2026

yzang2019 approved these changes Jan 12, 2026

View reviewed changes

Kbhat1 requested a review from jewei1997 January 13, 2026 05:03

blindchaser reviewed Jan 13, 2026

View reviewed changes

Migrate to Pebbledb v2

5a50264

Kbhat1 changed the title ~~Support Default Pebble Comparer~~ PebbleDB V2 and Default Comparer Jan 14, 2026

Kbhat1 changed the title ~~PebbleDB V2 and Default Comparer~~ Upgrade to PebbleDB v2 + Add DefaultComparer Config Option Jan 14, 2026

Kbhat1 requested review from blindchaser and yzang2019 January 14, 2026 17:53

Merge branch 'main' into PebbleDefaultMVCC

877b682

Kbhat1 added 2 commits January 14, 2026 18:06

Merge branch 'main' into PebbleDefaultMVCC

d261e7d

Update tests

97b9973

yzang2019 reviewed Jan 14, 2026

View reviewed changes

sei-db/db_engine/pebbledb/mvcc/db_test.go Outdated Show resolved Hide resolved

blindchaser approved these changes Jan 15, 2026

View reviewed changes

yzang2019 reviewed Jan 15, 2026

View reviewed changes

sei-db/db_engine/pebbledb/mvcc/comparator.go Outdated Show resolved Hide resolved

Kbhat1 requested a review from masih January 16, 2026 15:13

Kbhat1 commented Jan 16, 2026

View reviewed changes

masih reviewed Jan 16, 2026

View reviewed changes

Kbhat1 added 3 commits January 16, 2026 12:01

Merge branch 'main' into PebbleDefaultMVCC

115790b

compression

9ca5967

FormatMajorVersion set to default pebble.FormatVirtualSSTables

d5937f4

Kbhat1 added 5 commits January 16, 2026 14:57

Default comparator

28a37ea

Remove redundant check

8d16815

Refactor storage test suite

bd55471

Merge branch 'main' into PebbleDefaultMVCC

db37222

Update rocksdb test

c59e1a9

Kbhat1 merged commit e52b2a7 into main Jan 20, 2026
61 of 65 checks passed

Kbhat1 deleted the PebbleDefaultMVCC branch January 20, 2026 15:50

		@@ -83,15 +83,24 @@ func OpenDB(dataDir string, config config.StateStoreConfig) (*Database, error) {
		cache := pebble.NewCache(1024 * 1024 * 32)

Conversation

Kbhat1 commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Describe your changes and provide context

Testing performed to validate your change

Uh oh!

github-actions bot commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov bot commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

blindchaser Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

blindchaser Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

Kbhat1 Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

Kbhat1 Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

Kbhat1 commented Jan 14, 2026

Uh oh!

Uh oh!

Uh oh!

Kbhat1 Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Kbhat1 Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

masih Jan 16, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Kbhat1 commented Jan 12, 2026 •

edited

Loading

github-actions bot commented Jan 12, 2026 •

edited

Loading

codecov bot commented Jan 12, 2026 •

edited

Loading