CI sometimes fails with stale ballots check

[lumtis]

Describe the Issue
Example: https://github.com/zeta-chain/node/actions/runs/13650090622/job/38156693230

	Error Trace:	/go/delivery/zeta-node/e2e/runner/require.go:78
	            				/go/delivery/zeta-node/cmd/zetae2e/local/local.go:536
	            				/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:989
	            				/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1117
	            				/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1041
	            				/go/delivery/zeta-node/cmd/zetae2e/main.go:18
	            				/usr/local/go/src/runtime/proc.go:272
	            				/usr/local/go/src/runtime/asm_amd64.s:1700
	Error:      	"71" is not greater than or equal to "108"
	Messages:   	there should be no stale ballots

It might be linked to this change recently merged: #3553