OpenDAL's kvrocks tests failing after 2.6.0 released

[Xuanwo]

Search before asking

• I had searched in the issues and found no similar issues.

Version

2.6.0

Minimal reproduce step

Fork https://github.com/apache/incubator-opendal and running it's kvrocks test

  kvrocks:
    runs-on: ubuntu-latest
    services:
      redis:
        image: apache/kvrocks
        ports:
          - 6379:6666
    steps:
      - uses: actions/checkout@v3
      - name: Setup Rust toolchain
        uses: ./.github/actions/setup
        with:
          need-nextest: true
      - name: Test
        shell: bash
        working-directory: core
        run: cargo nextest run redis --features services-redis
        env:
          OPENDAL_REDIS_TEST: on
          OPENDAL_REDIS_ENDPOINT: tcp://127.0.0.1:6379
          OPENDAL_REDIS_ROOT: /
          OPENDAL_REDIS_DB: 0

What did you expect to see?

Test pass (this test is stable until today)

What did you see instead?

All operations returns Broken Pipe.

running 1 test
  2023-09-26T08:38:31.776841Z DEBUG opendal::services: service=redis operation=write path=bd4f0ac5-f137-43b5-a6fb-5a7f56993d1b -> started
    at core/src/layers/logging.rs:332

  2023-09-26T08:38:31.777030Z DEBUG opendal::services: service=redis operation=write path=bd4f0ac5-f137-43b5-a6fb-5a7f56993d1b -> start writing
    at core/src/layers/logging.rs:344

  2023-09-26T08:38:31.847986Z ERROR opendal::services: service=redis operation=Writer::close path=bd4f0ac5-f137-43b5-a6fb-5a7f56993d1b written=1870076B -> data close failed: Unexpected (temporary) at Writer::close => I/O error

Context:
   service: redis
   path: bd4f0ac5-f137-43b5-a6fb-5a7f56993d1b

Source:
   Broken pipe (os error 32)

https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618

Anything Else?

The container itself seems healthy:

Starting redis service container
  /usr/bin/docker pull apache/kvrocks
  Using default tag: latest
  latest: Pulling from apache/kvrocks
  659d66d51139: Already exists
  71db16f278e5: Pulling fs layer
  8c9c88edd96f: Pulling fs layer
  d2d819887e11: Pulling fs layer
  ce4bbcf2858c: Pulling fs layer
  ba6086eed9cb: Pulling fs layer
  c3a89d94ffd9: Pulling fs layer
  ba6086eed9cb: Waiting
  c3a89d94ffd9: Waiting
  ce4bbcf2858c: Waiting
  8c9c88edd96f: Download complete
  71db16f278e5: Verifying Checksum
  71db16f278e5: Download complete
  d2d819887e11: Verifying Checksum
  d2d819887e11: Download complete
  71db16f278e5: Pull complete
  8c9c88edd96f: Pull complete
  ba6086eed9cb: Verifying Checksum
  ba6086eed9cb: Download complete
  ce4bbcf2858c: Verifying Checksum
  ce4bbcf2858c: Download complete
  c3a89d94ffd9: Verifying Checksum
  c3a89d94ffd9: Download complete
  d2d819887e11: Pull complete
  ce4bbcf2858c: Pull complete
  ba6086eed9cb: Pull complete
  c3a89d94ffd9: Pull complete
  Digest: sha256:2bcc9488cc8e6a52e16[15](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:18)ff8d89[16](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:19)95e88fdcca9497b312776d583bb4febcfdc
  Status: Downloaded newer image for apache/kvrocks:latest
  docker.io/apache/kvrocks:latest
  /usr/bin/docker create --name [21](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:24)0c54969[27](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:30)341f[28](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:31)510a91bb90690af_apachekvrocks_6a942f --label 94[35](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:38)1b --network github_network_b82bef89e5354c3ca5d2cd8[37](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:40)5027b59 --network-alias redis -p 6379:6666  -e GITHUB_ACTIONS=true -e CI=true apache/kvrocks
  2ca70aef[44](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:47)a82cca2fd078[48](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:51)5675144f0f1d93b9aafb87c6b6d2fd601a63a1d4
  /usr/bin/docker start 2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd601a63a1d4
  2ca70aef44a82cca2fd07848567[51](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:54)44f0f1d93b9aafb87c6b6d2fd601a63a1d4
  /usr/bin/docker ps --all --filter id=2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd601a63a1d4 --filter status=running --no-trunc --format "{{.ID}} {{.Status}}"
  2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd601a63a1d4 Up Less than a second (health: starting)
  /usr/bin/docker port 2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd601a63a1d4
  6666/tcp -> 0.0.0.0:6379
  6666/tcp -> [::]:6379
Waiting for all services to be ready
  /usr/bin/docker inspect --format="{{if .Config.Healthcheck}}{{print .State.Health.Status}}{{end}}" 2ca70aef44a82cca2fd07848[56](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:59)75144f0f1d93b9aafb87c6b6d2fd601a63a1d4
  starting
  redis service is starting, waiting 2 seconds before checking again.
  /usr/bin/docker inspect --format="{{if .Config.Healthcheck}}{{print .State.Health.Status}}{{end}}" 2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd601a63a1d4
  starting
  redis service is starting, waiting 4 seconds before checking again.
  /usr/bin/docker inspect --format="{{if .Config.Healthcheck}}{{print .State.Health.Status}}{{end}}" 2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd[60](https://github.com/apache/incubator-opendal/actions/runs/6309725180/job/17131514618#step:2:64)1a63a1d4
  starting
  redis service is starting, waiting 8 seconds before checking again.
  /usr/bin/docker inspect --format="{{if .Config.Healthcheck}}{{print .State.Health.Status}}{{end}}" 2ca70aef44a82cca2fd078485675144f0f1d93b9aafb87c6b6d2fd601a63a1d4
  healthy
  redis service is healthy.

Are you willing to submit a PR?

• I'm willing to submit a PR!

[git-hulk]

@Xuanwo Thank you for your feedback.

[git-hulk]

Guess it should be related to this PR: #1676, we changed the default listening address to 127.0.0.1

[Xuanwo]

The simple re-pro:

Start container:

docker run -p 6379:6666 apache/kvrocks:2.6.0

Use redis-cli:

:( redis-cli get abc
Error: Connection reset by peer

It's ok on kvrocks:2.5.1:

:( redis-cli get abc
(nil)

[git-hulk]

@Xuanwo Thank you!