feat(core): add Alluxio e2e test

[hoslo]

base on PR: #3548 , we need to add E2E test for Alluxio.

[Zheaoli]

MOST LGTM
BTW, we need add health check in docker compose

[hoslo]

MOST LGTM BTW, we need add health check in docker compose

Excuse me? How can I fix this CI error

[Xuanwo]

Let's address the core's failure first.

thread 'main' panicked at core/src/raw/tests/utils.rs:68:45:
must succeed: Unsupported (permanent) at  => scheme is not enabled or supported

Context:
   scheme: alluxio

It's looks alluxio is not added in via_map at https://github.com/apache/incubator-opendal/blob/main/core/src/types/operator/builder.rs#L154?

[suyanhanx]

For health check, you could take the following as references :

• https://docs.docker.com/compose/compose-file/compose-file-v3/#healthcheck
• https://github.com/apache/incubator-opendal/blob/main/fixtures/s3/docker-compose-minio.yml

[Xuanwo]

The following tests are failure:

failures:
    behavior::test_blocking_write_with_special_chars
    behavior::test_blocking_create_dir_existing
    behavior::test_blocking_stat_not_exist
    behavior::test_blocking_stat_with_special_chars
    behavior::test_blocking_read_not_exist
    behavior::test_check
    behavior::test_blocking_delete_file
    behavior::test_list_dir
    behavior::test_list_dir_with_metakey
    behavior::test_blocking_remove_one_file
    behavior::test_list_non_exist_dir
    behavior::test_list_sub_dir
    behavior::test_list_dir_with_metakey_complete
    behavior::test_scan_root
    behavior::test_list_nested_dir
    behavior::test_scan
    behavior::test_rename_non_existing_source
    behavior::test_rename_file
    behavior::test_remove_all
    behavior::test_rename_nested
    behavior::test_create_dir_existing
    behavior::test_write_with_special_chars
    behavior::test_rename_overwrite
    behavior::test_stat_not_exist
    behavior::test_stat_with_special_chars
    behavior::test_read_not_exist
    behavior::test_read_with_special_chars
    behavior::test_delete_file
    behavior::test_delete_with_special_chars
    behavior::test_delete_not_existing
    behavior::test_writer_abort
    behavior::test_remove_one_file
    behavior::test_list_rich_dir
    behavior::test_delete_stream

You can reproduce those tests locally by OPENDAL_TEST=alluxio cargo test behaivor --features services-alluxio

[hoslo]

It seems that these error contexts don't have the correct scheme set and can be updated together.

https://github.com/apache/incubator-opendal/blob/bec1e9db5effb99fe1d369941f6e04036fb2ec99/core/src/services/alluxio/backend.rs#L151-L166

fixed

The following tests are failure:

failures:
    behavior::test_blocking_write_with_special_chars
    behavior::test_blocking_create_dir_existing
    behavior::test_blocking_stat_not_exist
    behavior::test_blocking_stat_with_special_chars
    behavior::test_blocking_read_not_exist
    behavior::test_check
    behavior::test_blocking_delete_file
    behavior::test_list_dir
    behavior::test_list_dir_with_metakey
    behavior::test_blocking_remove_one_file
    behavior::test_list_non_exist_dir
    behavior::test_list_sub_dir
    behavior::test_list_dir_with_metakey_complete
    behavior::test_scan_root
    behavior::test_list_nested_dir
    behavior::test_scan
    behavior::test_rename_non_existing_source
    behavior::test_rename_file
    behavior::test_remove_all
    behavior::test_rename_nested
    behavior::test_create_dir_existing
    behavior::test_write_with_special_chars
    behavior::test_rename_overwrite
    behavior::test_stat_not_exist
    behavior::test_stat_with_special_chars
    behavior::test_read_not_exist
    behavior::test_read_with_special_chars
    behavior::test_delete_file
    behavior::test_delete_with_special_chars
    behavior::test_delete_not_existing
    behavior::test_writer_abort
    behavior::test_remove_one_file
    behavior::test_list_rich_dir
    behavior::test_delete_stream

You can reproduce those tests locally by OPENDAL_TEST=alluxio cargo test behaivor --features services-alluxio

thanks, I'll fix them.

[Xuanwo]

Thanks a lot!

Already addressed.