Skip to content

[Enhancement] Table value function support reading local file #17308

@morningman

Description

@morningman

Search before asking

  • I had searched in the issues and found no similar issues.

Description

The table valued function now can read file from s3/hdfs.
We want to support a new tvf local() which can read local file from BE.
eg:

select * from local("file" = "path/to/file.txt", "backend_id" = "be_id", xxx);

And this stmt will read the file path/to/file.txt on specified backend;
This tvf is very helpful when we want to debug file reading or analyze local file.

And for security reason, it only allow to read file under the specified dir on Backend, we can add a new BE config to
specified this dir.

Solution

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions