Skip to content

feat: allow configure temp dir size for datafusion exec#5659

Merged
jackye1995 merged 1 commit intolance-format:mainfrom
jackye1995:disk-config
Jan 9, 2026
Merged

feat: allow configure temp dir size for datafusion exec#5659
jackye1995 merged 1 commit intolance-format:mainfrom
jackye1995:disk-config

Conversation

@jackye1995
Copy link
Copy Markdown
Contributor

@jackye1995 jackye1995 commented Jan 8, 2026

user hit error:

Operation failed: Query Execution error: Execution error: LanceError(IO): Resources exhausted: The used disk space 
during the spilling process has exceeded the allowable limit of 100.0 GB. Try increasing the `max_temp_directory_size` in 
the disk manager configuration., /home/runner/work/lance/lance/rust/lance-datafusion/src/chunker.rs:49:46, 
/home/runner/work/lance/lance/rust/lance-index/src/scalar/btree.rs:1418:29

@github-actions github-actions Bot added the enhancement New feature or request label Jan 8, 2026
@jackye1995 jackye1995 merged commit fac74c0 into lance-format:main Jan 9, 2026
29 of 31 checks passed
jackye1995 added a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
…#5659)

user hit error:

```
Operation failed: Query Execution error: Execution error: LanceError(IO): Resources exhausted: The used disk space 
during the spilling process has exceeded the allowable limit of 100.0 GB. Try increasing the `max_temp_directory_size` in 
the disk manager configuration., /home/runner/work/lance/lance/rust/lance-datafusion/src/chunker.rs:49:46, 
/home/runner/work/lance/lance/rust/lance-index/src/scalar/btree.rs:1418:29
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants