Skip to content

fix: remove logging for project_batch#5267

Merged
westonpace merged 1 commit intolance-format:mainfrom
westonpace:fix/remove-extraneous-plan-run
Dec 5, 2025
Merged

fix: remove logging for project_batch#5267
westonpace merged 1 commit intolance-format:mainfrom
westonpace:fix/remove-extraneous-plan-run

Conversation

@westonpace
Copy link
Copy Markdown
Member

I've noticed that debug / info logging has been flooded lately with things like...

[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 

This is because we create and execute a dummy plan to apply projection. This "dummy plan execution" is overly heavyweight on its own and should be optimized (see #5069). However, this short-term patch will at least remove the extraneous logging

@github-actions github-actions Bot added the bug Something isn't working label Nov 18, 2025
@westonpace westonpace force-pushed the fix/remove-extraneous-plan-run branch from 2b548ab to f228d49 Compare December 5, 2025 13:37
@codecov
Copy link
Copy Markdown

codecov Bot commented Dec 5, 2025

Codecov Report

❌ Patch coverage is 75.00000% with 4 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
rust/lance-datafusion/src/exec.rs 66.66% 3 Missing ⚠️
rust/lance-datafusion/src/projection.rs 85.71% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

@westonpace westonpace merged commit 28a01d3 into lance-format:main Dec 5, 2025
26 checks passed
jackye1995 pushed a commit to jackye1995/lance that referenced this pull request Dec 5, 2025
I've noticed that debug / info logging has been flooded lately with
things like...

```
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
```

This is because we create and execute a dummy plan to apply projection.
This "dummy plan execution" is overly heavyweight on its own and should
be optimized (see lance-format#5069).
However, this short-term patch will at least remove the extraneous
logging
jackye1995 pushed a commit to jackye1995/lance that referenced this pull request Dec 5, 2025
I've noticed that debug / info logging has been flooded lately with
things like...

```
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
```

This is because we create and execute a dummy plan to apply projection.
This "dummy plan execution" is overly heavyweight on its own and should
be optimized (see lance-format#5069).
However, this short-term patch will at least remove the extraneous
logging
jackye1995 pushed a commit that referenced this pull request Dec 5, 2025
I've noticed that debug / info logging has been flooded lately with
things like...

```
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
```

This is because we create and execute a dummy plan to apply projection.
This "dummy plan execution" is overly heavyweight on its own and should
be optimized (see #5069).
However, this short-term patch will at least remove the extraneous
logging
jackye1995 pushed a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
I've noticed that debug / info logging has been flooded lately with
things like...

```
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
[2025-11-18T14:12:05Z INFO  lance::events] target="lance::execution" type="plan_run" plan_summary="Projection(OneShot)" output_rows=2 iops=0 requests=0 bytes_read=0 indices_loaded=0 parts_loaded=0 index_comparisons=0 
```

This is because we create and execute a dummy plan to apply projection.
This "dummy plan execution" is overly heavyweight on its own and should
be optimized (see lance-format#5069).
However, this short-term patch will at least remove the extraneous
logging
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants