Skip to content

Conversation

@mbrobbel
Copy link
Member

@mbrobbel mbrobbel commented Feb 3, 2022

Continuing the work of @lidavidm in #11964 in this PR. Rebased on master.

@github-actions
Copy link

github-actions bot commented Feb 3, 2022

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW

Opening JIRAs ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename pull request title in the following format?

ARROW-${JIRA_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

See also:

@mbrobbel mbrobbel changed the title ARROW 15067: [C++] Add tracing spans to the scanner ARROW-15067: [C++] Add tracing spans to the scanner Feb 3, 2022
@github-actions
Copy link

github-actions bot commented Feb 3, 2022

@github-actions
Copy link

github-actions bot commented Feb 3, 2022

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@lidavidm
Copy link
Member

This can be closed in favor of the other PR, right?

@mbrobbel mbrobbel closed this Mar 31, 2022
@mbrobbel mbrobbel deleted the arrow-15067 branch March 31, 2022 07:21
lidavidm added a commit that referenced this pull request Apr 7, 2022
Continuing #12328 and #11964.
The tracing spans were not propagated through all the asynchronous constructs, causing some spans to become disconnected from the trace. This PR aims to address this.
Some things left to do:
- [x] Possibly add some attributes to the `read_column` span
- [x] fix parent/sibling relationships (some of the new spans should probably become a child)
- [x] Do something about all the `#ifdefs`
- [x] Wrap around a `Future`
- [x] Wrap `Executor`
- [x] Check if tracing now works properly for all of the file types, not just parquet
- [x] lidavidm mentioned some memory leaks that should be investigated
- [x] The `FragmentToBatches` span seems to be active way too long

Closes #12609 from joosthooz/arrow-15067

Lead-authored-by: Joost Hoozemans <joosthooz@msn.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants