Skip to content

Conversation

@bkietz
Copy link
Member

@bkietz bkietz commented May 14, 2019

Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in #4278

@codecov-io
Copy link

codecov-io commented May 14, 2019

Codecov Report

Merging #4309 into master will increase coverage by 0.42%.
The diff coverage is 0%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #4309      +/-   ##
==========================================
+ Coverage   88.54%   88.97%   +0.42%     
==========================================
  Files         796      704      -92     
  Lines      103206    94725    -8481     
  Branches     1253        0    -1253     
==========================================
- Hits        91388    84277    -7111     
+ Misses      11573    10448    -1125     
+ Partials      245        0     -245
Impacted Files Coverage Δ
cpp/src/arrow/ipc/writer.cc 93.04% <0%> (-1.15%) ⬇️
cpp/src/arrow/vendored/datetime/date.h 26.35% <0%> (-4.28%) ⬇️
cpp/src/plasma/thirdparty/ae/ae.c 70.75% <0%> (-0.95%) ⬇️
cpp/src/arrow/python/arrow_to_pandas.cc 91.55% <0%> (-0.04%) ⬇️
cpp/src/arrow/pretty_print.cc 83.18% <0%> (ø) ⬆️
cpp/src/arrow/vendored/datetime/tz.h 43.47% <0%> (ø) ⬆️
cpp/src/arrow/vendored/datetime/tz_private.h 33.33% <0%> (ø) ⬆️
cpp/src/gandiva/precompiled/epoch_time_point.h 100% <0%> (ø) ⬆️
cpp/src/arrow/pretty_print-test.cc 100% <0%> (ø) ⬆️
cpp/src/arrow/python/python-test.cc 100% <0%> (ø) ⬆️
... and 219 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24c42f7...8b356f3. Read the comment docs.

@bkietz
Copy link
Member Author

bkietz commented May 15, 2019

waiting for #4316 to be merged

@wesm
Copy link
Member

wesm commented May 16, 2019

Is it expected for the integration tests to pass (there is support in Java for reading these?)?

@bkietz
Copy link
Member Author

bkietz commented May 17, 2019

It seems like there is support: https://github.com/apache/arrow/blob/master/java/vector/src/test/java/org/apache/arrow/vector/ipc/TestArrowFile.java#L623

I'd need to spend more time figuring out exactly which java code is exercised by integration_test.py

@wesm
Copy link
Member

wesm commented May 17, 2019

I just poked around the Java codebase. It seems it may work by accident, but it is not tested

@emkornfield
Copy link
Contributor

@bkietz what are the next steps here, do you need help with something on the Java side?

@bkietz bkietz force-pushed the 1278-integration-tests-for-fixed-size-list branch from e287bd8 to ae45d3f Compare June 11, 2019 13:17
@bkietz
Copy link
Member Author

bkietz commented Jun 11, 2019

@emkornfield I have investigated the fixed size list tests. They're spare but present so I think we should merge this and add a JIRA to test fixed size list more thoroughly in Java.

@bkietz bkietz force-pushed the 1278-integration-tests-for-fixed-size-list branch from ae45d3f to 5806637 Compare June 11, 2019 15:41
@emkornfield
Copy link
Contributor

@bkietz sounds good, can you rebase?

@bkietz bkietz force-pushed the 1278-integration-tests-for-fixed-size-list branch from 5806637 to e7ed001 Compare June 12, 2019 15:49
@bkietz
Copy link
Member Author

bkietz commented Jun 12, 2019

@emkornfield rebased and green except for a coredump in test_csv (I don't think that was me)

g++ \
gcc \
git \
ninja-build \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emkornfield ninja is installed in ci/conda_env_cpp.yml so isn't this unused?

@emkornfield
Copy link
Contributor

@bkietz one small question about a change to docker file. Otherwise LGTM

@emkornfield
Copy link
Contributor

@bkietz potentially not an expert on docker stuff, so I'd prefer cleanup as a separate PR

@bkietz
Copy link
Member Author

bkietz commented Jun 13, 2019

@emkornfield reverted and green

@emkornfield
Copy link
Contributor

+1 LGTM, please file a JIRA for the follow-up work.

@bkietz bkietz deleted the 1278-integration-tests-for-fixed-size-list branch February 25, 2021 16:39
@codecov-commenter
Copy link

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.

Project coverage is 88.97%. Comparing base (24c42f7) to head (8b356f3).

Files with missing lines Patch % Lines
cpp/src/arrow/ipc/writer.cc 0.00% 7 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4309      +/-   ##
==========================================
+ Coverage   88.54%   88.97%   +0.42%     
==========================================
  Files         796      704      -92     
  Lines      103206    94725    -8481     
  Branches     1253        0    -1253     
==========================================
- Hits        91388    84277    -7111     
+ Misses      11573    10448    -1125     
+ Partials      245        0     -245     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Adds integration tests for fixed_size_list
Also adds support for fixed_size_list to RecordBatchSerializer, which was omitted in apache#4278

Author: Benjamin Kietzman <bengilgit@gmail.com>

Closes apache#4309 from bkietz/1278-integration-tests-for-fixed-size-list and squashes the following commits:

8b356f3 <Benjamin Kietzman> revert removal of ninja-build from dockerfile
e7ed001 <Benjamin Kietzman> fix flake8 error
8ab4efc <Benjamin Kietzman> Adding integration tests for fixed_size_list
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants