Skip to content

Feature/cache payloads#49

Merged
CFlaniganMide merged 50 commits intodevelopfrom
feature/cache_payloads
Aug 3, 2021
Merged

Feature/cache payloads#49
CFlaniganMide merged 50 commits intodevelopfrom
feature/cache_payloads

Conversation

@CFlaniganMide
Copy link
Copy Markdown
Contributor

This pull request contains changes to the EventArray class, as well as substantial refactoring in the unit tests covering it and other parts of dataset.py which are effected by the changes.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Jun 25, 2021

Codecov Report

Merging #49 (0799b89) into develop (675ee71) will decrease coverage by 2.41%.
The diff coverage is 87.64%.

Impacted file tree graph

@@             Coverage Diff             @@
##           develop      #49      +/-   ##
===========================================
- Coverage    68.84%   66.43%   -2.42%     
===========================================
  Files            9        9              
  Lines         3438     3626     +188     
===========================================
+ Hits          2367     2409      +42     
- Misses        1071     1217     +146     
Impacted Files Coverage Δ
idelib/dataset.py 74.65% <87.54%> (-6.55%) ⬇️
idelib/importer.py 49.57% <100.00%> (+0.42%) ⬆️
idelib/transforms.py 67.18% <0.00%> (-2.32%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 675ee71...0799b89. Read the comment docs.

MIDE\cflanigan added 8 commits June 25, 2021 12:55
…eturning times before, which should be incorrect
Rather than pre-allocate or anticipate, just do the caching in the blocks.

When accessing the cache, just concatenate all the data arrays in the blocks.

After loading all data, set the cache as the concatenated array.  Then make the blocks' payloads views on the full array.
Comment thread idelib/dataset.py Outdated
Comment thread idelib/dataset.py Outdated
Copy link
Copy Markdown
Contributor

@CrepeGoat CrepeGoat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the new stuff looks good. small change suggestion, check out 51a83a6

Comment thread idelib/dataset.py Outdated
Comment thread idelib/dataset.py Outdated
Comment thread testing/test_dataset.py
Comment thread idelib/dataset.py
@CFlaniganMide CFlaniganMide linked an issue Aug 3, 2021 that may be closed by this pull request
@CFlaniganMide CFlaniganMide merged commit d92f051 into develop Aug 3, 2021
@CFlaniganMide CFlaniganMide deleted the feature/cache_payloads branch August 3, 2021 20:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ArrayValues speed improvements

5 participants