I'm the author of the rMSIproc package which relies on ff for handling large datasets (sometimes several TB of data). My package creates multiple ff matrices and distribute data across them to handle such large data sizes. So, I use quite intensively ff::open.ff() and ff::close.ff() functions to free the file handlers that are not currently used and open them again when needed. This method allowed me to work on huge datasets.
In ff version 4.0.2 these methods are not exported anymore and therefore, my package stopped to work after updating R packages. I had to downgrade ff to 2.2-14.2 version to make it work again.
Could it be possible to re-export this functions or provide an alternative method?
Thanks!
I'm the author of the rMSIproc package which relies on ff for handling large datasets (sometimes several TB of data). My package creates multiple ff matrices and distribute data across them to handle such large data sizes. So, I use quite intensively ff::open.ff() and ff::close.ff() functions to free the file handlers that are not currently used and open them again when needed. This method allowed me to work on huge datasets.
In ff version 4.0.2 these methods are not exported anymore and therefore, my package stopped to work after updating R packages. I had to downgrade ff to 2.2-14.2 version to make it work again.
Could it be possible to re-export this functions or provide an alternative method?
Thanks!