Note: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-10886
It appears that the code that implements converting iterators to arrow arrays effectively relies on size_hint to return the precise size of the iterator otherwise it will crash (maybe) -- but I think the intention of size_hint is, as the name suggests, a hint.
The goal of this ticket is to remove the assumption in the code that size_hint must return a value as well as the assumption that it is accurate.
More details can be found here
apache/arrow#8842 (comment)