Is your feature request related to a problem? Please describe
The inferred schema of a Table currently treat columns of type X with and without missing values the same. For example, in the following table both columns would get type int:
Desired solution
- There is already a class
OptionalColumnType but it's not used. It should be used to clearly mark columns with missing values.
- Add an abstract method
is_missing or may_be_missing to ColumnType.
- Implement it for the subclasses.
- Use this method to reimplement
Table.list_columns_with_missing_values and Column.has_missing_values.