Question about type conversion between parquet and arrow. #4731
-
However, Why? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Int96 is deprecated - https://github.com/apache/parquet-format/blob/master/Encodings.md#plain-plain--0 Timestamps should always be encoded as int64 now - https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#timestamp Int96 is only still supported for compatibility with spark, which still has issues supporting nanosecond timestamps stored as int64 |
Beta Was this translation helpful? Give feedback.
Int96 is deprecated - https://github.com/apache/parquet-format/blob/master/Encodings.md#plain-plain--0
Timestamps should always be encoded as int64 now - https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#timestamp
Int96 is only still supported for compatibility with spark, which still has issues supporting nanosecond timestamps stored as int64