Skip to content

Conversation

@Fokko
Copy link
Contributor

@Fokko Fokko commented Feb 27, 2023

Resolves #6945

I'm aware that I didn't add any tests to cover this. I think it would be nice to get the integration tests in: #6398 Or have write support in Python.

Tested this by running a scan that will filter out data (December 2021):
image

This fails on the current master:
image

@Fokko Fokko force-pushed the fd-fix-timezone-issue branch 2 times, most recently from 5af2047 to b3191cc Compare February 27, 2023 09:10
@Fokko Fokko force-pushed the fd-fix-timezone-issue branch from b3191cc to 8401493 Compare February 27, 2023 09:15
@Fokko Fokko added this to the PyIceberg 0.4.0 release milestone Feb 28, 2023

def visit_timestampz(self, _: TimestamptzType) -> pa.DataType:
return pa.timestamp(unit="us", tz="+00:00")
return pa.timestamp(unit="us", tz="UTC")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why change all uses to UTC rather than +00:00? Aren't these the same thing?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Technically yes. #6945 has a deeper explanation for this. It is because the test data is written using a docker container that is using UTC.

@Fokko Fokko merged commit 049ec49 into apache:master Feb 28, 2023
@Fokko Fokko deleted the fd-fix-timezone-issue branch February 28, 2023 17:17
krvikash pushed a commit to krvikash/iceberg that referenced this pull request Mar 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Python: Inconsistency around timezones

2 participants