Skip to content

Two codepoints symbols#329

Closed
ikosyanenko wants to merge 5 commits intoapache:masterfrom
ikosyanenko:Two-codepoints-symbols
Closed

Two codepoints symbols#329
ikosyanenko wants to merge 5 commits intoapache:masterfrom
ikosyanenko:Two-codepoints-symbols

Conversation

@ikosyanenko
Copy link
Copy Markdown

An issue described here - #328

ikosyanenko and others added 5 commits July 30, 2019 11:21
Fix truncateStringMax() method for two-codepoint symbols
Fix truncateStringMax() method for two-codepoints symbols
Revert "Fix truncateStringMax() method for two-codepoints symbols"
@ikosyanenko ikosyanenko marked this pull request as ready for review July 30, 2019 09:45
@rdblue
Copy link
Copy Markdown
Contributor

rdblue commented Jul 30, 2019

@ikosyanenko, can you explain why you chose to skip low surrogate characters?

@vgankidi, can you take a look at this?

@rdblue rdblue closed this in 30d45f8 Aug 1, 2019
danielcweeks pushed a commit that referenced this pull request Aug 1, 2019
* Add argument validation to HadoopTables#create (#298)

* Install source JAR when running install target (#310)

* Add projectStrict for Dates and Timestamps (#283)

* Correctly publish artifacts on JitPack (#321)

The Gradle install target produces invalid POM files that are missing
the dependencyManagement section and versions for some dependencies.
Instead, we directly tell JitPack to run the correct Gradle target.

* Add build info to README.md (#304)

* Convert Iceberg time type to Hive string type (#325)

* Add overwrite option to write builders (#318)

* Fix out of order Pig partition fields (#326)

* Add mapping to Iceberg for external name-based schemas (#338)

* Site: Fix broken link to Iceberg API (#333)

* Add forTable method for Avro WriteBuilder (#322)

* Remove multiple literal strings check rule for scala (#335)

* Fix invalid javadoc url in README.md (#336)

* Use UnicodeUtil.truncateString for Truncate transform. (#340)

This truncates by unicode codepoint instead of Java chars.

* Refactor metrics tests for reuse (#331)

* Spark: Add support for write-audit-publish workflows (#342)

* Avoid write failures if metrics mode is invalid (#301)

* Fix truncateStringMax in UnicodeUtil (#334)

Fixes #328, fixes #329.

Index to codePointAt should be the offset calculated by code points

* [Vectorization] Added batch sizing, switched to BufferAllocator, other minor style fixes.
rdblue pushed a commit to rdblue/iceberg that referenced this pull request Aug 22, 2019
Fixes apache#328, fixes apache#329.

Index to codePointAt should be the offset calculated by code points
rdblue pushed a commit to rdblue/iceberg that referenced this pull request Sep 5, 2019
Fixes apache#328, fixes apache#329.

Index to codePointAt should be the offset calculated by code points
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants