Skip to content

numfmt: support non-UTF8 delimiters for locales like GB18030#10079

Merged
sylvestre merged 5 commits intouutils:mainfrom
ChrisDryden:fix-numfmt-non-utf8
Jan 9, 2026
Merged

numfmt: support non-UTF8 delimiters for locales like GB18030#10079
sylvestre merged 5 commits intouutils:mainfrom
ChrisDryden:fix-numfmt-non-utf8

Conversation

@ChrisDryden
Copy link
Collaborator

@ChrisDryden ChrisDryden commented Jan 5, 2026

This test corresponds to the numfmt-nonutf8 gnu test and the change is to parse the separator as an OsString so that non-UTF8 delimeters can be used. There is one todo where GNU is only supposed to accept a single character when its non UTF8 but we don't have the capability to determine this yet for locales and this is missing in cut nl and in numfmt, so for now it still will let you but we need to follow up with that in the future. I also added some regression tests.

@github-actions
Copy link

github-actions bot commented Jan 5, 2026

GNU testsuite comparison:

Congrats! The gnu test tests/numfmt/mb-non-utf8 is no longer failing!

@ChrisDryden ChrisDryden marked this pull request as ready for review January 5, 2026 21:13
@github-actions
Copy link

github-actions bot commented Jan 6, 2026

GNU testsuite comparison:

Congrats! The gnu test tests/numfmt/mb-non-utf8 is no longer failing!

@github-actions
Copy link

github-actions bot commented Jan 9, 2026

GNU testsuite comparison:

Congrats! The gnu test tests/numfmt/mb-non-utf8 is no longer failing!
Note: The gnu test tests/basenc/bounded-memory is now being skipped but was previously passing.

@sylvestre sylvestre merged commit c5c3a8e into uutils:main Jan 9, 2026
132 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants