Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unicode U+2007 character treated as whitespace on macOS #224

Open
frenchy64 opened this issue Jan 31, 2025 · 1 comment
Open

Unicode U+2007 character treated as whitespace on macOS #224

frenchy64 opened this issue Jan 31, 2025 · 1 comment

Comments

@frenchy64
Copy link
Contributor

macOS Sequoia 15.2 (Intel)

This test for the keyword :<U+2007><U+2007> fails on macOS.

===============================================================================
/Users/ambrose/Projects/jank-local-dev/main/compiler+runtime/test/cpp/jank/read/lex.cpp:1664:
TEST SUITE: lex
TEST CASE:  UTF-8
  Whitespace Characters

/Users/ambrose/Projects/jank-local-dev/main/compiler+runtime/test/cpp/jank/read/lex.cpp:1778: ERROR: CHECK( tokens == make_tokens({ { 0, 7, token_kind::keyword, "  "sv } }) ) is NOT correct!
  values: CHECK( [ err(error(0 - 0, "invalid keyword: expected non-whitespace character after :")) ok(token(1, 3, symbol,  )) err(error(4 - 4, "expected whitespace before next token")) ok(token(4, 3, symbol,  )) ] == [ token(0, 7, keyword,   ) ] )

===============================================================================
@jeaye
Copy link
Member

jeaye commented Jan 31, 2025

I've seen this showing up on some people's machine. I suspected it was a locale issue on that machine, not having UTF-8 setup properly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants