mirror of
https://github.com/GrammaticalFramework/gf-core.git
synced 2026-09-26 12:13:37 -06:00
Japanese uses the same lexer as Chinese, i.e. every character is a separate token.
Japanese uses the same lexer as Chinese, i.e. every character is a separate token.