mirror of
https://github.com/GrammaticalFramework/gf-core.git
synced 2026-09-21 01:36:01 -06:00
Japanese uses the same lexer as Chinese, i.e. every character is a separate token.
Japanese uses the same lexer as Chinese, i.e. every character is a separate token.