Partial lexer implementation#8

Merged

wpkelso merged 24 commits intomainfrom

Jan 14, 2025

Commits on Dec 20, 2024

Commits on Dec 23, 2024

lay tokenizer groundwork
wpkelso
committed

Commits on Dec 24, 2024

Commits on Dec 26, 2024

num tokens and tests
wpkelso
committed

Commits on Dec 28, 2024

Commits on Dec 29, 2024

token validation fn shell & fn inlining
wpkelso
committed

Commits on Jan 13, 2025

add load lexing
wpkelso
committed

Commits on Jan 14, 2025