Add tokenizer

This commit is contained in:
0x4261756D
2023-09-15 11:07:50 +02:00
commit 721383a043
6 changed files with 1328 additions and 0 deletions

2
.gitignore vendored Normal file
View File

@ -0,0 +1,2 @@
zig-out/
zig-cache/