Grant Herman 262625fa30 gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

..

file_tokenizer.c

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

helpers.c

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

helpers.h

…

readline_tokenizer.c

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

string_tokenizer.c

…

tokenizer.h

…

utf8_tokenizer.c

…