Grant Herman 262625fa30 gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

..

file_tokenizer.c

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

helpers.c

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

helpers.h

…

readline_tokenizer.c

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275)

2026-06-06 01:58:35 +00:00

string_tokenizer.c

gh-145234: Normalize decoded CR in string tokenizer (#145281)

2026-02-27 12:44:54 +00:00

tokenizer.h

…

utf8_tokenizer.c

…