Miss Islington (bot) 6a40e1c8d0 [3.13] gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (GH-150275) (#150998) ...

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (GH-150275)
(cherry picked from commit 262625fa30)

Co-authored-by: Grant Herman <grantlouisherman041@gmail.com>

2026-06-06 03:47:00 +01:00

..

file_tokenizer.c

[3.13] gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (GH-150275) (#150998)

2026-06-06 03:47:00 +01:00

helpers.c

[3.13] gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (GH-150275) (#150998)

2026-06-06 03:47:00 +01:00

helpers.h

…

readline_tokenizer.c

[3.13] gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (GH-150275) (#150998)

2026-06-06 03:47:00 +01:00

string_tokenizer.c

…

tokenizer.h

…

utf8_tokenizer.c

…