PublicArchive/cpython
2
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2026-05-08 13:40:46 -04:00
Code Issues Packages Projects Releases Wiki Activity
129,819 Commits 7 Branches 655 Tags
5462002bbefd6cb79716828051beae94de8f2529
Commit Graph

282 Commits

Author SHA1 Message Date
Sam Gross 594a4631c3 gh-120321: Fix TSan reported races on gi_frame_state (gh-143128) 2025-12-24 16:10:43 -05:00
Sam Gross 7607712b61 gh-120321: Avoid -Wunreachable-code warning on Clang (gh-143022) 2025-12-20 14:42:12 -05:00
Sam Gross 4ea3c1a047 gh-120321: Fix TSan reported race in gen_clear_frame (gh-142995) 
TSan treats compare-exchanges that fail as if they are writes
so there is a false positive with the read of gi_frame_state in
gen_close.
 2025-12-19 17:33:49 -05:00
Sam Gross 08bc03ff2a gh-120321: Make gi_frame_state transitions atomic in FT build (gh-142599) 
This makes generator frame state transitions atomic in the free
threading build, which avoids segfaults when trying to execute
a generator from multiple threads concurrently.

There are still a few operations that aren't thread-safe and may crash
if performed concurrently on the same generator/coroutine:

 * Accessing gi_yieldfrom/cr_await/ag_await
 * Accessing gi_frame/cr_frame/ag_frame
 * Async generator operations
 2025-12-19 19:10:37 +00:00
Sam Gross 25397f9541 gh-142766: Clear frame when generator.close() is called (gh-142838) 2025-12-17 13:06:32 -05:00
Mikhail Efimov d17f28fed5 gh-140373: Correctly emit PY_UNWIND event when generator is closed (GH-140767) 2025-10-31 10:09:22 +00:00
Sam Gross 574405c19e gh-140431: Fix GC crash due to partially initialized coroutines (gh-140470) 
The `make_gen()` function creates and tracks generator/coro objects, but
doesn't fully initialize all the fields. At a minimum, we need to
initialize all the fields that may be accessed by gen_traverse because
the call to `compute_cr_origin()` can trigger a GC.
 2025-10-23 10:18:13 -04:00
Marat Khagazheev cb07bd24ee gh-138902: Fix generator send arg name (#138905) 
Co-authored-by: marat <khagazheev@artlebedev.ru>
 2025-09-15 14:05:36 +03:00
Semyon Moroz 968f6e523a gh-130821: Add type information to error messages for invalid return type (GH-130835) 2025-08-14 11:04:41 +03:00
Xuanteng Huang b1056c2a44 gh-135607: remove null checking of weakref list in dealloc of extension modules and objects (#135614) 
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
Co-authored-by: Victor Stinner <vstinner@python.org>
 2025-06-30 11:14:31 +00:00
Donghee Na 52be7f445e gh-133931: Introduce _PyObject_XSetRefDelayed to replace Py_XSETREF (gh-134377) 2025-06-18 08:36:02 +09:00
Duane Griffin b6237c3602 gh-117852: fix argument checking of async_generator.athrow (#134868) 
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
 2025-06-02 20:04:26 +05:30
Irit Katriel 2c8f329dc6 gh-131738: optimize builtin any/all/tuple calls with a generator expression arg (#131737) 2025-03-28 10:35:20 +00:00
Victor Stinner 7101cba6bf gh-131238: Move _Py_VISIT_STACKREF() to pycore_stackref.h (#131560) 
* Move _Py_VISIT_STACKREF() from pycore_gc.h to pycore_stackref.h.
* Remove pycore_interpframe.h include from pycore_genobject.h.
* Remove now useless includes from C files.
* Add pycore_interpframe_structs.h to Makefile.pre.in and
  pythoncore.vcxproj.
 2025-03-21 23:24:14 +01:00
Victor Stinner 61317074d4 gh-131238: Add pycore_interpframe_structs.h header (#131553) 
Add an explicit include to pycore_interpframe_structs.h in
pycore_runtime_structs.h to fix a dependency cycle.
 2025-03-21 17:19:47 +00:00
Victor Stinner 34c1ea3109 gh-111178: Fix function signatures for multiple tests (#131496) 2025-03-20 12:27:03 +01:00
Victor Stinner 20c5f969dd gh-131238: Remove more includes from pycore_interp.h (#131480) 2025-03-19 23:01:32 +01:00
Mark Shannon a45f25361d GH-131238: More refactoring of core header files (GH-131351) 
Adds new pycore_stats.h header file to help break dependencies involving the pycore_code.h header.
 2025-03-17 14:41:05 +00:00
Mark Shannon a1aeec61c4 GH-131238: Core header refactor (GH-131250) 
* Moves most structs in pycore_ header files into pycore_structs.h and pycore_runtime_structs.h

* Removes many cross-header dependencies
 2025-03-17 09:19:04 +00:00
Victor Stinner a5776639c8 gh-111178: Fix function signatures to fix undefined behavior (#131191) 2025-03-14 09:52:15 +00:00
Victor Stinner a25042e6d2 gh-129354: Use PyErr_FormatUnraisable() function (#129523) 
Replace PyErr_WriteUnraisable() with PyErr_FormatUnraisable().

Update tests:

* test_coroutines
* test_exceptions
* test_generators
* test_struct
 2025-02-05 10:31:59 +00:00
Yury Selivanov 188598851d GH-91048: Add utils for capturing async call stack for asyncio programs and enable profiling (#124640) 
Signed-off-by: Pablo Galindo <pablogsal@gmail.com>
Co-authored-by: Pablo Galindo <pablogsal@gmail.com>
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
Co-authored-by: Łukasz Langa <lukasz@langa.pl>
Co-authored-by: Savannah Ostrowski <savannahostrowski@gmail.com>
Co-authored-by: Jacob Coffee <jacob@z7x.org>
Co-authored-by: Irit Katriel <1055913+iritkatriel@users.noreply.github.com>
 2025-01-22 17:25:29 +01:00
Mikhail Efimov 8e20e42cc6 gh-125723: Fix crash with f_locals when generator frame outlive their generator (#126956) 
Co-authored-by: Kirill Podoprigora <kirill.bast9@mail.ru>
Co-authored-by: Alyssa Coghlan <ncoghlan@gmail.com>
 2025-01-22 15:50:01 +03:00
Bénédikt Tran 402b91da87 gh-128078: Use PyErr_SetRaisedException in _PyGen_SetStopIterationValue (#128287) 
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
 2025-01-13 21:24:13 +05:30
Bénédikt Tran 76ffaef729 gh-128078: Clear exception in anext before calling _PyGen_SetStopIterationValue (#128780) 
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
 2025-01-13 18:25:09 +05:30
Petr Viktorin 690fe077f6 gh-126491: Revert "GH-126491: Lower heap size limit with faster marking (GH-127519)" (GH-127770) 
Revert "GH-126491: Lower heap size limit with faster marking (GH-127519)"

This reverts commit 023b7d2141, which introduced
a refleak.
 2024-12-10 11:53:56 +01:00
Mark Shannon 023b7d2141 GH-126491: Lower heap size limit with faster marking (GH-127519) 
* Faster marking of reachable objects

* Changes calculation of work to do and work done.

* Merges transitive closure calculations
 2024-12-06 10:46:59 +00:00
Jacob Bower e8bb053941 gh-126091: Always link generator frames when propagating a thrown-in exception through a yield-from chain (#126092) 
Always link generator frames when propagating a thrown-in exception through a yield-from chain.
 2024-11-21 17:37:49 -06:00
Victor Stinner 16cd6cc86b gh-111178: Fix function signatures in genobject.c (#124970) 
* Add "CAST" macros.
* Rename parameters/variables "o" to "ag", "ags", "agw" or "agt"
  in some functions.
 2024-10-05 09:56:44 +02:00
Sam Gross f4997bb3ac gh-123923: Defer refcounting for f_funcobj in _PyInterpreterFrame (#124026) 
Use a `_PyStackRef` and defer the reference to `f_funcobj` when
possible. This avoids some reference count contention in the common case
of executing the same code object from multiple threads concurrently in
the free-threaded build.
 2024-09-24 20:08:18 +00:00
Sam Gross b2afe2aae4 gh-123923: Defer refcounting for f_executable in _PyInterpreterFrame (#123924) 
Use a `_PyStackRef` and defer the reference to `f_executable` when
possible. This avoids some reference count contention in the common case
of executing the same code object from multiple threads concurrently in
the free-threaded build.
 2024-09-12 12:37:06 -04:00
Brandt Bucher 7797182b78 GH-118093: Improve handling of short and mid-loop traces (GH-122252) 2024-07-29 14:49:17 -07:00
Sam Gross 5716cc3529 gh-100240: Use a consistent implementation for freelists (#121934) 
This combines and updates our freelist handling to use a consistent
implementation. Objects in the freelist are linked together using the
first word of memory block.

If configured with freelists disabled, these operations are essentially
no-ops.
 2024-07-22 12:08:27 -04:00
Ken Jin 22b0de2755 gh-117139: Convert the evaluation stack to stack refs (#118450) 
This PR sets up tagged pointers for CPython.

The general idea is to create a separate struct _PyStackRef for everything on the evaluation stack to store the bits. This forces the C compiler to warn us if we try to cast things or pull things out of the struct directly.

Only for free threading: We tag the low bit if something is deferred - that means we skip incref and decref operations on it. This behavior may change in the future if Mark's plans to defer all objects in the interpreter loop pans out.

This implies a strict stack reference discipline is required. ALL incref and decref operations on stackrefs must use the stackref variants. It is unsafe to untag something then do normal incref/decref ops on it.

The new incref and decref variants are called dup and close. They mimic a "handle" API operating on these stackrefs.

Please read Include/internal/pycore_stackref.h for more information!

---------

Co-authored-by: Mark Shannon <9448417+markshannon@users.noreply.github.com>
 2024-06-27 03:10:43 +08:00
Irit Katriel 8ac08f36fe gh-120834: fix over-allocation in PyGenObject, PyCoroObject, PyAsyncGenObject. (#120941) 2024-06-24 18:41:53 +01:00
Irit Katriel 65a12c559c gh-120834: fix type of *_iframe field in _PyGenObject_HEAD declaration (#120835) 2024-06-24 10:23:38 +01:00
Steele Farnsworth 2c7209a3bd gh-114091: Reword error message for unawaitable types (#114090) 
Reword error message for unawaitable types.
 2024-06-17 20:18:17 +05:30
James Hilton-Balfe e7dafdc224 gh-110209: Add __class_getitem__ for generator and coroutine (#110212) 2024-05-06 18:41:32 -07:00
Thomas Grainger e5c699280d GH-117714: implement athrow().close() and asend().close() using throw (GH-117906) 
* GH-117714: replace athrow().close() and asend().close() stubs with implimentations

* test athrow().close() and asend().close() raises RuntimeError

* 📜🤖 Added by blurb_it.

* Update Objects/genobject.c

Co-authored-by: Petr Viktorin <encukou@gmail.com>

---------

Co-authored-by: blurb-it[bot] <43283697+blurb-it[bot]@users.noreply.github.com>
Co-authored-by: Petr Viktorin <encukou@gmail.com>
 2024-05-06 17:13:15 +00:00
Thomas Grainger fc7e1aa3c0 GH-117881: fix athrow().throw()/asend().throw() concurrent access (GH-117882) 2024-05-01 08:44:01 +02:00
Dino Viehland 4a1cf66c5c gh-117657: Fix small issues with instrumentation and TSAN (#118064) 
Small TSAN fixups for instrumentation
 2024-04-30 11:38:05 -07:00
Irit Katriel 1f16b4ce56 gh-118272: Clear generator frame's locals when the generator is closed (#118277) 
Co-authored-by: Thomas Grainger <tagrain@gmail.com>
 2024-04-30 19:32:25 +01:00
Thomas Grainger 7d369d471c GH-117536: GH-117894: fix athrow().throw(...) unawaited warning (GH-117851) 2024-04-24 14:20:19 +02:00
Donghee Na 8db8d7118e gh-111968: Split _Py_async_gen_asend_freelist out of _Py_async_gen_fr… (gh-115546) 2024-02-17 10:03:10 +09:00
Donghee Na f15795c9a0 gh-111968: Rename freelist related struct names to Eric's suggestion (gh-115329) 2024-02-14 00:32:51 +00:00
Donghee Na d4d5bae147 gh-111968: Refactor _PyXXX_Fini to integrate with _PyObject_ClearFreeLists (gh-114899) 2024-02-10 00:57:04 +00:00
Donghee Na 13907968d7 gh-111968: Use per-thread freelists for dict in free-threading (gh-114323) 2024-02-01 20:53:53 +00:00
Donghee Na 699779256e gh-111968: Unify freelist naming schema to Eric's suggestion (gh-114581) 2024-01-27 00:25:16 +09:00
Donghee Na 7fa511ba57 gh-111968: Use per-thread freelists for generator in free-threading (gh-114189) 2024-01-18 18:15:00 +00:00
Sam Gross 73ae2023a7 gh-113753: Clear finalized bit when putting PyAsyncGenASend back into free list (#113754) 2024-01-10 10:18:38 -08:00