Commit Graph

1578 Commits

Author SHA1 Message Date
Jeffrey Dallatezza 459037e5a1 Update comments. 2025-06-06 10:22:42 -07:00
Jeffrey Dallatezza cd59ad22c3 Cleanup. 2025-06-05 11:02:33 -07:00
Jeffrey Dallatezza b80c21bd0f Send other subscription messages through the broadcast queue to keep ordering. 2025-06-05 10:35:52 -07:00
Phoebe Goldman 1c8b321e78 Respond to Mazdak's review 2025-06-03 10:31:41 -04:00
Phoebe Goldman 27931af96c Clippy 2025-06-02 14:16:43 -04:00
Phoebe Goldman 937c79ef91 Remove the lock around the ClientsMap in the SubscriptionManager
We were seeing a deadlock where at least one Tokio task was blocked on this lock.
@jsdt had some hypotheses about the specific Tokio behaviors that were causing this,
but the important thing is that the lock is not necessary at all,
and so we can remove it without delving into the dark depths of the Tokio scheduler.

As part of this change, I split the send worker into being its own struct.
That struct now holds its own copy of the clients map.
This also simplifies the code that cleans up the send queue length metric.
2025-06-02 13:45:17 -04:00
Kim Altintop c98219529d commitlog: Fix index truncation test. (#2792) 2025-05-30 15:13:06 +00:00
Kim Altintop f7d35e5b9f core: Make asyncify preserve the current span (#2790) 2025-05-30 15:12:54 +00:00
joshua-spacetime 8a16a12304 Build indexes over TxData for subscription eval (#2768) 2025-05-28 20:53:14 +00:00
Phoebe Goldman 1e50c7d8ad Aggregate and broadcast DbUpdates off the main thread (#2793)
Co-authored-by: joshua-spacetime <josh@clockworklabs.io>
2025-05-28 17:10:48 +00:00
Phoebe Goldman ac187906ad Per-database incoming and outgoing queue length metrics (#2773) 2025-05-28 16:17:48 +00:00
Mazdak Farrokhzad f3c899e998 Consider deleted committed rows in MutTxId::create_index (#2805)
Signed-off-by: Mazdak Farrokhzad <twingoow@gmail.com>
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-05-28 16:10:00 +00:00
Mazdak Farrokhzad 800af9b8f5 Page::reset_for: stop zeroing pages (#2804)
Bypassed rules because of a cla automation issue. All checks passed otherwise.
2025-05-28 10:22:17 -04:00
Tyler Cloutier 71f48ff561 Datastore Extraction: Create DatastoreError type (#2798)
Signed-off-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>
2025-05-28 03:09:03 +00:00
Tyler Cloutier afc9e5b73b Datastore Extraction: StVarName refactor, small non-functional change in furtherance of datastore extraction (#2795)
Signed-off-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>
2025-05-28 02:18:00 +00:00
Tyler Cloutier ca21404f83 Datastore Extraction: Remove reference to WORKER_METRICS inside db_metrics (#2797) 2025-05-28 01:51:02 +00:00
Tyler Cloutier 7375323d38 Datastore Extraction: TxMetrics refactor, small non-functional change to make datastore extraction easier (#2794) 2025-05-27 17:12:14 +00:00
joshua-spacetime e7b9c610a7 Run reducers on tokio blocking thread instead of rayon (#2785) 2025-05-24 04:32:30 +00:00
joshua-spacetime b86e41fcf6 Single-threaded subscription evaluation (#2682) 2025-05-23 16:43:43 +00:00
joshua-spacetime e727090f50 add instrumentation to remove_multi_subscription (#2781) 2025-05-23 15:12:50 +00:00
Mazdak Farrokhzad c3803ae278 Cheaper Table::clone_structure (#2776)
Signed-off-by: Phoebe Goldman <phoebe@goldman-tribe.org>
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-05-23 13:40:35 +00:00
Mazdak Farrokhzad 1ce60237fa Don't yap about putting chunks into my pool (#2777) 2025-05-22 18:27:49 +00:00
Zeke Foppa ec26f526ed Bump C# versions (#2774)
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
v1.1.2-csharp-release
2025-05-22 17:47:50 +00:00
Mazdak Farrokhzad f7f08dc85b commit_and_broadcast_event: read_tx.merge(update_metrics) (#2772)
Signed-off-by: Mazdak Farrokhzad <twingoow@gmail.com>
Co-authored-by: joshua-spacetime <josh@clockworklabs.io>
2025-05-22 15:17:09 +00:00
joshua-spacetime ade5858269 Re-enable page bool with default size of 128 pages (#2769) 2025-05-22 14:17:36 +00:00
Shubham Mishra f2a9657a72 Commitlog: handle empty offset index lookup (#2771) 2025-05-22 12:59:02 +00:00
Zeke Foppa 2308c989fc Bump version to 1.1.2 (#2767)
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-05-22 04:55:49 +00:00
Tyler Cloutier c30cdea2af Fixed compile errors and warnings on Windows (#2646) 2025-05-21 22:32:29 +00:00
Phoebe Goldman 67b573a036 Make connection metrics keyed on database identity, not replica ID (#2765) 2025-05-21 21:53:59 +00:00
Carlos Cobo c39bb46301 Fix TypeScript imports codegen (#2747)
Signed-off-by: Carlos Cobo <699969+toqueteos@users.noreply.github.com>
Co-authored-by: Jeffrey Dallatezza <jeffreydallatezza@gmail.com>
2025-05-21 18:25:56 +00:00
Mazdak Farrokhzad 32c4ee8989 datastore: apply schema changes immediately to committed state. (#2685)
Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>
2025-05-21 16:27:21 +00:00
Mazdak Farrokhzad 05e171ccec Cache with_label_values more & don't do metrics while holding lock (#2734) 2025-05-21 14:11:41 +00:00
Kim Altintop 1c33aa4e36 cli: Add value_parser for num-replicas (#2759) 2025-05-20 17:39:27 +00:00
Phoebe Goldman 68765f9024 build_sequence_state: clobber pre-existing in-memory Sequences (#2760) 2025-05-20 17:03:17 +00:00
Kim Altintop a10f714dc6 core: Fix error handling when restoring snapshot (#2755) 2025-05-20 13:39:16 +00:00
Kim Altintop f14d7cf5e2 ci: Update dependencies for the wasm_bindings job (#2717) 2025-05-19 07:53:18 +00:00
Kim Altintop c729c2100d Reintroduce replication factor parameter (#2718) 2025-05-19 06:55:09 +00:00
Kim Altintop 1f4207de86 commitlog: Include latest commit offset in segment metadata (#2733) 2025-05-19 06:54:58 +00:00
Kim Altintop d1ed964db7 core: Asyncify commitlog compressor (#2743) 2025-05-16 19:49:25 +00:00
Adrien Figueiredo d7d5306018 Update quickstart-chat README.md (#2727)
Signed-off-by: Adrien Figueiredo <43353685+Trobyss@users.noreply.github.com>
2025-05-16 18:35:13 +00:00
Jeffrey Dallatezza 3fc61bc1c9 Add counters for client connections spawned and aborted. (#2741) 2025-05-15 19:11:45 +00:00
Noa 0829f7d6cf Follow-up: use asyncify in ModuleHost::call (#2740) 2025-05-15 17:53:56 +00:00
Jeffrey Dallatezza 7bd848ada1 Call reducers on the blocking pool. (#2737) 2025-05-15 16:04:42 +00:00
Kim Altintop 3d1a91c25c Handle snapshot restore more robustly (#2735)
Signed-off-by: Kim Altintop <kim@eagain.io>
Signed-off-by: Shubham Mishra <shivam828787@gmail.com>
Co-authored-by: Shubham Mishra <shubham@clockworklabs.io>
2025-05-15 14:35:09 +00:00
Jeffrey Dallatezza 2c5d78d4fa Fix row count stats for multi subscription responses. (#2736) 2025-05-14 22:47:58 +00:00
james gilles 0d419afbfa Reduce reflection use in generated C# code (#2725) 2025-05-14 18:36:50 +00:00
Noa 6b8d077ba0 Move init_database out of wasm_common (#2732) 2025-05-14 18:28:48 +00:00
Noa cb1b053114 Use spawn_blocking for the fallback commit in identity_dis/connected (#2730) 2025-05-14 17:23:31 +00:00
joshua-spacetime 6eef6989dd Do not evaluate subscriptions that return empty result sets (#2731)
Signed-off-by: joshua-spacetime <josh@clockworklabs.io>
Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>
2025-05-14 14:19:52 +00:00
joshua-spacetime 70a04914e1 Fix index scan rewrite rule (#2728) 2025-05-13 16:09:55 +00:00