Commit Graph

730 Commits

Author SHA1 Message Date
joshua-spacetime 2f1d99ce1c Log when a websocket connection has ended (#2883) 2025-06-20 17:09:43 +00:00
joshua-spacetime 9608f498f1 Speed up metadata update on unsubscribe (#2880) 2025-06-20 16:05:23 +00:00
Jeffrey Dallatezza 8d25009853 Fix two places we grab blocking locks on tokio runtime worker threads (#2881) 2025-06-20 15:22:04 +00:00
joshua-spacetime 718712a8f7 Record the size of a client's outgoing message queue on drop (#2877) 2025-06-18 17:28:55 +00:00
joshua-spacetime b63df7872a Track metadata updates for unsubscribes (#2876) 2025-06-18 15:48:57 +00:00
joshua-spacetime 4f493e4d2f Relax conditions for query pruning (#2873) 2025-06-16 19:03:58 +00:00
Mazdak Farrokhzad 1318e7e1f5 messages::serialize: take/put buffers from/into a SerializeBufferPool (#2823)
Co-authored-by: Noa <coolreader18@gmail.com>
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
Co-authored-by: Phoebe Goldman <phoebe@goldman-tribe.org>
2025-06-16 16:44:57 +00:00
joshua-spacetime 27af02ce73 Use database identity not owner identity for metrics (#2868) 2025-06-16 15:56:23 +00:00
joshua-spacetime c522c0f950 Prune more queries when evaluating subscription updates (#2855)
Signed-off-by: joshua-spacetime <josh@clockworklabs.io>
Co-authored-by: Mario Montoya <mamcx@elmalabarista.com>
2025-06-14 00:45:20 +00:00
joshua-spacetime 70df4fb034 Test subscription updates for dml (#2716) 2025-06-13 23:37:45 +00:00
Jeffrey Dallatezza 228c761c7c Use a scope guard for decrementing queue length. (#2865) 2025-06-13 21:00:04 +00:00
joshua-spacetime 193c0d4889 Add more subscription metrics (#2861) 2025-06-13 19:26:17 +00:00
Phoebe Goldman 2d756dbc93 Wrap try_init_host futures in tokio::spawn so they don't get cancelled (#2857) 2025-06-13 16:26:41 +00:00
joshua-spacetime f4f698efa1 Always use identity when hashing queries from owners (#2859) 2025-06-12 20:34:19 +00:00
Jeffrey Dallatezza 12abd48a54 Send one-off responses through the broadcast queue. (#2853) 2025-06-11 18:34:04 +00:00
Noa 053fc6d97c Tidy up ModuleKind conversions a tiny bit (#2840) 2025-06-11 13:16:09 +00:00
joshua-spacetime a19bd458c4 Reserve cores 0 and 1 for the OS (#2851) 2025-06-10 17:46:52 +00:00
Phoebe Goldman c99dc82a48 Remove the lock around the ClientsMap in the SubscriptionManager (#2821)
Co-authored-by: Jeffrey Dallatezza <jeffreydallatezza@gmail.com>
2025-06-06 20:52:08 +00:00
Noa 967e82a5f8 Pin db threads to cores (#2801)
Signed-off-by: Noa <coolreader18@gmail.com>
Co-authored-by: Jeffrey Dallatezza <jeffreydallatezza@gmail.com>
Co-authored-by: joshua-spacetime <josh@clockworklabs.io>
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-06-06 18:37:35 +00:00
Viktor Szépe f6da9e1f5f Fix typos (#2812)
Signed-off-by: Viktor Szépe <viktor@szepe.net>
2025-06-04 16:33:32 +00:00
Noa b07f22ec00 Log every second a reducer takes to run (#2738) 2025-06-03 17:24:25 +00:00
Kim Altintop f7d35e5b9f core: Make asyncify preserve the current span (#2790) 2025-05-30 15:12:54 +00:00
joshua-spacetime 8a16a12304 Build indexes over TxData for subscription eval (#2768) 2025-05-28 20:53:14 +00:00
Phoebe Goldman 1e50c7d8ad Aggregate and broadcast DbUpdates off the main thread (#2793)
Co-authored-by: joshua-spacetime <josh@clockworklabs.io>
2025-05-28 17:10:48 +00:00
Phoebe Goldman ac187906ad Per-database incoming and outgoing queue length metrics (#2773) 2025-05-28 16:17:48 +00:00
Mazdak Farrokhzad f3c899e998 Consider deleted committed rows in MutTxId::create_index (#2805)
Signed-off-by: Mazdak Farrokhzad <twingoow@gmail.com>
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-05-28 16:10:00 +00:00
Tyler Cloutier 71f48ff561 Datastore Extraction: Create DatastoreError type (#2798)
Signed-off-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>
2025-05-28 03:09:03 +00:00
Tyler Cloutier afc9e5b73b Datastore Extraction: StVarName refactor, small non-functional change in furtherance of datastore extraction (#2795)
Signed-off-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>
2025-05-28 02:18:00 +00:00
Tyler Cloutier ca21404f83 Datastore Extraction: Remove reference to WORKER_METRICS inside db_metrics (#2797) 2025-05-28 01:51:02 +00:00
Tyler Cloutier 7375323d38 Datastore Extraction: TxMetrics refactor, small non-functional change to make datastore extraction easier (#2794) 2025-05-27 17:12:14 +00:00
joshua-spacetime e7b9c610a7 Run reducers on tokio blocking thread instead of rayon (#2785) 2025-05-24 04:32:30 +00:00
joshua-spacetime b86e41fcf6 Single-threaded subscription evaluation (#2682) 2025-05-23 16:43:43 +00:00
joshua-spacetime e727090f50 add instrumentation to remove_multi_subscription (#2781) 2025-05-23 15:12:50 +00:00
Mazdak Farrokhzad c3803ae278 Cheaper Table::clone_structure (#2776)
Signed-off-by: Phoebe Goldman <phoebe@goldman-tribe.org>
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-05-23 13:40:35 +00:00
Mazdak Farrokhzad 1ce60237fa Don't yap about putting chunks into my pool (#2777) 2025-05-22 18:27:49 +00:00
Mazdak Farrokhzad f7f08dc85b commit_and_broadcast_event: read_tx.merge(update_metrics) (#2772)
Signed-off-by: Mazdak Farrokhzad <twingoow@gmail.com>
Co-authored-by: joshua-spacetime <josh@clockworklabs.io>
2025-05-22 15:17:09 +00:00
Tyler Cloutier c30cdea2af Fixed compile errors and warnings on Windows (#2646) 2025-05-21 22:32:29 +00:00
Phoebe Goldman 67b573a036 Make connection metrics keyed on database identity, not replica ID (#2765) 2025-05-21 21:53:59 +00:00
Mazdak Farrokhzad 32c4ee8989 datastore: apply schema changes immediately to committed state. (#2685)
Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>
2025-05-21 16:27:21 +00:00
Mazdak Farrokhzad 05e171ccec Cache with_label_values more & don't do metrics while holding lock (#2734) 2025-05-21 14:11:41 +00:00
Phoebe Goldman 68765f9024 build_sequence_state: clobber pre-existing in-memory Sequences (#2760) 2025-05-20 17:03:17 +00:00
Kim Altintop a10f714dc6 core: Fix error handling when restoring snapshot (#2755) 2025-05-20 13:39:16 +00:00
Kim Altintop d1ed964db7 core: Asyncify commitlog compressor (#2743) 2025-05-16 19:49:25 +00:00
Jeffrey Dallatezza 3fc61bc1c9 Add counters for client connections spawned and aborted. (#2741) 2025-05-15 19:11:45 +00:00
Noa 0829f7d6cf Follow-up: use asyncify in ModuleHost::call (#2740) 2025-05-15 17:53:56 +00:00
Jeffrey Dallatezza 7bd848ada1 Call reducers on the blocking pool. (#2737) 2025-05-15 16:04:42 +00:00
Kim Altintop 3d1a91c25c Handle snapshot restore more robustly (#2735)
Signed-off-by: Kim Altintop <kim@eagain.io>
Signed-off-by: Shubham Mishra <shivam828787@gmail.com>
Co-authored-by: Shubham Mishra <shubham@clockworklabs.io>
2025-05-15 14:35:09 +00:00
Jeffrey Dallatezza 2c5d78d4fa Fix row count stats for multi subscription responses. (#2736) 2025-05-14 22:47:58 +00:00
Noa 6b8d077ba0 Move init_database out of wasm_common (#2732) 2025-05-14 18:28:48 +00:00
Noa cb1b053114 Use spawn_blocking for the fallback commit in identity_dis/connected (#2730) 2025-05-14 17:23:31 +00:00