Commit Graph

1458 Commits

Author SHA1 Message Date
Phoebe Goldman 9fe73d3818 Merge remote-tracking branch 'origin/master' into phoebe/parallelism-test/sequential-eval-incr 2025-04-04 09:56:04 -04:00
Phoebe Goldman 62818e9c7b Various methods and trait impls for time arithmetic (#2502) 2025-04-03 18:06:28 +00:00
Phoebe Goldman 80b3613f45 Add CI job to run cargo doc on the bindings crate (#2548) 2025-04-03 17:41:17 +00:00
Jeffrey Dallatezza 396d1c2814 Add some tokio runtime metrics. (#2537) 2025-04-03 16:17:47 +00:00
Phoebe Goldman df5d55b7ff Static feature flag for generating perfmaps (#746) 2025-04-03 15:36:59 +00:00
Phoebe Goldman cae2628b8a Rip Rayon out of reducer execution and query evaluation
For testing/benchmarking purposes.
One theory about our performance is that we're spending a lot of time context-switching
between Tokio and Rayon threads.
This build will be used in the first of a series of experiments
to investigate that overhead.
In this patch, we just do sequential evaluation on the Tokio worker threads
where the rest of our code runs, instead of sending stuff to Rayon.
Rayon use is mostly, but not entirely, removed from Core.

The two next steps I am interested in:
- Use parallelism, but on Tokio workers rather than Rayon threads.
  I.e. replace `par_iter`, `fold` and `reduce_with` calls with Tokio-isms,
  instead of this patch's `std::iter::Iterator` versions.
- (Not discussed in meeting) continue using `par_iter` and friends,
  but invoke the "outer loop" from Tokio threads.
  I.e. retain use of `par_iter`, `fold` and `reduce_with`,
  but remove calls to `rayon::scope` or `rayon::spawn`.
2025-04-02 15:25:50 -04:00
Noa 649ce34b01 Update tungstenite to 0.26 (#2539) 2025-04-02 18:09:13 +00:00
joshua-spacetime adf42551c8 Add rls to the sql api (#2526) 2025-04-02 17:36:20 +00:00
Mario Montoya 4ade692700 Update formatting of timestamps and identities in PsqlFormatter (#2486) 2025-04-02 16:53:27 +00:00
Kim Altintop a2200be55d core: Export the snapshot watcher / commitlog compressor (#2536) 2025-04-02 13:40:10 +00:00
Kim Altintop d88a266c20 commitlog: Derive serde for Commit (#2535) 2025-04-02 11:16:11 +00:00
Noa f2a4abbf4b Update PR template (#2395)
Co-authored-by: Zeke Foppa <196249+bfops@users.noreply.github.com>
2025-04-01 16:55:08 +00:00
Mazdak Farrokhzad eb380e6a18 Repair transactionality of st_client removals after disconnect (#2446)
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-04-01 14:04:16 +00:00
Noa d436b1f9b7 Followup to #2504 (#2534) 2025-03-31 23:52:56 +00:00
joshua-spacetime 20e92ced5a Feature gate #[client_visibility_filter] (#2528) 2025-03-31 23:15:24 +00:00
joshua-spacetime 6d3840aabe Add utility for rls resolution (#2519) 2025-03-31 22:37:05 +00:00
Noa a5212a5f75 Commitlog compression (#2504) 2025-03-31 22:00:52 +00:00
james gilles 1d0dc6da7b Fix C# SDK Tests (#2533) 2025-03-31 18:35:41 +00:00
Jeffrey Dallatezza 6577f8019c Update data size metrics periodically, not on every transaction. (#2532) 2025-03-31 18:12:47 +00:00
Jeffrey Dallatezza 64aef29d3c Add endpoints for heap profiling (#2517)
Co-authored-by: Zeke Foppa <196249+bfops@users.noreply.github.com>
2025-03-31 18:12:31 +00:00
Kim Altintop 8dfab1c09d commitlog: Open stream writer with metadata (#2530) 2025-03-31 17:25:39 +00:00
Zeke Foppa 4dca52fef3 CI - Make Test Suite check for dirty git diff (#2531)
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-03-31 17:25:18 +00:00
james gilles 13dfb03135 Add [ClientVisibilityFilter] to csharp module library (#2481) 2025-03-28 19:03:13 +00:00
Mario Montoya 98395ca530 Print back the # of rows affected (ins, upd, del) with timings (#2462)
Signed-off-by: Mario Montoya <mamcx@elmalabarista.com>
Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>
2025-03-28 16:57:23 +00:00
Zeke Foppa 9bd75787c9 CI - Containerize linux x86_64 GNU builds (#2466)
Co-authored-by: Noa <coolreader18@gmail.com>
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-03-28 03:25:32 +00:00
Noa b2412b44f6 Install tls dependencies in standalone dockerfile (#2484)
Co-authored-by: Phoebe Goldman <phoebe@clockworklabs.io>
2025-03-28 03:04:30 +00:00
Zeke Foppa c3c0d92fbe Bump versions to 1.1.0 (#2518)
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-03-27 23:37:38 +00:00
Mario Montoya ee7970e752 Add .cargo/config.toml to spacetime init Rust project with default target to wasm (#2328) 2025-03-26 14:34:32 +00:00
Jeffrey Dallatezza 765330c863 Remove trailing slashes from isser when looking up oidc configs. (#2499) 2025-03-26 14:19:39 +00:00
Kim Altintop a084222eb0 smoketests: Adjust clear_database test (#2501) 2025-03-26 14:09:15 +00:00
Kim Altintop 5063bd8759 commitlog: Streaming (#2492) 2025-03-26 07:40:23 +00:00
joshua-spacetime 01c391f8a9 Add sql support for :sender parameter (#2483) 2025-03-21 17:53:34 +00:00
Jeffrey Dallatezza a4a2925f12 Use jemalloc in standalone and add stats. (#2470) 2025-03-20 19:00:06 +00:00
Noa 80ad69ca14 Build for musl (#2418) 2025-03-20 04:19:27 +00:00
Kim Altintop c2c19c6b7a smoketests: Test database deletion (#2480) 2025-03-19 16:31:50 +00:00
Noa 16c5f0e312 Allow databases from 1.0.1 to be run on 1.0.0 (#2472) 2025-03-19 16:28:42 +00:00
Kim Altintop 434c28063f commitlog: Fix open flags for read-only offset index (#2468) 2025-03-19 12:24:30 +00:00
Noa 20cda7c38b Close scheduler on module exit (#2477) 2025-03-18 23:21:10 +00:00
Zeke Foppa 4d04ab0493 CI - Fix docker jobs failing (#2471)
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-03-14 19:14:27 +00:00
John Detter 26c1387512 Add install from source instructions to README (#2443)
Co-authored-by: John Detter <no-reply@boppygames.gg>
2025-03-14 00:41:08 +00:00
james gilles 91e96ffb3f Bring over Rust module doc fixes from the C# module docs (#2360) 2025-03-13 17:00:12 +00:00
Jeffrey Dallatezza cb80a8edfd Allow a single string to be passed as the audience (#2460) 2025-03-13 16:34:59 +00:00
Jeffrey Dallatezza 872a8d839c When generating for typescript, convert the primary key to camel case. (#2409) 2025-03-12 22:14:12 +00:00
james gilles f5e4663cb5 Implement IEquatable<Self> for all [SpacetimeDB.Type]s (#2396) 2025-03-12 18:59:34 +00:00
Phoebe Goldman e67b5f8565 Fix outdated advice in getrandom warning (#2444) 2025-03-12 15:55:22 +00:00
Mazdak Farrokhzad 2ae19838d3 Fix subs when clients use variying compression (#2434) 2025-03-12 14:39:08 +00:00
joshua-spacetime be97181b72 update install instructions in readme (#2435) 2025-03-12 02:03:14 +00:00
Zeke Foppa 8930e78f97 Bump versions to 1.0.1 (#2431)
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-03-11 18:43:48 +00:00
joshua-spacetime 25abdd5857 fix: bag semantics for joins (#2398) 2025-03-11 18:33:07 +00:00
Zeke Foppa 0dd1807063 CI - Only tag extra docker images on tag refs (#2335)
Signed-off-by: Zeke Foppa <196249+bfops@users.noreply.github.com>
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2025-03-11 17:56:16 +00:00