perf: Improve presence performance with application-layer cache #1534

Open

gamesguru wants to merge 4 commits from gamesguru/continuwuity:guru/backports/perf/presence-startup-costs-naive-loop-fix into main

Author	SHA1	Message	Date
Shane Jaroch	60d37b038d	batch presence updates per server, not room. bundle events and local users under batch requests per a smart policy. Some checks failed Documentation / Build and Deploy Documentation (pull_request) Has been skipped Details Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 3m21s Details Update flake hashes / update-flake-hashes (pull_request) Successful in 57s Details Checks / Prek / Clippy and Cargo Tests (pull_request) Failing after 21m25s Details simplify my refactor of service manager startup logic [performance] update TODO regarding presence cache and DB reads [low-priority]	2026-03-13 13:58:24 -04:00
Shane Jaroch	06cb8b514b	implement moka cache for presence layer. w/ tests.	2026-03-13 00:41:06 -04:00
Shane Jaroch	60b06e23a5	fixup naive presence caching impl	2026-03-13 00:24:58 -04:00
Shane Jaroch	5a87474708	perf: address presence timer/DB inefficiencies Some checks failed Documentation / Build and Deploy Documentation (pull_request) Has been cancelled Details Checks / Prek / Pre-commit & Formatting (pull_request) Has been cancelled Details Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled Details perf: impl basic presence cache to avoid DB churn chore: document tech debt/TODOs for presence optimizations chore: add method for presence: `clear_cache()` for service mgr to call with rest on cache clear	2026-03-11 21:19:31 -04:00