git-mirrors/continuwuity
1
0
Fork 0
mirror of https://forgejo.ellis.link/continuwuation/continuwuity.git synced 2025-06-27 17:34:51 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
4819 commits 36 branches 20 tags 19 MiB
Commit graph

914 commits

Author SHA1 Message Date
Jason Volk
49023aa295 use database for resolver caches 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-22 02:16:51 +00:00
Jason Volk
0c96891008 add CBOR support to database schema 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-22 00:52:48 +00:00
Jason Volk
dda27ffcb1 add some compaction related interfaces 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-18 12:05:07 +00:00
Jason Volk
19f6d9d0e1 add index-compression and auto-readahead to descriptor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 12:12:44 +00:00
Jason Volk
277b4951e8 add compression-shaping; tweak default compression levels 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 11:50:17 +00:00
Jason Volk
3dae02b886 add preferred jemalloc config 
add muzzy/dirty configuration mallctl interface

add program argument for --gc-muzzy=false

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-18 01:30:41 +00:00
Jason Volk
abf33013e3 check-in additional database test related 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:48:47 +00:00
Jason Volk
96e85adc32 use cache builder for row and table cache options 
add cache check using multi-get path

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:48:47 +00:00
Jason Volk
fc1170e12a additional tracing span tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jason Volk
bab40a3747 enable hashing on large-block indexes 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jason Volk
aad42bdaa0 reduce block size on small tables 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jason Volk
3759d1be6c tweak per-column write_buffer down from default 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jade Ellis
2cc6ad8df3 implement /login/get_token (MSC3882) 2025-01-17 17:40:53 -05:00
Jason Volk
9ebb39ca4f
add missing cfg_attr on deserialisation db test 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2025-01-15 14:34:50 -05:00
strawberry
5a1c41e66b knocking implementation 
Signed-off-by: strawberry <strawberry@puppygock.gay>

add sync bit of knocking

Signed-off-by: strawberry <strawberry@puppygock.gay>
 2025-01-13 14:15:16 -05:00
Jason Volk
66231676f1 gracefully ignore unknown columns; add dropped flag in descriptor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 22:29:05 +00:00
Jason Volk
16fa2eca87 add conf item for write buffer size 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
6a0f9add0c refactor database engine/options; add column descriptors 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
02f19cf951 tweak tracing spans; inlines 
db deserializer tracing instrument cover

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
685b127f99 simplify iterator state constructor arguments 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
44e6b1af3c fixes for tests to be run in release-mode 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-09 19:56:42 +00:00
Jason Volk
94c8683836 improve db pool topology configuration 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-09 18:14:23 +00:00
Jason Volk
d36167ab64 partially revert 9a9c071e82; use std threads for db pool. 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-09 18:14:23 +00:00
strawberry
7a349fdc58
use latest sccache, bump nix flake lock, cache everything in rust-cache 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2025-01-02 19:13:27 -05:00
Jason Volk
77d7e8a3ad add json array to serde_json::Value db deserialization without Raw 2025-01-02 06:52:32 +00:00
Jason Volk
2259e2c82f batch queries to maximize throughput 
query-side streams for first level of callsites

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
1792711d09 support core affinity mask 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
c5b94be5b8 remove dev_release_log_level cfg 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
2bbb28bb88 get device info with libc using major/minor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
b56e480b3c integrate some std io error kinds with our status code abstraction 
associate rocksdb error kinds with std io error kinds

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
74eb30c106 add LIFO scheduling for database frontend pool workers 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
7a6d657558 configurable dynamic stream concurrency scalar 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
b195107053 optimize for multi-queue storage topologies with affinity 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
a3d87be22f enable atomic_flush for database columns 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
98e6c81e49 offload remaining db iterator initial seeks on cache miss 
consume task budget on cache hit

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
14341bb906 simplify and improve db iter State init interface 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
4d46df2af5 abort tasks for non-async pool shudown 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-18 14:16:23 -05:00
Jason Volk
5f7636f177
set dbpool thread name (gated by tokio_unstable) 
Signed-off-by: Jason Volk <jason@zemos.net>
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-18 13:31:41 -05:00
Jason Volk
ad8cbcaac1 check cache prior to offloading iterator seek 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-18 13:29:43 -05:00
strawberry
77e0b76408
apply new rustfmt.toml changes, fix some clippy lints 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-15 01:00:41 -05:00
strawberry
0317cc8cc5
rename conduit to conduwuit finally 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-14 22:24:45 -05:00
Jason Volk
aba88ccead misc tracing span tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-10 06:20:30 +00:00
strawberry
faf48405aa bump rocksdb to v9.8.4, enable track_and_verify_wals_in_manifest by default 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-09 12:52:06 -05:00
strawberry
61670370ed add rocksdb paranoid_file_checks config option, add some more config checks 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-09 12:28:14 -05:00
Jason Volk
ff56ee7413 add back the consume_budget on cache hits 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-08 07:12:27 +00:00
Jason Volk
6aa35260e6 misc database options tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-08 07:12:27 +00:00
Jason Volk
65a370836c derive specific ReadOptions for iterators 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-08 07:12:27 +00:00
Jason Volk
48703173bc split get_batch from get.rs; add aqry_batch 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-04 00:51:57 +00:00
Jason Volk
3109c0daba perform async shutdown for database pool after services stop 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-04 00:51:57 +00:00
Jason Volk
b5006a4c41 offload initial iterator seeks to threadpool 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-03 13:25:33 +00:00