Changyu Bi
b42bf48310
Add stats for WBWI ingestion and transaction size ( #13611 )
...
Summary:
Add stats to monitor the large transaction optimization. A stat is added for how many times wbwi ingestion is used. A histogram is added to track transaction size. We could also just track write batch size for all writes but I don't want to add the overhead to all writes yet.
Pull Request resolved: https://github.com/facebook/rocksdb/pull/13611
Test Plan:
ran `python3 ./tools/db_crashtest.py --txn blackbox --txn_write_policy=0 --commit_bypass_memtable_one_in=50 --test_batches_snapshots=0 --stats_dump_period_sec=2 --dump_malloc_stats=0 --statistics=1` and manually check LOG files
```
rocksdb.number.wbwi.ingest COUNT : 57
...
rocksdb.num.op.per.transaction P50 : 1.000000 P95 : 1.000000 P99 : 1.000000 P100 : 1.000000 COUNT : 2265 SUM : 2265
```
Reviewed By: jowlyzhang
Differential Revision: D74829087
Pulled By: cbi42
fbshipit-source-id: 5a9c3ab2d4cb6071cedfc47201ce2cf65a77d3c6
2025-05-16 11:51:58 -07:00
..
file_read_sample.h
Remove unnecessary, confusing 'extern' ( #12300 )
2024-01-29 10:38:08 -08:00
histogram.cc
Remove extra semi colon from internal_repo_rocksdb/repo/monitoring/histogram.cc
2024-01-23 08:37:47 -08:00
histogram.h
Standardize on clang-format version 18 ( #13233 )
2024-12-19 10:58:40 -08:00
histogram_test.cc
clang format files under monitoring/ ( #10857 )
2022-10-24 20:45:54 -07:00
histogram_windowing.cc
internal_repo_rocksdb (-8794174668376270091) ( #12114 )
2023-12-01 11:10:30 -08:00
histogram_windowing.h
Remove 'virtual' when implied by 'override' ( #12319 )
2024-01-31 13:14:42 -08:00
in_memory_stats_history.cc
internal_repo_rocksdb (-8794174668376270091) ( #12114 )
2023-12-01 11:10:30 -08:00
in_memory_stats_history.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE ( #6433 )
2020-02-20 12:09:57 -08:00
instrumented_mutex.cc
Inject spurious wakeup and sleep before acquiring db mutex to expose race condition ( #10291 )
2022-09-12 13:55:23 -07:00
instrumented_mutex.h
Fix race in options taking effect ( #11929 )
2023-10-12 10:05:23 -07:00
iostats_context.cc
clang format files under monitoring/ ( #10857 )
2022-10-24 20:45:54 -07:00
iostats_context_imp.h
Fix build error with NIOSTATS_CONTEXT ( #10506 )
2022-08-23 15:00:14 -07:00
iostats_context_test.cc
clang format files under monitoring/ ( #10857 )
2022-10-24 20:45:54 -07:00
perf_context.cc
Add time measuring metrics for file ingestion in PerfContext ( #13219 )
2024-12-19 16:53:42 -08:00
perf_context_imp.h
Add a perf level for measuring user thread block time ( #12368 )
2024-02-22 12:14:53 -08:00
perf_level.cc
internal_repo_rocksdb (-8794174668376270091) ( #12114 )
2023-12-01 11:10:30 -08:00
perf_level_imp.h
clang format files under monitoring/ ( #10857 )
2022-10-24 20:45:54 -07:00
perf_step_timer.h
Change internal headers with duplicate names ( #11408 )
2023-05-17 11:27:09 -07:00
persistent_stats_history.cc
Group SST write in flush, compaction and db open with new stats ( #11910 )
2023-12-29 15:29:23 -08:00
persistent_stats_history.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE ( #6433 )
2020-02-20 12:09:57 -08:00
statistics.cc
Add stats for WBWI ingestion and transaction size ( #13611 )
2025-05-16 11:51:58 -07:00
statistics_impl.h
Remove 'virtual' when implied by 'override' ( #12319 )
2024-01-31 13:14:42 -08:00
statistics_test.cc
Remove RocksDB LITE ( #11147 )
2023-01-27 13:14:19 -08:00
stats_history_test.cc
Refactor wal related naming and more ( #13490 )
2025-04-11 10:08:29 -07:00
thread_status_impl.cc
internal_repo_rocksdb (-8794174668376270091) ( #12114 )
2023-12-01 11:10:30 -08:00
thread_status_updater.cc
Group rocksdb.sst.read.micros stat by IOActivity flush and compaction ( #11288 )
2023-04-21 09:07:18 -07:00
thread_status_updater.h
Group rocksdb.sst.read.micros stat by IOActivity flush and compaction ( #11288 )
2023-04-21 09:07:18 -07:00
thread_status_updater_debug.cc
Replace reinterpret_cast with static_cast_with_check ( #7067 )
2020-07-02 19:25:41 -07:00
thread_status_util.cc
fix linking without thread status support ( #12400 )
2024-03-04 17:39:03 -08:00
thread_status_util.h
Group rocksdb.sst.read.micros stat by IOActivity flush and compaction ( #11288 )
2023-04-21 09:07:18 -07:00
thread_status_util_debug.cc
Rename Env::IOActivity::kReadManifest ( #13471 )
2025-03-19 12:08:06 -07:00