continuwuation/rocksdb
6
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity
rocksdb/table/block_based
History
Peter Dillinger 78c83ac1ec Publish/support format_version=7, related enhancements (#13713) 
Summary:
* Make new format_version=7 a supported setting.
* Fix a bug in compressed_secondary_cache.cc that is newly exercised by custom compression types and showing up in crash test with tiered secondary cache
* Small change to handling of disabled compression in fv=7: use empty compression manager compatibility name.
* Get rid of GetDefaultBuiltinCompressionManager() in public API because it could cause unexpected+unsafe schema change on a user's CompressionManager if built upon the default built-in manager and we add a new built-in schema. Now must be referenced by explicit compression schema version in the public API. (That notion was already exposed in compressed secondary cache API, for better or worse.)
* Improve some error messages for compression misconfiguration
* Improve testing with ObjectLibrary and CompressionManagers
* Improve testing of compression_name table property in BlockBasedTableTest.BlockBasedTableProperties2
* Improve some comments

Pull Request resolved: https://github.com/facebook/rocksdb/pull/13713

Test Plan: existing and updated tests. Notably, the crash test has already been running with (unpublished) format_version=7

Reviewed By: mszeszko-meta, hx235

Differential Revision: D77035482

Pulled By: pdillinger

fbshipit-source-id: 95278de8734a79706a22361bff2184b1edb230ca
2025-06-20 17:39:47 -07:00
..
binary_search_index_reader.cc Eliminate some parameters redundant with ReadOptions (#12761) 2024-06-12 15:44:37 -07:00
binary_search_index_reader.h Extend Get/MultiGet deadline support to table open (#6982) 2020-06-29 14:53:17 -07:00
block.cc Add initial support for TimedPut API (#12419) 2024-03-14 15:44:55 -07:00
block.h Add some per key optimization for UDT in memtable only feature (#13031) 2024-10-03 17:57:50 -07:00
block_based_table_builder.cc Publish/support format_version=7, related enhancements (#13713) 2025-06-20 17:39:47 -07:00
block_based_table_builder.h Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
block_based_table_factory.cc Preliminary support for custom compression algorithms (#13659) 2025-06-16 14:19:03 -07:00
block_based_table_factory.h Preliminary support for custom compression algorithms (#13659) 2025-06-16 14:19:03 -07:00
block_based_table_iterator.cc Trim readahead size based on prefix during prefix scan (#13040) 2024-10-17 15:52:55 -07:00
block_based_table_iterator.h Trim readahead size based on prefix during prefix scan (#13040) 2024-10-17 15:52:55 -07:00
block_based_table_reader.cc Publish/support format_version=7, related enhancements (#13713) 2025-06-20 17:39:47 -07:00
block_based_table_reader.h Preliminary support for custom compression algorithms (#13659) 2025-06-16 14:19:03 -07:00
block_based_table_reader_impl.h Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
block_based_table_reader_sync_and_async.h propagate request_id from app -> Rocks -> FS (#13616) 2025-05-16 21:25:50 -07:00
block_based_table_reader_test.cc Preliminary support for custom compression algorithms (#13659) 2025-06-16 14:19:03 -07:00
block_builder.cc internal_repo_rocksdb (-8794174668376270091) (#12114) 2023-12-01 11:10:30 -08:00
block_builder.h Logically strip timestamp during flush (#11557) 2023-06-29 15:50:50 -07:00
block_cache.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
block_cache.h Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
block_prefetcher.cc propagate request_id from app -> Rocks -> FS (#13616) 2025-05-16 21:25:50 -07:00
block_prefetcher.h Refactor FilePrefetchBuffer code (#12097) 2024-01-05 09:29:01 -08:00
block_prefix_index.cc Fix bug with kHashSearch and changing prefix_extractor with SetOptions (#10128) 2022-06-10 08:51:45 -07:00
block_prefix_index.h Fix bug with kHashSearch and changing prefix_extractor with SetOptions (#10128) 2022-06-10 08:51:45 -07:00
block_test.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
block_type.h Remove deprecated block-based filter (#10184) 2022-06-16 15:51:33 -07:00
cachable_entry.h Support pro-actively erasing obsolete block cache entries (#12694) 2024-06-07 08:57:11 -07:00
data_block_footer.cc Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433) 2020-02-20 12:09:57 -08:00
data_block_footer.h Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433) 2020-02-20 12:09:57 -08:00
data_block_hash_index.cc Format files under table/ by clang-format (#10852) 2022-10-25 11:50:38 -07:00
data_block_hash_index.h Fix build with gcc 13 by including <cstdint> (#11118) 2023-01-25 14:30:32 -08:00
data_block_hash_index_test.cc Preliminary support for custom compression algorithms (#13659) 2025-06-16 14:19:03 -07:00
filter_block.h Standardize on clang-format version 18 (#13233) 2024-12-19 10:58:40 -08:00
filter_block_reader_common.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
filter_block_reader_common.h Remove redundant no_io parameters to filter functions (#12762) 2024-06-12 18:47:11 -07:00
filter_policy.cc Clean up obsolete code in BlockBasedTable::PrefetchIndexAndFilterBlocks (#13277) 2025-01-08 18:03:46 -08:00
filter_policy_internal.h Clean up obsolete code in BlockBasedTable::PrefetchIndexAndFilterBlocks (#13277) 2025-01-08 18:03:46 -08:00
flush_block_policy.cc Change internal headers with duplicate names (#11408) 2023-05-17 11:27:09 -07:00
flush_block_policy_impl.h Change internal headers with duplicate names (#11408) 2023-05-17 11:27:09 -07:00
full_filter_block.cc Option to decouple index and filter partitions (#12939) 2024-08-16 15:34:31 -07:00
full_filter_block.h Option to decouple index and filter partitions (#12939) 2024-08-16 15:34:31 -07:00
full_filter_block_test.cc Optimize, simplify filter block building (fix regression) (#12931) 2024-08-14 15:13:16 -07:00
hash_index_reader.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
hash_index_reader.h Extend Get/MultiGet deadline support to table open (#6982) 2020-06-29 14:53:17 -07:00
index_builder.cc Refactor IndexBuilder::AddIndexEntry (#12867) 2024-07-22 14:27:31 -07:00
index_builder.h Refactor IndexBuilder::AddIndexEntry (#12867) 2024-07-22 14:27:31 -07:00
index_reader_common.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
index_reader_common.h Eliminate some parameters redundant with ReadOptions (#12761) 2024-06-12 15:44:37 -07:00
mock_block_based_table.h Remove deprecated block-based filter (#10184) 2022-06-16 15:51:33 -07:00
parsed_full_filter_block.cc Hide FilterBits{Builder,Reader} from public API (#9592) 2022-02-17 16:34:46 -08:00
parsed_full_filter_block.h Major Cache refactoring, CPU efficiency improvement (#10975) 2023-01-11 14:20:40 -08:00
partitioned_filter_block.cc propagate request_id from app -> Rocks -> FS (#13616) 2025-05-16 21:25:50 -07:00
partitioned_filter_block.h Option to decouple index and filter partitions (#12939) 2024-08-16 15:34:31 -07:00
partitioned_filter_block_test.cc Option to decouple index and filter partitions (#12939) 2024-08-16 15:34:31 -07:00
partitioned_index_iterator.cc Refactor FilePrefetchBuffer code (#12097) 2024-01-05 09:29:01 -08:00
partitioned_index_iterator.h Format files under table/ by clang-format (#10852) 2022-10-25 11:50:38 -07:00
partitioned_index_reader.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
partitioned_index_reader.h Support pro-actively erasing obsolete block cache entries (#12694) 2024-06-07 08:57:11 -07:00
reader_common.cc Prefer static_cast in place of most reinterpret_cast (#12308) 2024-02-07 10:44:11 -08:00
reader_common.h Remove unnecessary, confusing 'extern' (#12300) 2024-01-29 10:38:08 -08:00
uncompression_dict_reader.cc Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00
uncompression_dict_reader.h Big refactor for preliminary custom compression API (#13540) 2025-05-15 17:14:23 -07:00