cryptogera/bitcoin
1
0
Fork 0
mirror of https://github.com/bitcoin/bitcoin.git synced 2026-02-14 09:28:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
bitcoin/src/test/util
History
Andrew Chow 5aa0c82ccd
Merge bitcoin/bitcoin#25325: Add pool based memory resource 
9f947fc3d4b779f017332135323b34e8f216f613 Use PoolAllocator for CCoinsMap (Martin Leitner-Ankerl)
5e4ac5abf54f8e6d6330df0c73119aa0cca4c103 Call ReallocateCache() on each Flush() (Martin Leitner-Ankerl)
1afca6b663bb54022afff193fd9d83856606b189 Add PoolResource fuzzer (Martin Leitner-Ankerl)
e19943f049ed8aa4f32a1d8440a9fbf160367f0f Calculate memory usage correctly for unordered_maps that use PoolAllocator (Martin Leitner-Ankerl)
b8401c3281978beed6198b2f9782b6a8dd35cbd7 Add pool based memory resource & allocator (Martin Leitner-Ankerl)

Pull request description:

  A memory resource similar to `std::pmr::unsynchronized_pool_resource`, but optimized for node-based containers. The goal is to be able to cache more coins with the same memory usage, and allocate/deallocate faster.

  This is a reimplementation of #22702. The goal was to implement it in a way that is simpler to review & test

  * There is now a generic `PoolResource` for allocating/deallocating memory. This has practically the same API as `std::pmr::memory_resource`. (Unfortunately I cannot use std::pmr because libc++ simply doesn't implement that API).
  * Thanks to sipa there is now a fuzzer for PoolResource! On a fast machine I ran it for ~770 million executions without finding any issue.

  * The estimation of the correct node size is now gone, PoolResource now has multiple pools and just needs to be created large enough to have space for the unordered_map nodes.

  I ran benchmarks with #22702, mergebase, and this PR. Frequency locked Intel i7-8700, clang++ 13.0.1 to reindex up to block 690000.

  ```sh
  bitcoind -dbcache=5000 -assumevalid=00000000000000000002a23d6df20eecec15b21d32c75833cce28f113de888b7 -reindex-chainstate -printtoconsole=0 -stopatheight=690000
  ```

  The performance is practically identical with #22702, just 0.4% slower. It's ~21% faster than master:

  ![Progress in Million Transactions over Time(2)](https://user-images.githubusercontent.com/14386/173288685-91952ade-f304-4825-8bfb-0725a71ca17b.png)

  ![Size of Cache in MiB over Time](https://user-images.githubusercontent.com/14386/173291421-e6b410be-ac77-479b-ad24-5fafcebf81eb.png)
  Note that on cache drops mergebase's memory doesnt go so far down because it does not free the `CCoinsMap` bucket array.

  ![Size of Cache in Million tx over Time(1)](https://user-images.githubusercontent.com/14386/173288703-a80c9c9e-93c8-4a16-9df8-610c89c61cc4.png)

ACKs for top commit:
  LarryRuane:
    ACK 9f947fc3d4b779f017332135323b34e8f216f613
  achow101:
    re-ACK 9f947fc3d4b779f017332135323b34e8f216f613
  john-moffett:
    ACK 9f947fc3d4b779f017332135323b34e8f216f613
  jonatack:
    re-ACK 9f947fc3d4b779f017332135323b34e8f216f613

Tree-SHA512: 48caf57d1775875a612b54388ef64c53952cd48741cacfe20d89049f2fb35301b5c28e69264b7d659a3ca33d4c714d47bafad6fd547c4075f08b45acc87c0f45
2023-04-20 16:20:15 -04:00
..
blockfilter.cpp
Create InsecureRandMoneyAmount() test util helper
2023-02-09 15:03:36 -08:00
blockfilter.h
…
chainstate.h
refactor: Move fs.* to util/fs.*
2023-03-23 12:55:18 +01:00
coins.cpp
De-duplicate add_coin methods to a test util helper
2023-02-09 15:03:36 -08:00
coins.h
De-duplicate add_coin methods to a test util helper
2023-02-09 15:03:36 -08:00
json.cpp
test, build: Separate read_json function into its own module
2023-01-27 09:26:29 +00:00
json.h
test, build: Separate read_json function into its own module
2023-01-27 09:26:29 +00:00
logging.cpp
scripted-diff: Bump copyright headers
2021-12-30 19:36:57 +02:00
logging.h
scripted-diff: Bump copyright headers
2022-12-24 23:49:50 +00:00
mining.cpp
Merge bitcoin/bitcoin#26695: bench: BlockAssembler on a mempool with packages
2023-01-11 18:11:11 -05:00
mining.h
[refactor] parameterize BlockAssembler::Options in PrepareBlock
2022-12-22 11:33:37 +00:00
net.cpp
Merge bitcoin/bitcoin#27324: net: #27257 follow-ups
2023-03-28 11:48:02 +01:00
net.h
clang-tidy: Fix modernize-use-default-member-init in headers
2023-01-31 11:50:10 +00:00
poolresourcetester.h
Add pool based memory resource & allocator
2023-03-23 19:38:38 +01:00
random.h
Create InsecureRandMoneyAmount() test util helper
2023-02-09 15:03:36 -08:00
README.md
…
script.cpp
fuzz: [refactor] Use IsValidFlagCombination in signature_checker fuzz target
2021-03-30 10:42:45 +02:00
script.h
fuzz: [refactor] Use IsValidFlagCombination in signature_checker fuzz target
2021-03-30 10:42:45 +02:00
setup_common.cpp
Move ::nPruneTarget into BlockManager
2023-03-15 15:33:12 +01:00
setup_common.h
refactor: Move fs.* to util/fs.*
2023-03-23 12:55:18 +01:00
str.cpp
…
str.h
…
transaction_utils.cpp
…
transaction_utils.h
…
txmempool.cpp
test: Use type-safe NodeSeconds for TestMemPoolEntryHelper
2022-10-24 11:33:33 +02:00
txmempool.h
test: Use type-safe NodeSeconds for TestMemPoolEntryHelper
2022-10-24 11:33:33 +02:00
validation.cpp
scripted-diff: Bump copyright headers
2022-12-24 23:49:50 +00:00
validation.h
scripted-diff: Bump copyright headers
2022-12-24 23:49:50 +00:00
xoroshiro128plusplus.h
Add xoroshiro128++ PRNG
2023-01-30 18:12:21 -05:00

README.md

Test library

This contains files for the test library, which is used by the test binaries (unit tests, benchmarks, fuzzers, gui tests).

Generally, the files in this folder should be well-separated modules. New code should be added to existing modules or (when in doubt) a new module should be created.

The utilities in here are compiled into a library, which does not hold any state. However, the main file setup_common defines the common test setup for all test binaries. The test binaries will handle the global state when they instantiate the BasicTestingSetup (or one of its derived classes).