Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add --X-trie-log subcommand #6303

Merged
merged 27 commits into from
Jan 8, 2024

Commits on Dec 15, 2023

  1. Add x-trie-log subcommand for one-off backlog prune

    Signed-off-by: Simon Dudley <simon.dudley@consensys.net>
    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    siladu authored and gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    16c0a49 View commit details
    Browse the repository at this point in the history
  2. long -> int

    Signed-off-by: Simon Dudley <simon.dudley@consensys.net>
    
    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    siladu authored and gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    7dd4928 View commit details
    Browse the repository at this point in the history
  3. Removed banned method

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    bf2b098 View commit details
    Browse the repository at this point in the history
  4. Preload process stream in parallel

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    e67ae51 View commit details
    Browse the repository at this point in the history
  5. Drop unwanted trielogs and keep reatain layers only

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    9b4e0c9 View commit details
    Browse the repository at this point in the history
  6. Add output to user and cleanup refactor

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    0b9fe83 View commit details
    Browse the repository at this point in the history
  7. small tweak to display cf that had reference dropped by RocksDbSegmen…

    …tIdentifier.reset()
    
    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    426848e View commit details
    Browse the repository at this point in the history
  8. spotless

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    7401b59 View commit details
    Browse the repository at this point in the history
  9. Fix classes that changed package

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    1b7fb72 View commit details
    Browse the repository at this point in the history
  10. spotless

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    11e6b05 View commit details
    Browse the repository at this point in the history
  11. Code review

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    f2d01e2 View commit details
    Browse the repository at this point in the history
  12. Only clear DB when we have the exact amount of trie logs we want in m…

    …emory
    
    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    04f1aaa View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. Trielogs stream to and from file to avoid possibly OOM

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    2f01c5a View commit details
    Browse the repository at this point in the history
  2. Process trie logs in chunks to avoid OOM

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    56e4c8e View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. save and read in batches to handle edge cases

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    78561b0 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. save and read files to/from database dir

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    42c72cf View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9961fc2 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. add unit tests and PR review fixes

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    9389540 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e3d4fbc View commit details
    Browse the repository at this point in the history
  3. spdx

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    c7144fe View commit details
    Browse the repository at this point in the history
  4. Fix unit tests directory creation and deletion

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    20b0ba5 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. Configuration menu
    Copy the full SHA
    e7d175c View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. PR review

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    gfukushima committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    b214bf2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    aa75348 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2bc0732 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. Configuration menu
    Copy the full SHA
    deec021 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5d7b68e View commit details
    Browse the repository at this point in the history