Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[dbnode] Repopulate cached searched in index active block #3671

Merged
merged 107 commits into from
Aug 27, 2021
Merged

[dbnode] Repopulate cached searched in index active block #3671

merged 107 commits into from
Aug 27, 2021

Commits on May 18, 2021

  1. [dbnode] Use active block which GCs series instead of explicit block … 

    …rotations
    @robskillington
    robskillington committed May 18, 2021
    Configuration menu
    Copy the full SHA
    7d21f7d View commit details
    Browse the repository at this point in the history

  2. Fix supplying RelookupAndIncrementReaderWriterCount

    @robskillington
    robskillington committed May 18, 2021
    Configuration menu
    Copy the full SHA
    fde5188 View commit details
    Browse the repository at this point in the history

  3. Always write to active block

    @robskillington
    robskillington committed May 18, 2021
    Configuration menu
    Copy the full SHA
    2fe5644 View commit details
    Browse the repository at this point in the history

  4. Set attempt to true when calling OnIndexPrepare

    @robskillington
    robskillington committed May 18, 2021
    Configuration menu
    Copy the full SHA
    2b167e7 View commit details
    Browse the repository at this point in the history

  5. Do not expire from the shard until no longer indexed any block starts

    @robskillington
    robskillington committed May 18, 2021
    Configuration menu
    Copy the full SHA
    10cd227 View commit details
    Browse the repository at this point in the history

  6. [dbnode] Add postings list cache for searches

    @robskillington
    robskillington committed May 18, 2021
    Configuration menu
    Copy the full SHA
    60eb057 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2021

  1. Check query range against block state

    @rallen090
    rallen090 committed Jun 11, 2021
    Configuration menu
    Copy the full SHA
    8270d5c View commit details
    Browse the repository at this point in the history

  2. Remove print

    @rallen090
    rallen090 committed Jun 11, 2021
    Configuration menu
    Copy the full SHA
    951b420 View commit details
    Browse the repository at this point in the history

  3. Allow no metadata

    @rallen090
    rallen090 committed Jun 11, 2021
    Configuration menu
    Copy the full SHA
    5e2e22d View commit details
    Browse the repository at this point in the history

  4. Fix test

    @rallen090
    rallen090 committed Jun 11, 2021
    Configuration menu
    Copy the full SHA
    d23c8fc View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2021

  1. Only consider blocks both sealed and in-mem data evicted as flushed b… 

    …locks for evicting series from in-mem segments
    @robskillington
    robskillington committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    f1222d5 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2021

  1. Rebased

    @rallen090
    rallen090 committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    f29148d View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2021

  1. Fix unit test 1

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    341c8ef View commit details
    Browse the repository at this point in the history

  2. Fix unit test 2

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    3bdfc8d View commit details
    Browse the repository at this point in the history

  3. Add debug info to integration test

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    33194dc View commit details
    Browse the repository at this point in the history

  4. Fix integration test

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    b9a0f32 View commit details
    Browse the repository at this point in the history

  5. Fix integration test for rotation

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    612da98 View commit details
    Browse the repository at this point in the history

  6. More unit test fixes

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    7623cd4 View commit details
    Browse the repository at this point in the history

  7. Big unit test fixes

    @rallen090
    rallen090 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    0869a68 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2021

  1. More unit test fixes

    @rallen090
    rallen090 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    12045e2 View commit details
    Browse the repository at this point in the history

  2. More unit test fixes 2

    @rallen090
    rallen090 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    2d37a0f View commit details
    Browse the repository at this point in the history

  3. More unit test fixes 3

    @rallen090
    rallen090 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    3064b1c View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2021

  1. More unit test fixes

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    e7dc197 View commit details
    Browse the repository at this point in the history

  2. Fix test TestNamespaceIndexTick

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    b288ef0 View commit details
    Browse the repository at this point in the history

  3. Fix test TestLimits

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    7fd4eb9 View commit details
    Browse the repository at this point in the history

  4. Fix test TestNamespaceForwardIndexInsertQuery

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    bbe332a View commit details
    Browse the repository at this point in the history

  5. Fix test TestNamespaceIndexForwardWrite

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    b9930a1 View commit details
    Browse the repository at this point in the history

  6. Fix test TestNamespaceIndexInsertQuery

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    5d9aee4 View commit details
    Browse the repository at this point in the history

  7. Fix test TestNamespaceIndexInsertQuery

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    75768fe View commit details
    Browse the repository at this point in the history

  8. Fix test TestShardAsyncInsertMarkIndexedForBlockStart

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    aecdc56 View commit details
    Browse the repository at this point in the history

  9. Fix test race condition

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    9f4ff04 View commit details
    Browse the repository at this point in the history

  10. Fix test TestNamespaceIndexBlockQueryReleasingContext

    @rallen090
    rallen090 committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    9d0bf10 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2021

  1. Fix test TestNamespaceIndexHighConcurrentQueriesWithoutTimeouts

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    88229ac View commit details
    Browse the repository at this point in the history

  2. Fix test index_query_concurrent_test

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    97d534e View commit details
    Browse the repository at this point in the history

  3. Fix test mock order in TestNamespaceIndexBlockQueryReleasingContext

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    6eb4716 View commit details
    Browse the repository at this point in the history

  4. Fix test mock order in TestNamespaceIndexBlockQueryReleasingContext 2

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    2d686d0 View commit details
    Browse the repository at this point in the history

  5. Gen

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    f1ec6ed View commit details
    Browse the repository at this point in the history

  6. Doc update from master

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    bc8fb74 View commit details
    Browse the repository at this point in the history

  7. Lint 1

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    4d09a99 View commit details
    Browse the repository at this point in the history

  8. Lint 2

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    f22f91e View commit details
    Browse the repository at this point in the history

  9. Lint 3

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    8e6241a View commit details
    Browse the repository at this point in the history

  10. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    8564260 View commit details
    Browse the repository at this point in the history

  11. Rebased

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    f723d6f View commit details
    Browse the repository at this point in the history

  12. Rebased CI

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    6878e08 View commit details
    Browse the repository at this point in the history

  13. Gen

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    9294049 View commit details
    Browse the repository at this point in the history

  14. Gen

    @rallen090
    rallen090 committed Jul 14, 2021
    Configuration menu
    Copy the full SHA
    ed89e86 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2021

  1. Add metric

    @rallen090
    rallen090 committed Jul 21, 2021
    Configuration menu
    Copy the full SHA
    837131e View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Jul 21, 2021
    Configuration menu
    Copy the full SHA
    1a5362c View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2021

  1. Fix for index block appearing as a flushed index block, now explicit … 

    …check has on disk segment (#3622)
    @robskillington
    robskillington authored Jul 26, 2021
    6 Configuration menu
    Copy the full SHA
    2df8748 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2021

  1. Fix considering block as flushed based on result from tick (check blo… 

    …ck result not aggregated results) (#3631)
    @robskillington
    robskillington authored Jul 27, 2021
    Configuration menu
    Copy the full SHA
    508327c View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2021

  1. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    c815135 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Check entry empty state to ensure GC eligible (#3634)

    @rallen090
    rallen090 authored Aug 19, 2021
    Configuration menu
    Copy the full SHA
    926a478 View commit details
    Browse the repository at this point in the history

  2. Rebased r/index-active-block

    @rallen090
    rallen090 committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    2087962 View commit details
    Browse the repository at this point in the history

  3. Rebase repopulate commit

    @robskillington @rallen090
    robskillington authored and rallen090 committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    844045a View commit details
    Browse the repository at this point in the history

  4. Fix test

    @rallen090
    rallen090 committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    9a35d5a View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2021

  1. Mock

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    b04952f View commit details
    Browse the repository at this point in the history

  2. Correctly decrement reader/writer on entry and misc cleanup

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    957c743 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    49f5def View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/r/index-active-block-cache-searc… 

    …hes' into ra/index-active-block-cache-searches-repopulate
    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    e91d650 View commit details
    Browse the repository at this point in the history

  5. Fix tests

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    5870ef3 View commit details
    Browse the repository at this point in the history

  6. Lint

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    2997cfb View commit details
    Browse the repository at this point in the history

  7. Mock

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    0d0c570 View commit details
    Browse the repository at this point in the history

  8. Lint

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    44051d4 View commit details
    Browse the repository at this point in the history

  9. Mock

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    9ebdead View commit details
    Browse the repository at this point in the history

  10. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    1adcf6d View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    382ba93 View commit details
    Browse the repository at this point in the history

  12. Merge remote-tracking branch 'origin/r/index-active-block-cache-searc… 

    …hes' into ra/index-active-block-cache-searches-repopulate
    @rallen090
    rallen090 committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    877cce9 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. Check series indexed along with isEmpty

    @rallen090
    rallen090 committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    8034ad6 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    ca78fb5 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    69ddf5c View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/r/index-active-block-cache-searc… 

    …hes' into ra/index-active-block-cache-searches-repopulate
    @rallen090
    rallen090 committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    0823464 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2021

  1. Remove IndexedOrAttemptedAny

    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    06d62f1 View commit details
    Browse the repository at this point in the history

  2. [dbnode] Check ref count when considering if a series is empty (#3694)

    @rallen090
    rallen090 authored Aug 25, 2021
    Configuration menu
    Copy the full SHA
    12baa60 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    7075595 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    50ff458 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/r/index-active-block-cache-searc… 

    …hes' into ra/index-active-block-cache-searches-repopulate
    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    436b252 View commit details
    Browse the repository at this point in the history

  6. Fixing tests

    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    30c753c View commit details
    Browse the repository at this point in the history

  7. Add check for ID is nil

    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    a6558fa View commit details
    Browse the repository at this point in the history

  8. Add check for ID is nil 2

    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    2978a79 View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/master' into r/index-active-block

    @rallen090
    rallen090 committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    c9d9c4f View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2021

  1. Add IndexGarbageCollected

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    bd4169d View commit details
    Browse the repository at this point in the history

  2. Fix CI

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    4282709 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    03e0df1 View commit details
    Browse the repository at this point in the history

  4. Rebased

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    54b9c0e View commit details
    Browse the repository at this point in the history

  5. Fix test

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    faaa846 View commit details
    Browse the repository at this point in the history

  6. More test fixes

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    d83522c View commit details
    Browse the repository at this point in the history

  7. Test fixes

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    cd21e4a View commit details
    Browse the repository at this point in the history

  8. Lint

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    089e80c View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    603d1b4 View commit details
    Browse the repository at this point in the history

  10. Merge remote-tracking branch 'origin/r/index-active-block-cache-searc… 

    …hes' into ra/index-active-block-cache-searches-repopulate
    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    7722d32 View commit details
    Browse the repository at this point in the history

  11. Forgot integration tag

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    c61cd1b View commit details
    Browse the repository at this point in the history

  12. Merge conflict

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    51501f8 View commit details
    Browse the repository at this point in the history

  13. Check if segments require background GC before compacting (#3695)

    @robskillington
    robskillington authored Aug 26, 2021
    Configuration menu
    Copy the full SHA
    b420578 View commit details
    Browse the repository at this point in the history

  14. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    f3337c2 View commit details
    Browse the repository at this point in the history

  15. Rebased

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    d4c0015 View commit details
    Browse the repository at this point in the history

  16. Fix tests

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    6438044 View commit details
    Browse the repository at this point in the history

  17. Fix tests

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    6b21b4e View commit details
    Browse the repository at this point in the history

  18. Lint

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    5131acd View commit details
    Browse the repository at this point in the history

  19. Only GC segments things every so often

    @robskillington
    robskillington committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    a1f689b View commit details
    Browse the repository at this point in the history

  20. Fix active block test

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    ad10d33 View commit details
    Browse the repository at this point in the history

  21. Mock

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    7cbbec9 View commit details
    Browse the repository at this point in the history

  22. Merge remote-tracking branch 'origin/r/index-active-block' into r/ind… 

    …ex-active-block-cache-searches
    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    11b3f01 View commit details
    Browse the repository at this point in the history

  23. Rebased

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    6abefae View commit details
    Browse the repository at this point in the history

  24. Lint

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    8162ee2 View commit details
    Browse the repository at this point in the history

  25. Rebased

    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    dfd2110 View commit details
    Browse the repository at this point in the history

  26. Merge remote-tracking branch 'origin/r/index-active-block-cache-searc… 

    …hes' into ra/index-active-block-cache-searches-repopulate
    @rallen090
    rallen090 committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    fc4cd09 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2021

  1. Fix test

    @rallen090
    rallen090 committed Aug 27, 2021
    Configuration menu
    Copy the full SHA
    9873beb View commit details
    Browse the repository at this point in the history