1 Release published by 1 person

• v4.4.3

  published Jun 26, 2024

31 Pull requests merged by 10 people

• Sort index should always start from row zero

  #1690 merged Jul 19, 2024

• Sort index should always start from zero

  #1675 merged Jul 16, 2024

• Bugfix/1683/allow unsorted data in v1 api compact incomplete

  #1691 merged Jul 16, 2024

• Bugfix 1637: append does not respect prune previous

  #1640 merged Jul 15, 2024

• Refactor/1643/reduce prune previous memory footprint

  #1657 merged Jul 15, 2024

• Bugfix 1637: 4.4.x backport

  #1677 merged Jul 15, 2024

• Refactor 1643: 4.4.x backport

  #1688 merged Jul 15, 2024

• Release GIL when using recursive normalizers

  #1678 merged Jul 12, 2024

• Version map refactor for 4.4.x

  #1681 merged Jul 12, 2024

• Pin libcxx for conda to last known working versions (#1680)

  #1686 merged Jul 12, 2024

• Pin libcxx for conda to last known working versions

  #1680 merged Jul 12, 2024

• update docs: map_size is per library

  #1651 merged Jul 11, 2024

• Add note about staged/incomplete data and delete

  #1669 merged Jul 11, 2024

• Refactor log_event function and add retry logic (#1660)

  #1667 merged Jul 9, 2024

• Refactor log_event function and add retry logic

  #1660 merged Jul 8, 2024

• Try fix gh action checkout issue

  #1658 merged Jul 5, 2024

• Upgrade to Protobuf 5

  #1635 merged Jul 3, 2024

• conda-build: Replace boost-cpp with libboost-devel

  #1653 merged Jul 1, 2024

• 44x read streaming 20240628

  #1654 merged Jun 30, 2024

• Fix ArcticDB reading streaming data

  #1647 merged Jun 28, 2024

• Reduce memory usage during conda build

  #1649 merged Jun 26, 2024

• Encoding version 2: binary-only memory layout

  #1317 merged Jun 25, 2024

• Implement support for very old style symbol list entries.

  #1630 merged Jun 25, 2024

• Set numpy<2 for older arcticdb

  #1644 merged Jun 25, 2024

• build: Update azure-core-cpp to 1.12.0

  #1639 merged Jun 25, 2024

• Enhancement/1610/method to force compact symbol list

  #1624 merged Jun 21, 2024

• Adapt Raise to use format string as message directly if no args are given

  #1606 merged Jun 21, 2024

• Fix sort_and_finalize_staged_data

  #1617 merged Jun 21, 2024

• Added resample demo notebook

  #1634 merged Jun 21, 2024

• Fix bullet point lists in query builder docstrings

  #1594 merged Jun 21, 2024

• Adds a unit test for lib.version_store.sort_index

  #1629 merged Jun 20, 2024

19 Pull requests opened by 6 people

• Bugfix 1641: Remove unused staged arg from write_pickle_batch

  #1642 opened Jun 24, 2024

• NO_SUCH_BUCKET and RESOURCE_UNAVAILABLE are not expected error types

  #1648 opened Jun 26, 2024

• Make modification of snapshot atomic and corresponding tombstone handling changes

  #1650 opened Jun 26, 2024

• Release GIL on read

  #1656 opened Jul 2, 2024

• Update benchmark_commits.yml and fix the checkout there

  #1659 opened Jul 5, 2024

• Fix resampling using invalid iterator

  #1661 opened Jul 5, 2024

• Bugfix 1552: Set row_count/rows to None in get_description/get_info and batch versions thereof if symbol is pickled

  #1664 opened Jul 5, 2024

• Enhancement 1666: Do not fallback to iterating snapshots if if version as_of int or timestamp not found in version chain in V2 API

  #1672 opened Jul 10, 2024

• Correctly hash descriptor in segment header

  #1676 opened Jul 11, 2024

• Properly hash descriptor in v1 (master)

  #1682 opened Jul 11, 2024

• Release GIL on recursive normalizers (master)

  #1684 opened Jul 11, 2024

• Bugfix 1683: Add validate_index arg to staged data finalization in both V1 and V2 APIs

  #1694 opened Jul 16, 2024

• Add support for cgroup v2 cpu limits

  #1696 opened Jul 16, 2024

• Bugfix 1692: fix batch read with row range no query builder

  #1697 opened Jul 16, 2024

• WIP parallelize string handling, enable python types, prepare for Arrow

  #1698 opened Jul 17, 2024

• Add object information to the exception messages

  #1700 opened Jul 18, 2024

• Port sparse data test from the old repo

  #1701 opened Jul 18, 2024

• Added symbol to ReadRequest docstring

  #1702 opened Jul 19, 2024

• Enhancement/lazy dataframe

  #1703 opened Jul 19, 2024

14 Issues closed by 4 people

• V2 encoding does not hash descriptor

  #706 closed Jul 18, 2024

• Improve test coverage of `sort_merge`

  #1693 closed Jul 18, 2024

• `append` does not respect prune previous

  #1637 closed Jul 15, 2024

• Reduce memory footprint of `prune_previous_versions`

  #1643 closed Jul 15, 2024

• Import error with 4.4.1

  #1689 closed Jul 12, 2024

• Dedup broken with V2 encoding

  #1645 closed Jul 5, 2024

• Investigate high memory usage of `lib.prune_previous_versions`

  #1638 closed Jul 5, 2024

• Improve error message with recursive normalisers

  #1299 closed Jul 2, 2024

• Feature to restrict versions of a symbol to only the previous and latest one.

  #1628 closed Jul 2, 2024

• Conda+mac workflow fails with MacOS version 13.6.4

  #1322 closed Jul 1, 2024

• Import from arcticdb.util.test gives an error on Windows

  #1279 closed Jul 1, 2024

• Docs: explain that update does nothing when an empty dataframe is passed

  #1591 closed Jun 27, 2024

• E_ASSERTION_FAILURE Index mismatch, cannot update a timeseries with a non-timeseries-indexed frame

  #1627 closed Jun 23, 2024

• Add method to forcibly compact the symbol list, and throw a useful error message if it fails

  #1610 closed Jun 21, 2024

17 Issues opened by 9 people

• Add information about the key in expectation messages

  #1699 opened Jul 18, 2024

• Add support for cgroup v2

  #1695 opened Jul 16, 2024

• Batch read does not respect the row_range argument of the ReadRequest

  #1692 opened Jul 15, 2024

• Can you add support for Google Cloud Storage

  #1687 opened Jul 12, 2024

• Remove pin to libcxx==17.0.6 for conda

  #1685 opened Jul 12, 2024

• Add `validate_index` argument to `compact_incomplete` and `finalize_staged_data`

  #1683 opened Jul 11, 2024

• sort_and_finalize_staged_data is not properly tested

  #1679 opened Jul 11, 2024

• LMDB windows, error when access with newly created library.

  #1673 opened Jul 11, 2024

• Add per-key-type metrics to library size calculation job

  #1668 opened Jul 9, 2024

• Reading `as_of=int` should not search snapshots if the version has been tombstoned in the V2 API

  #1666 opened Jul 8, 2024

• is thread-safe in multi-thread application?

  #1665 opened Jul 7, 2024

• Reading just the index functionality extended to `read_batch`

  #1663 opened Jul 5, 2024

• Reading just the index functionality extended to `head/tail`

  #1662 opened Jul 5, 2024

• You can create invalid library names with Mongo backend

  #1655 opened Jul 1, 2024

• Mixing pd.Timestamp, pd.NaT and timezone aware pd.Timestamp throws a misleading exception

  #1652 opened Jun 27, 2024

• Crash during resampling

  #1646 opened Jun 25, 2024

• `write_pickle_batch` has a `staged` argument that does not do anything

  #1641 opened Jun 24, 2024

33 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Read index API

  #1568 commented on Jul 17, 2024 • 27 new comments

• Fix #1384 by refactoring `VersionMap` to include all combinations of `LoadType`s and whether to `include_deleted`

  #1443 commented on Jul 12, 2024 • 3 new comments

• Add mimalloc

  #1602 commented on Jun 26, 2024 • 2 new comments

• User facing API to analyze library size

  #1392 commented on Jun 25, 2024 • 0 new comments

• Flaky ASV benchmark

  #1589 commented on Jul 18, 2024 • 0 new comments

• MultiIndex with RangeIndex as first column is not consitent with RangeIndex

  #1569 commented on Jul 18, 2024 • 0 new comments

• Do not cast empty Pandas blocks to float64 when empty types are enabled

  #1562 commented on Jul 18, 2024 • 0 new comments

• Index values returned by tail and row_range parameter are different than the ones returned by Pandas' tail when RangeIndex is used

  #1537 commented on Jul 18, 2024 • 0 new comments

• ccache emits warnings in Windows CI builds

  #1396 commented on Jul 18, 2024 • 0 new comments

• `compact_incomplete` should only write a symbol list key if the symbol is new

  #1324 commented on Jul 18, 2024 • 0 new comments

• IndexRange interect does not take into account if the intervals are opened/closed

  #1305 commented on Jul 18, 2024 • 0 new comments

• Flaky VersionStoreTest.StressBatchReadUncompressed cpp test

  #1254 commented on Jul 18, 2024 • 0 new comments

• CMake cannot generate proper project unless executed within python environment

  #1232 commented on Jul 18, 2024 • 0 new comments

• Numpy arrays should not allow inputs of different type

  #1214 commented on Jul 18, 2024 • 0 new comments

• `compact_incomplete` fails if one of the dataframes is of empty-type

  #1056 commented on Jul 18, 2024 • 0 new comments

• iterate_type with prefix can return incomplete results with S3 storage

  #212 commented on Jul 18, 2024 • 0 new comments

• RLE, constant and frequency encodings

  #1605 commented on Jun 25, 2024 • 0 new comments

• get_description date_range truncates nanoseconds

  #1460 commented on Jul 1, 2024 • 0 new comments

• ArcticDB crashes when when trying to normalize timezone data with MsgPack

  #1406 commented on Jul 1, 2024 • 0 new comments

• Certificate path detection is incorrect when using AWS STS (eg with AWS EKS)

  #1129 commented on Jul 1, 2024 • 0 new comments

• Poor performance when reading as_of a date with many early versions deleted

  #1384 commented on Jul 1, 2024 • 0 new comments

• Document that as_of interprets argument as UTC and document how point-in-time works

  #483 commented on Jul 1, 2024 • 0 new comments

• Promote internal API method `clear` to python API

  #375 commented on Jul 1, 2024 • 0 new comments

• Overlapping index check during update logic is incorrect

  #1306 commented on Jul 1, 2024 • 0 new comments

• Empty type known issues [epic]

  #1339 commented on Jul 1, 2024 • 0 new comments

• Flaky `test_filter_numeric_isnotin_si`

  #1546 commented on Jul 3, 2024 • 0 new comments

• lib._nvs.get_num_rows incorrect for pickled symbol

  #1552 commented on Jul 5, 2024 • 0 new comments

• maint: Support protobuf Python library v5

  #1422 commented on Jul 8, 2024 • 0 new comments

• `as_of=Timestamp(...)` searches in snapshots

  #682 commented on Jul 9, 2024 • 0 new comments

• EPIC: Resampling remaining work

  #1587 commented on Jul 12, 2024 • 0 new comments

• E_ASSERTION_FAILURE Invalid dtype 'UNKNOWN' in visit dim

  #1626 commented on Jul 16, 2024 • 0 new comments

• Updating an array type is not working propery

  #1277 commented on Jul 18, 2024 • 0 new comments

• Rationalise behaviour when a column or date range is requested that does not exist

  #1558 commented on Jul 18, 2024 • 0 new comments