v0.11.12

0.11.12

Fixes

• Unix onramp: Add the missing StartStream message to handle multiple connections correctly

v0.11.11

Fix issue with the kafka connector that broke delivery guarantees introduced during the 0.11.7 update of librdkafka

v0.11.10

0.11.10

Fixes

• Fix windowed queries emitting events with null metadata on tick

v0.11.9

0.11.9

Fixes

• Kafka onramp: Remove failing metadata fetch in order to verify topic existence. Instead detect subscription errors and stop the onramp in that case.

Details

The Kafka onramp used to fail non-reliably during startup when attempting to verify topic existence by fetching the metadata for all given topics. This was error prone. Additionally we hard-coded a timeout that was way too tight, especially for big clusters. We removed this check and instead error properly if we find out that a subscription did not work. This only works asynchronously, so the only way is to stop the source. The Tremor logs will show the error. Example:

2021-10-20T13:16:52.549478+02:00 INFO tremor_runtime::source::kafka - [Source::tremor://localhost/onramp/datain/simplees01/out] Subscribing to: ["test", "snot"]
2021-10-20T13:16:52.549752+02:00 INFO tremor_runtime::source::kafka - [Source::tremor://localhost/onramp/datain/simplees01/out] Subscription initiated...
2021-10-20T13:16:52.550037+02:00 INFO tremor_runtime::onramp - Onramp tremor://localhost/onramp/datain/simplees01/out started.
2021-10-20T13:16:52.550816+02:00 INFO tremor_runtime::source - [Source::tremor://localhost/onramp/datain/simplees01/out] Connecting tremor://localhost/pipeline/system::metrics/system/in as metrics pipeline.
2021-10-20T13:16:52.551138+02:00 INFO tremor_runtime::pipeline - [Pipeline::tremor://localhost/pipeline/system::passthrough/simplees01] Connecting tremor://localhost/onramp/datain/simplees01/out to 'in'
2021-10-20T13:16:52.551325+02:00 INFO tremor_runtime::system - Binding binding tremor://localhost/binding/default/simplees01
2021-10-20T13:16:52.567448+02:00 ERROR tremor_runtime::source::kafka - [Source::tremor://localhost/onramp/datain/simplees01/out] Subscription failed: UnknownTopicOrPartition (Broker: Unknown topic or partition). Stopping.
2021-10-20T13:16:52.567547+02:00 WARN tremor_runtime::source - [Source::tremor://localhost/onramp/datain/simplees01/out] Disconnected.

v0.11.8

0.11.8

Fixes

• Fix hdr and dds aggregation function losing events when aggregating > 8192 events: #1246
• Make otel severity_number optional: #1248

New Features

• Add the unix-socket onramp: #1236 By @Agares

v0.11.7 - Upgrade librdkafka to 1.6.1

We crafted this release in order to mitigate a possible bug in librdkafka: confluentinc/librdkafka#2933

Fixes

• Upgrade dependency on librdkafka to 1.6.1 #1228.

v0.11.6 - Fix Memory safety issue

0.11.6

Fixes

• Fix possible memory safety issue when using patch or merge on state #1217.

Affected tremor-script code sample:

# this is where the memory safety issue occured
let state = merge state of event end;
emit state;

As an optimization we were optimizing both patch and merge to update the target expression (state in the case above) in-place, but only if the merge/patch result is assigned to itself. In case of state as target expression we were adding references to a given memory region where the event data was allocated and those references now outlived the actual event data allocation. 😱

This whole optimization has been removed for now.

Release v0.11.5

0.11.5

Fixes

• Fix artefact sorting in tremor startup script

v0.11.4 - Fixing the release builds

Fixes

• Fix the Release archive and package build process

v0.11.3 - Fixing our Release builds

New features

• Add tests for merge feature in tremor-script #721

Fixes

• Remove a number of transmutes
• Catalog remaining transmutes with related tickets
• Bump snmalloc-rs to 0.2.26 to ensure builds succeed on systems with libc < 2.25