v2.5.0

• [Feature] Pipe all the errors including synchronous errors via the error.occurred.
• [Improvement] Pipe delivery errors that occurred not via the error callback using the error.occurred channel.
• [Improvement] Introduce WaterDrop::Errors::ProduceError and WaterDrop::Errors::ProduceManyError for any inline raised errors that occur. You can get the original error by using the #cause.
• [Improvement] Include #dispatched messages handler in the WaterDrop::Errors::ProduceManyError error, to be able to understand which of the messages were delegated to librdkafka prior to the failure.
• [Maintenance] Remove the WaterDrop::Errors::FlushFailureError in favour of correct error that occurred to unify the error handling.
• [Maintenance] Rename Datadog::Listener to Datadog::MetricsListener to align with Karafka (#329).
• [Fix] Do not flush when there is no data to flush in the internal buffer.
• [Fix] Wait on the final data flush for short-lived producers to make sure, that the message is actually dispatched by librdkafka or timeout.

v2.4.11

• Replace the local rspec locator with generalized core one.
• Make ::WaterDrop::Instrumentation::Notifications::EVENTS list public for anyone wanting to re-bind those into a different notification bus.

v2.4.10

• Include caller in the error instrumentation to align with Karafka.

v2.4.9

• Remove empty debug logging out of LoggerListener.
• Do not lock Ruby version in Karafka in favour of karafka-core.
• Make sure karafka-core version is at least 2.0.9 to make sure we run karafka-rdkafka.

v2.4.8

• Use monotonic time from Karafka core.

v2.4.7

• Add support to customizable middlewares that can modify message hash prior to validation and dispatch.
• Fix a case where upon not-available leader, metadata request would not be retried
• Require karafka-core 2.0.7.

v2.4.6

• Set statistics.interval.ms to 5 seconds by default, so the defaults cover all the instrumentation out of the box.

Upgrade notes

If you want to disable librdkafka statistics because you do not use them at all, update the kafka statistics.interval.ms setting and set it to 0:

producer = WaterDrop::Producer.new

producer.setup do |config|
  config.deliver = true
  config.kafka = {
    'bootstrap.servers': 'localhost:9092',
    'statistics.interval.ms': 0
  }
end

v2.4.5

• Fix invalid error scope visibility.
• Cache partition count to improve messages production and lower stress on Kafka when partition_key is on.

v2.4.4

• Add a temporary patch on top of rdkafka-ruby to mitigate metadata fetch timeout failures.

v2.4.3

• Support for librdkafka 0.13
• Update Github Actions
• Change auto-generated id from SecureRandom#uuid to SecureRandom#hex(6)
• Remove shared components that were moved to karafka-core from WaterDrop