Fluent Bit 3.1.0

https://fluentbit.io/announcements/v3.1.0/

What's Changed

• release: update to 3.0.7 by @github-actions in #8876
• in_prometheus_scrape: add User-Agent HTTP header (#8880) by @endersonmaia in #8882
• tests: internal: log: use milliseconds to do time comparisons for cache timeout. by @pwhelan in #8891
• tests/runtime/in_podman_metrics: refactor iteration of counters to use cfl_list from #8844. by @pwhelan in #8888
• out_cloudwatch_logs: support log_group_class option by @PettitWesley in #8832
• in_http: respond accordingly to requests that produce errors. by @pwhelan in #8794
• out_calyptia: move debug payload to debug level. by @lecaros in #8805
• tests: rutime: out_http: simplify and make the in_http test more robust. by @pwhelan in #8897
• in_splunk: Store HEC token on enabled HTTP2 and raw endpoints by @cosmo0920 in #8883
• in_splunk: Add switch for storing in metadata or records and handle multiple tokens on in splunk by @cosmo0920 in #8900
• in_kubernetes_events: refactor time check to use struct flb_time. by @pwhelan in #8887
• Fix GCC 14.1 build issues by @Javex in #8901
• in_systemd: Move one record back after skipping to the end by @ardavast in #8917
• http_server: api: v1: traces: fix finding inputs by alias. by @pwhelan in #8886
• in_winevtlog: Fix threshold condition to avoid unnecessary warning by @Meetp369 in #8771
• dockerfile: update to bookworm base image by @patrick-stephens in #8916
• lib: cmetrics: upgrade to v0.9.1 by @edsiper in #8922
• CMakeLists.txt: fix build with ninja by @ThomasDevoogdt in #8835
• processor_metrics_selector: Implement delete by label value operation by @cosmo0920 in #8812
• dockerfiles: windows: Update to use vcpkg instead of chocolatey by @cosmo0920 in #8924
• core: add log groups support and full OTLP <--> OTLP by @edsiper in #8898
• out_opentelemetry: fix handling of multiple scopes by @edsiper in #8933
• build: add new FLB_MINIMAL cmake option to disable all plugins by @edsiper in #8935
• tls: Verify vhost when tls.verify is enabled by @cosmo0920 in #8934
• workflows: remove AppVeyor from release workflow by @patrick-stephens in #8948
• lib: monkey: upgrade to v1.7.5 by @edsiper in #8945
• in_opentelemetry: attempt to fix tag_from_uri by @shaohme in #8881
• help: input: Handle listen to be a parameter for setting up listen address by @cosmo0920 in #8952
• lib: c-ares: upgrade to v1.30.0 by @edsiper in #8953
• workflows: bump docker/build-push-action from 5 to 6 by @dependabot in #8973
• in_opentelemetry: opentelemetry_prot: Fix string in http response code 400 by @lecaros in #8979
• in_prometheus_remote_write: prom_rw_prot: Fix string in http response code 400 by @lecaros in #8978
• in_winevtlog: Retrieve actual user account's domain and name by @cosmo0920 in #8992
• in_splunk: splunk_prot: Fix string in http response code 400. by @lecaros in #8980
• in_winevtlog: Permit absence of publisher metadata by @cosmo0920 in #8974
• processor_content_modifier: add support for OTel Logs Resource and Scopes by @edsiper in #8989
• in_docker: fix memory leak caused by conversion error by @Garfield96 in #8994
• processor_opentelemetry_envelope: new processor to package non OTel Logs content as OTel by @edsiper in #9001
• in_opentelemetry: handle missing or invalid content-type headers in metrics and traces handlers by @portswigger-tim in #8986
• in_kubernetes_events: Efficiently stream kubernetes events via watch by @ryanohnemus in #8351
• out_loki: allow sending unquoted strings by @iandrewt in #8814
• parser: add new option time_system_timezone (copy of #8164) by @edsiper in #9006
• processor_content_modifier: logs: do not fail if keys are not found by @edsiper in #9005
• out_datadog: Add support for setting a static hostname by @jszwedko in #8988
• Improved OpenTelemetry OTLP error handling by @nuclearpidgeon in #8962
• tls: input: output: Provide restoring way for tls.verify hebavior by @cosmo0920 in #8966
• utils: floating-point number support in size-to-bytes conversion by @Meetp369 in #8767
• Added parser for Linux kernel netfilter firewall log by @protohuf in #8778
• workflows: update for 3.1 release by @edsiper in #9008
• lib: c-ares: upgrade to v1.31.0 by @edsiper in #9009
• metrics: Allocate metrics' titles dynamically by @cosmo0920 in #8969
• in_winetvlog: Handle buffer allocation error and not mapped error by @cosmo0920 in #9011
• out_splunk: remove raw endpoint by @pmeier in #9007
• http_server: always set the content-length on HTTP/1.x (fix #9010) by @edsiper in #9036
• http_server and downstream: fix keepalive issues by @edsiper in #9038
• tls: openssl: fix handling of noisy non TLS errors by @edsiper in #9039
• lib: luajit: upgrade to 04dca791 by @edsiper in #9044
• lib: librdkafka: upgrade to v2.4.0 by @edsiper in #9045
• lib: c-ares: upgrade to v1.32.0 by @edsiper in #9047
• dockerfile: packaging: Fix build check for centos-7 and failures of package creations by @cosmo0920 in #9043
• lib: nghttp2: backport upstream security fix by @edsiper in #9052
• windows: luajit: Enable LuaJIT on ARM64 Windows by @cosmo0920 in #9051
• out_gelf: test: Implement injecting tag capability by @cosmo0920 in #9031
• out_loki: add support for structured metadata by @jtackaberry in #9048
• http_server: Don't override keepalive for HTTP/2 by @cosmo0920 in #9056
• config_format: yaml: Support passing arbitrary objects to processors by @tchrono in #8874
• in_syslog: Fix double free when no parser is set by @belzerus in #8976
• out_http: don't retry non retryable 4xx status codes by @IsraelZeromski in #8861
• build: Set security flags for release builds by @Garfield96 in #6087
• out_loki: Add http_buffer_max_size option and handle HTTP 5xx errors by @drbugfinder-work in #8830
• motd: v3.1 by @edsiper in #9059

New Contributors

• @Javex made their first contribution in #8901
• @ardavast made their first contribution in #8917
• @Meetp369 made their first contribution in #8771
• @shaohme made their first contribution in #8881
• @portswigger-tim made their first contribution in #8986
• @nuclearpidgeon made their first contribution in #8962
• @protohuf made their first contribution in #8778
• @pmeier made their first contribution in #9007
• @jtackaberry made their first contribution in #9048
• @belzerus made their first contribution in #8976
• @IsraelZeromski made their first contribution in #8861

Full Changelog: v3.0.6...v3.1.0

Fluent Bit 3.0.7

https://fluentbit.io/announcements/v3.0.7/

What's Changed

• release: update to 3.0.7 by @github-actions in #8876
• in_prometheus_scrape: add User-Agent HTTP header (#8880) by @endersonmaia in #8882
• tests: internal: log: use milliseconds to do time comparisons for cache timeout. by @pwhelan in #8891
• tests/runtime/in_podman_metrics: refactor iteration of counters to use cfl_list from #8844. by @pwhelan in #8888
• out_cloudwatch_logs: support log_group_class option by @PettitWesley in #8832
• in_http: respond accordingly to requests that produce errors. by @pwhelan in #8794
• out_calyptia: move debug payload to debug level. by @lecaros in #8805
• tests: rutime: out_http: simplify and make the in_http test more robust. by @pwhelan in #8897
• in_splunk: Store HEC token on enabled HTTP2 and raw endpoints by @cosmo0920 in #8883
• in_splunk: Add switch for storing in metadata or records and handle multiple tokens on in splunk by @cosmo0920 in #8900
• in_kubernetes_events: refactor time check to use struct flb_time. by @pwhelan in #8887
• Fix GCC 14.1 build issues by @Javex in #8901
• in_systemd: Move one record back after skipping to the end by @ardavast in #8917
• http_server: api: v1: traces: fix finding inputs by alias. by @pwhelan in #8886
• in_winevtlog: Fix threshold condition to avoid unnecessary warning by @Meetp369 in #8771
• dockerfile: update to bookworm base image by @patrick-stephens in #8916
• lib: cmetrics: upgrade to v0.9.1 by @edsiper in #8922
• CMakeLists.txt: fix build with ninja by @ThomasDevoogdt in #8835
• processor_metrics_selector: Implement delete by label value operation by @cosmo0920 in #8812
• dockerfiles: windows: Update to use vcpkg instead of chocolatey by @cosmo0920 in #8924

New Contributors

• @Javex made their first contribution in #8901
• @ardavast made their first contribution in #8917
• @Meetp369 made their first contribution in #8771

Full Changelog: v3.0.6...v3.0.7

Fluent Bit 3.0.6

https://fluentbit.io/announcements/v3.0.6/

What's Changed

• release: update to 3.0.6 by @github-actions in #8865
• packaging: add build support for ubuntu 24.04 noble numbat by @markuman in #8796
• out_stackdriver: Support writing to textPayload field of Cloud Logging LogEntry. by @shuaich in #8850
• out_splunk: fix metadata bug that affects splunk_token behavior (fix #8867) by @edsiper in #8873
• core: Fix crash when running dry by @zecke in #8872

New Contributors

• @markuman made their first contribution in #8796
• @shuaich made their first contribution in #8850
• @zecke made their first contribution in #8872

Full Changelog: v3.0.5...v3.0.6

Fluent Bit 3.0.5

https://fluentbit.io/announcements/v3.0.5/

What's Changed

• release: update to 3.0.5 by @github-actions in #8839
• workflows: ensure only master releases are marked latest by @patrick-stephens in #8856
• engine: free after log worker thread has been stopped by @hiroyha1 in #8486
• out_splunk: reduce noise and fix hec_token handling (fix #8859) by @edsiper in #8864
• winevtlog: change total_size_threshold to size_t by @braydonk in #8853
• output: Fix handling of metrics in output processor by @tchrono in #8848

New Contributors

• @hiroyha1 made their first contribution in #8486
• @tchrono made their first contribution in #8848

Full Changelog: v3.0.4...v3.0.5

Fluent Bit 2.2.3

https://fluentbit.io/announcements/v2.2.3/

What's Changed

• release: update to 2.2.3 by @github-actions in #8377
• maintenance: backport fixes by @edsiper in #8402
• input_chunk: added proper accounting of chunks that are rolled over by @leonardo-albertovich in #8441
• workflows: windows: use concrete option on windows workflow [Backport 2.2] by @cosmo0920 in #8444
• network: utils: Fix int conversion errors [Backport to 2.2] by @cosmo0920 in #8575
• api: v2: reload: Prevent duplicated request via api v2 reload [Backport 2.2] by @cosmo0920 in #8462
• in_http: Adds support for Content-Encoding: gzip [Backport to 2.2] by @cosmo0920 in #8573
• engine_dispatch: remove chunks from memory if the task fails to be created by @seblaz in #8681
• in_kubernetes_events: update time check to use struct flb_time. by @pwhelan in #8845
• tests: in_podman_metrics: refactor iteration of counters to use cfl_list. by @pwhelan in #8844

Full Changelog: v2.2.2...v2.2.3

Fluent Bit 3.0.4

https://fluentbit.io/announcements/v3.0.4/

What's Changed

• release: update to 3.0.4 by @github-actions in #8770
• in_otel: support to add resource of log by @nokute78 in #8294
• http_server: Fix keep-alive for HTTP/1.1 requests by @iandrewt in #8761
• workflows: macos: Use matrix for building Apple Silicon artefacts by @cosmo0920 in #8765
• filter: aws metadata group retries by @mwarzynski in #7245
• workflows: bump ossf/scorecard-action from 2.3.1 to 2.3.3 by @dependabot in #8811
• config: fix error message grammar by @braydonk in #8818
• out_kafka: increase max kafka dynamic topic length to 249 characters by @mickymiek in #8789
• processor_labels: Remove a needless existence check for insert operation by @cosmo0920 in #8824
• Config: fix incorrect assignment of kernel version between major and minor by @thenamehasbeentake in #8797
• fix: splunk output plugin correct record accessor key for hec_token by @mannbiher in #8793
• out_datadog: Update the descriptions of special field options by @jszwedko in #8751
• in_premetheus_remote_write: Implement handler of payloads of prometheus remote write protocol by @cosmo0920 in #8725

New Contributors

• @iandrewt made their first contribution in #8761
• @mickymiek made their first contribution in #8789
• @thenamehasbeentake made their first contribution in #8797
• @mannbiher made their first contribution in #8793

Full Changelog: v3.0.3...v3.0.4

Fluent Bit 3.0.3

https://fluentbit.io/announcements/v3.0.3/

What's Changed

• workflows: bump azure/setup-kubectl from 3.2 to 4 by @dependabot in #8706
• workflows: bump azure/setup-helm from 3.5 to 4 by @dependabot in #8705
• release: update to 3.0.3 by @github-actions in #8707
• lib: updates for CFL, CMetrics and CTraces plus others by @edsiper in #8732
• in_splunk: out_splunk: Propagate ingested splunk_token authentication header by @cosmo0920 in #8738
• workflows: bump helm/kind-action from 1.9.0 to 1.10.0 by @dependabot in #8754
• in_http: fix url decoder by unifying normal interface with the one used in HTTP/1.x by @edsiper in #8752
• Update security policy to indicate 3.x supported only by @patrick-stephens in #8764
• out_chronicle: handle 1MB or larger chunks by @lecaros in #8766
• lib: updates on ctraces and cmetrics 2024-04-26 by @edsiper in #8768
• out_http: Use x-ndjson content type for json_lines by @mrueg in #8715

New Contributors

• @mrueg made their first contribution in #8715

Full Changelog: v3.0.2...v3.0.3

Fluent Bit 3.0.2

https://fluentbit.io/announcements/v3.0.2/

What's Changed

• engine_dispatch: remove chunks from memory if the task fails to be created by @seblaz in #8601
• release: update to 3.0.2 by @github-actions in #8676
• in_forward: Handle multiply concatenated gzip payloads by @cosmo0920 in #8665
• wamrc: build: macos: Prioritize for defined LLVM_DIR environment variable by @cosmo0920 in #8670
• lib: upgrade core libraries by @edsiper in #8686
• out_websocket: Add ability to provide additional headers by @markusthoemmes in #8536
• input_chunk: handle some chunk size debug messages as traces by @edsiper in #8688
• input_metric: fixed a double free by @leonardo-albertovich in #8690
• lib: cmetrics: upgrade to v0.7.3 by @edsiper in #8692
• out_loki: Change loglevel for non-existing but defined label in record by @drbugfinder-work in #8680
• in_tail: Preventing incorrect inode usage from db. #8025 by @jinyongchoi in #8062
• task: on retry, only put chunk down if there are no users (fix #8691) by @edsiper in #8694
• fix Oracle Log Analytics output plugin 400 Bad Request issue by @handsomecheung in #8685
• Add support to set otel fields from the event body based on keys. Sig… by @cb645j in #8644
• config: fix compilation with FLB_HAVE_STATIC_CONF. by @bglimepoint in #7536
• test: internal: log: fix failures caused by timing issue. by @pwhelan in #8672
• in_opentelemetry: fixed the uris used to detect gRPC requests by @leonardo-albertovich in #8697
• in_kubernetes_filter: add namespace_metadata_only option to fix regression from #8279 by @ryanohnemus in #8695
• Update cmetrics_decode_fuzz.c: Add missing include by @maflcko in #8647
• in_winevtlog: Make configurable for the size of collecting threshold per a cycle by @cosmo0920 in #8677
• in_http: reassign mk_http_request values on realloc. by @pwhelan in #8643
• lib: sqlite: upgrade to v3.45.2 by @edsiper in #8704
• in_emitter: Fix single record chunks and respect mem_buf_limit pause by @drbugfinder-work in #8473

New Contributors

• @markusthoemmes made their first contribution in #8536
• @handsomecheung made their first contribution in #8685
• @cb645j made their first contribution in #8644
• @bglimepoint made their first contribution in #7536
• @maflcko made their first contribution in #8647

Full Changelog: v3.0.1...v3.0.2

Fluent Bit 3.0.1

https://fluentbit.io/announcements/v3.0.1/

What's Changed

• release: update to 3.0.1 by @github-actions in #8619
• tests: runtime: processor_content_modifier: add test cases for convert by @nokute78 in #8627
• in_tail: skip_empty_line supports CRLF line by @nokute78 in #8474
• processor_sql: general fixes for conditional expressions by @edsiper in #8635
• workflows: windows: Add chain workflow for windows unit testing by @cosmo0920 in #8582
• http_server: added parser reset code to prevent use after free by @leonardo-albertovich in #8649
• lib: cmetrics: upgrade to v0.7.1 by @edsiper in #8652

Full Changelog: v3.0.0...v3.0.1

Fluent Bit 3.0.0

Summary of the big news here: https://fluentbit.io/announcements/v3.0.0/

CI issue with signing containers with Cosign: #8618

List of changes per commit

• release: update to 2.2.3 by @github-actions in #8377
• build: Fix release builds with enabled FLB_DEBUG by @Garfield96 in #8058
• workflows: bump actions/cache from 3 to 4 by @dependabot in #8389
• out_forward: fix memory leak during connection loss by @Garfield96 in #8399
• in_calyptia_fleet: general fixes from #8371 by @edsiper in #8392
• engine: fix several file descriptor leaks. by @pwhelan in #8393
• wasm: restore support for some targets by @ThomasDevoogdt in #8401
• out_stackdriver: add k8s_cluster resource type by @ryanohnemus in #8349
• workflows: update for new 2.2 branch/3.x master by @patrick-stephens in #8414
• workflows: bump frabert/replace-string-action from 2.4 to 2.5 by @dependabot in #8425
• workflows: bump peter-evans/dockerhub-description from 3 to 4 by @dependabot in #8424
• workflows: bump vlaurin/action-ghcr-prune from 0.5.0 to 0.6.0 by @dependabot in #8423
• input_chunk: added proper accounting of chunks that are rolled over by @leonardo-albertovich in #8440
• workflows: bump peter-evans/create-pull-request from 5 to 6 by @dependabot in #8445
• workflows: windows: Use concrete option on Invoke-WebRequest by @cosmo0920 in #8443
• workflows: bump hmarr/debug-action from 2 to 3 by @dependabot in #8456
• dockerfile: windows: Link OpenSSL libraries correctly by @cosmo0920 in #8463
• workflows: bump helm/kind-action from 1.8.0 to 1.9.0 by @dependabot in #8476
• out_stackdriver: fix bug in k8s_pod process_local_resource_id by @ryanohnemus in #8490
• out_stackdriver: print tag with api error message by @ryanohnemus in #8459
• out_opentelemetry: enhancements for log body and attributes handling (fix #8359) by @edsiper in #8491
• motd: v3 by @edsiper in #8510
• lib: cmetrics: upgrade to v0.7.0 by @edsiper in #8514
• out_cloudwatch_logs: Support EMF format for metrics type of events by @cosmo0920 in #8448
• mp: new API to convert between msgpack and CFL object by @edsiper in #8518
• in_head: fix buffer length for split_line by @nokute78 in #8516
• workflows: bump softprops/action-gh-release from 1 to 2 by @dependabot in #8565
• filter_kubernetes: add kubernetes_namespace metadata by @ryanohnemus in #8279
• Adds support for Content-Encoding: gzip to in_http by @erhudy in #7667
• workflows: make 3.0 releases latest by @patrick-stephens in #8415
• processor: new enhancements, API changes and new processor by @edsiper in #8563
• out_http: default the output format to JSON. by @pwhelan in #8493
• network: utils: Fix int conversion errors by @cosmo0920 in #8555
• processor_content_modifier: fix cb_processor_logs callback arguments type by @pwhelan in #8572
• in_tail: flush multiline before exit on EOF by @nokute78 in #8545
• workflows: bump softprops/action-gh-release from 1 to 2 by @dependabot in #8574
• http_server: component addition by @leonardo-albertovich in #8570
• in_forward: Implement handshake protocol by @cosmo0920 in #8561
• network: add port sharing feature by @leonardo-albertovich in #8571
• processor: Implement native processor metrics_selector by @cosmo0920 in #8526
• in_winevtlog: Display error on invalid subscription state by @cosmo0920 in #8544
• api: v2: reload: Prevent duplicated request via api v2 reload by @cosmo0920 in #8461
• in_tcp: Add a capability to inject source IP by @cosmo0920 in #7672
• wasm: filter_wasm: Pass through msgpack format records into wasm filters by @cosmo0920 in #8431
• custom_calyptia: fix using after freed memory(#8530) by @nokute78 in #8543
• in_tail: compressed file ingestion support by @leonardo-albertovich in #8585
• http_client: Add Ability to Process Http Chunked Stream by @ryanohnemus in #8316
• pack: increase buffer reallocation for higher performance (fix #8492) by @edsiper in #8589
• out_opentelemetry: support metadata key properties by @nokute78 in #8475
• tests: runtime: processor_content_modifier: add test code by @nokute78 in #8591
• in_elasticsearch: include file to fix warnings by @nokute78 in #8590
• filter_nest: define a new var to prevent pointer arithmetic by @nokute78 in #8454
• processor_sql: Ensure jemalloc compiling before starting to build sql parser by @cosmo0920 in #8594
• processor_sql: Remove a needless yywrap definition by @cosmo0920 in #8609
• http_server: removed deprecated code and added window update handling by @leonardo-albertovich in #8605
• packaging: build: Make to be able to replace docker cli via environment variable by @cosmo0920 in #8612
• lib: nghttp2: Disable auto-detection for OpenSSL by @cosmo0920 in #8613

New Contributors

• @erhudy made their first contribution in #7667

Full Changelog: v2.2.2...v3.0.0