Telemetry: Deduplicate log entries

[marcotc]

This PR removes duplicate telemetry logs sent within the same batch (currently 10s). The number of occurrences is captured in the new count field for the Log telemetry event, so we can know how many events were removed as duplicated.

Change log entry

None

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-12-18 00:12:46

Comparing candidate commit fcde76a in PR branch dedup-logs with baseline commit 61ca49f in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 31 metrics, 2 unstable metrics.

[github-actions]

Thank you for updating Change log entry section 👏

^{Visited at: 2024-12-13 19:02:47 UTC}

[datadog-datadog-prod-us1]

Datadog Report

Branch report: dedup-logs
Commit report: fcde76a
Test service: dd-trace-rb

✅ 0 Failed, 22127 Passed, 1475 Skipped, 5m 26.16s Total Time

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 98.47716% with 3 lines in your changes missing coverage. Please review.

Project coverage is 97.75%. Comparing base (ef81a2f) to head (35c01fb).

Files with missing lines	Patch %	Lines
lib/datadog/core/telemetry/event.rb	92.10%	3 Missing ⚠️

Additional details and impacted files

@@           Coverage Diff            @@
##           master    #4154    +/-   ##
========================================
  Coverage   97.75%   97.75%            
========================================
  Files        1355     1355            
  Lines       82007    82192   +185     
  Branches     4207     4217    +10     
========================================
+ Hits        80164    80349   +185     
  Misses       1843     1843            

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[p-datadog]

Should the worker spec contain a test for metrics?