From d17af79b395bc85f28e9e7e2ef09dce1b6d3531d Mon Sep 17 00:00:00 2001 From: Thomas Date: Tue, 11 Nov 2025 18:31:25 -0500 Subject: [PATCH 1/2] chore(releasing): prepare v0.51.1 release (#24214) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * chore(ci): reorganize integration test files (#24108) * chore(ci): reorganize integration test files * revert nats data move * fix paths to data * fix more paths * amqp fix * Fix logstash int tests shared files paths * Rename scripts/integration -> tests/integration * scripts/integration -> tests/integration in source files * Fix scripts->tests * Fix gcp paths * Fix http-client pem path * move nats data --------- Co-authored-by: Thomas * chore(vdev): move all utils in a new utils folder (#24143) * chore(vdev): move all utils in a new utils folder * move remaining files to utils dir * move remaining files to utils dir * fmt * chore(vdev): make modules visible to rustfmt (#24162) * Remove mod inside cli_subcommands macro * cargo fmt * chore(vdev): apply vdev rust check fixes * Link to rustfmt issue * fix(vdev): release prepare vrl version pinning (#24158) * Add --dry-run to release prepare * Add error handling and checks to pin_vrl_version * Add wrapper to toml * Remove wrapper, parse as Table instead * Fix vrl pinning logic * Enable preserve_order feature in toml crate * Use dependency instead of whole toml * Fix dry run docs * Fix dry run wording * refactor to use toml_edit * Add update_vrl_to_version to add unit test * Use indoc in prepare.rs * Remove preserve_order feature * chore(deps): update VRL to add missing stdlib fns from 0.28 (#24178) * chore(ci): temporarily remove homebrew publish step from publish workflow (#24185) This temporarily removes the publish-homebrew job from the publish workflow to address issue #24139. This is step 1 of the plan to fix the homebrew publishing process. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-authored-by: Claude * fix(blackhole sink): disable rate limiting for periodic stats messages (#24190) * fix(blackhole sink): disable rate limiting for periodic stats messages The blackhole sink's informational "Collected events" messages were being rate-limited since rate limiting was enabled by default in #24024. This is undesirable because: 1. These are deliberately scheduled periodic messages (controlled by the `print_interval_secs` config option), not error conditions that could flood the logs 2. Users explicitly configure the frequency - rate limiting defeats that explicit configuration and breaks user expectations 3. The interval timer already prevents log flooding, making additional rate limiting redundant 4. The blackhole sink is used for debugging/testing, where predictable output is essential This fix adds `internal_log_rate_limit = false` to both info! calls, similar to how the console sink disables rate limiting for its critical operational messages. Fixes #24188 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude * chore: add changelog fragment for blackhole sink rate limiting fix --------- Co-authored-by: Claude * chore(internal logs): Disable rate limiting for critical internal error logs (#24192) * Improve debug log in aws_ecs_metrics * Add internal_log_rate_limit = false to config reload errors * Disable rate limiting for lua build failure * Disable rate limiting for amqp build failure * Add internal_log_rate_limit = false to important failures during reload * Disable log rate limit for repeated events in process.rs * Update src/config/watcher.rs * Fix message format * fix(tracing): prevent panic for traces without standard fields (#24191) * fix(tracing): prevent panic for traces without std fields * forbid unwrap in this lib * clippy fix * improve events_with_custom_fields_no_message_dont_panic, advance to next window * chore(tracing): do not rate limit utlization report (#24202) * chore(internal metrics): move config_reload_* metrics to VectorReload* (#24203) * chore(internal metrics): move config_reload_* metrics to VectorReloaded and VectorReloadedError * update topology_doesnt_reload_new_data_dir test * chore(dev): cargo fmt * strengthen tests, since now we have a better interface * chore(releasing): Add 0.51.0 known issues (#24211) * Format fixes * Add 0.51.0 known issues * Add dots * Reword log panic known issue * Reword VRL missing fns * Backtick versions * Update website/cue/reference/releases/0.51.0.cue Co-authored-by: Pavlos Rontidis * Fix cue docs fmt --------- Co-authored-by: Pavlos Rontidis * Bump vector version to 0.51.1 * Bump VRL to 0.28.1 * Generate 0.51.1 cue * Add vrl_changelog * Remove whitespace * chore(releasing): Updated distribution/install.sh vector version to 0.51.1 * chore(releasing): Add 0.51.1 to versions.cue * chore(releasing): Created release md file * Add description * Reorder items and fix format * Finally fix styling * Bump date --------- Co-authored-by: Pavlos Rontidis Co-authored-by: Claude chore(releasing): pull in `internal_logs` fix into 0.51.1 (#24225) * fix(internal_logs source): remove rate limit (#24218) * fix(internal_logs source): remove rate limit * add changelog * Debug commit * Fix validated - Revert "Debug commit" This reverts commit c7b9ec9c74ef31d235df08edc4681d7336c9cc1e. * add unit test * fix check-events * Pull in internal_logs source fix * Add internal_logs known issue * Bump date * Update website/cue/reference/releases/0.51.0.cue Co-authored-by: Pavlos Rontidis --------- Co-authored-by: Pavlos Rontidis --- distribution/install.sh | 2 +- website/content/en/releases/0.51.1.md | 4 + website/cue/reference/releases/0.51.1.cue | 104 ++++++++++++++++++++++ website/cue/reference/versions.cue | 1 + 4 files changed, 110 insertions(+), 1 deletion(-) create mode 100644 website/content/en/releases/0.51.1.md create mode 100644 website/cue/reference/releases/0.51.1.cue diff --git a/distribution/install.sh b/distribution/install.sh index c3d80833ea432..38d765d203645 100755 --- a/distribution/install.sh +++ b/distribution/install.sh @@ -13,7 +13,7 @@ set -u # If PACKAGE_ROOT is unset or empty, default it. PACKAGE_ROOT="${PACKAGE_ROOT:-"https://packages.timber.io/vector"}" # If VECTOR_VERSION is unset or empty, default it. -VECTOR_VERSION="${VECTOR_VERSION:-"0.51.0"}" +VECTOR_VERSION="${VECTOR_VERSION:-"0.51.1"}" _divider="--------------------------------------------------------------------------------" _prompt=">>>" _indent=" " diff --git a/website/content/en/releases/0.51.1.md b/website/content/en/releases/0.51.1.md new file mode 100644 index 0000000000000..b3098b05a39f1 --- /dev/null +++ b/website/content/en/releases/0.51.1.md @@ -0,0 +1,4 @@ +--- +title: Vector v0.51.1 release notes +weight: 30 +--- diff --git a/website/cue/reference/releases/0.51.1.cue b/website/cue/reference/releases/0.51.1.cue new file mode 100644 index 0000000000000..f93558bc64ea4 --- /dev/null +++ b/website/cue/reference/releases/0.51.1.cue @@ -0,0 +1,104 @@ +package metadata + +releases: "0.51.1": { + date: "2025-11-13" + codename: "" + + whats_next: [] + + description: """ + * When Vector is running with debug logs enabled (`VECTOR_LOG=debug`), threads no + longer panic when logging utilization or other debug messages. + + * The `config_reload_rejected` and `config_reloaded` counters added in `0.51.0` were + not being emitted and have been replaced. `component_errors_total` with + `error_code="reload"` now replaces `config_reload_rejected` and `reloaded_total` + replaces `config_reloaded`. + + * The `basename`, `dirname` and `split_path` VRL functions added in `0.51.0` are now + properly exposed. + + * `blackhole` sink's periodic statistics messages are no longer rate limited. + + * The `internal_logs` source now captures all internal Vector logs without rate limiting. + Previously, repeated log messages were silently dropped. + """ + + changelog: [ + { + type: "fix" + description: """ + The `blackhole` sink's periodic statistics messages (controlled by `print_interval_secs`) are no longer incorrectly suppressed by rate limiting. These informational messages now appear at the user-configured interval as expected. + """ + contributors: ["pront"] + }, + { + type: "fix" + description: """ + Fixed a panic in the tracing rate limiter when config reload failed. While the panic didn't kill Vector (it was caught by tokio's task + runtime), it could cause unexpected behavior. The rate limiter now gracefully handles events without standard message fields. + """ + contributors: ["pront"] + }, + { + type: "enhancement" + description: """ + The `component_errors_total` metric now includes a `reason` tag when `error_code="reload"` to provide more granular information about reload + failures. Possible reasons include: + + - `global_options_changed`: Reload rejected because global options (like `data_dir`) changed + - `global_diff_failed`: Reload rejected because computing global config diff failed + - `topology_build_failed`: Reload rejected because new topology failed to build/healthcheck + - `restore_failed`: Reload failed and could not restore previous config + + Replaced metrics: + + - `config_reload_rejected` was replaced by `component_errors_total` with `error_code="reload"` and a `reason` tag specifying the rejection type + - `config_reloaded` was replaced by the existing `reloaded_total` metric + + Note: The replaced metrics were introduced in v0.50.0 but were never emitted due to a bug. These changes provide consistency across Vector's internal telemetry. + """ + contributors: ["pront"] + }, + { + type: "fix" + description: """ + The `internal_logs` source now captures all internal Vector logs without rate limiting. Previously, repeated log messages were silently + dropped. + """ + contributors: ["pront"] + }, + ] + + vrl_changelog: """ + ### [0.28.1 (2025-11-07)] + + #### Fixes + + - Fixed an issue where `split_path`, `basename`, `dirname` had not been added to VRL's standard + library and, therefore, appeared to be missing and were inaccessible in the `0.28.0` release. + + authors: thomasqueirozb (https://github.com/vectordotdev/vrl/pull/1553) + + + ### [0.28.0 (2025-11-03)] + """ + + commits: [ + {sha: "0aedea9561a4834f6abebaa2a0bc5580b9143a9e", date: "2025-11-04 02:03:46 UTC", description: "reorganize integration test files", pr_number: 24108, scopes: ["ci"], type: "chore", breaking_change: false, author: "Pavlos Rontidis", files_count: 125, insertions_count: 149, deletions_count: 122}, + {sha: "2d3793e96d7047408d6ce24d378d2396ca6830f4", date: "2025-11-05 01:13:53 UTC", description: "move all utils in a new utils folder", pr_number: 24143, scopes: ["vdev"], type: "chore", breaking_change: false, author: "Pavlos Rontidis", files_count: 40, insertions_count: 242, deletions_count: 174}, + {sha: "35a408804d9c4453852ff357c15d7ab3aaad5cbd", date: "2025-11-05 20:54:56 UTC", description: "improve/fix minor release template", pr_number: 24156, scopes: ["releasing"], type: "chore", breaking_change: false, author: "Thomas", files_count: 1, insertions_count: 23, deletions_count: 27}, + {sha: "0cce521b4a2eb2a92cb024e46e7c6ffcb1c64754", date: "2025-11-06 02:17:02 UTC", description: "make modules visible to rustfmt", pr_number: 24162, scopes: ["vdev"], type: "chore", breaking_change: false, author: "Thomas", files_count: 19, insertions_count: 218, deletions_count: 117}, + {sha: "4add1c3aa9ebe05d2e16a56afc3ee8accf7cfeb1", date: "2025-11-06 03:28:00 UTC", description: "release prepare vrl version pinning", pr_number: 24158, scopes: ["vdev"], type: "fix", breaking_change: false, author: "Thomas", files_count: 3, insertions_count: 66, deletions_count: 33}, + {sha: "1e8e99a4898958ae9b56ee33af162c98092ed9b9", date: "2025-11-06 21:29:00 UTC", description: "update VRL to add missing stdlib fns from 0.28", pr_number: 24178, scopes: ["deps"], type: "chore", breaking_change: false, author: "Thomas", files_count: 1, insertions_count: 1, deletions_count: 1}, + {sha: "fbbcffc1414041be01bff8963727ceedb2f7fe70", date: "2025-11-07 21:03:54 UTC", description: "temporarily remove homebrew publish step from publish workflow", pr_number: 24185, scopes: ["ci"], type: "chore", breaking_change: false, author: "Pavlos Rontidis", files_count: 1, insertions_count: 0, deletions_count: 12}, + {sha: "c855585c3386324b26ad2b8516c16177bc860d20", date: "2025-11-07 23:52:13 UTC", description: "disable rate limiting for periodic stats messages", pr_number: 24190, scopes: ["blackhole sink"], type: "fix", breaking_change: false, author: "Pavlos Rontidis", files_count: 2, insertions_count: 5, deletions_count: 0}, + {sha: "a22b790bcf2e111e7c1b6ffc2de1394fe37b7ae2", date: "2025-11-10 20:17:52 UTC", description: "Disable rate limiting for critical internal error logs", pr_number: 24192, scopes: ["internal logs"], type: "chore", breaking_change: false, author: "Thomas", files_count: 6, insertions_count: 42, deletions_count: 14}, + {sha: "87e7cb8733a6e5b0afe075e54be3cc397023c128", date: "2025-11-10 23:10:54 UTC", description: "prevent panic for traces without standard fields", pr_number: 24191, scopes: ["tracing"], type: "fix", breaking_change: false, author: "Pavlos Rontidis", files_count: 5, insertions_count: 56, deletions_count: 8}, + {sha: "a7e68b17010c58d0ac2a1656fe13468063c6ddf3", date: "2025-11-11 00:18:14 UTC", description: "do not rate limit utlization report", pr_number: 24202, scopes: ["tracing"], type: "chore", breaking_change: false, author: "Pavlos Rontidis", files_count: 1, insertions_count: 1, deletions_count: 15}, + {sha: "7d657023131d15334255a29a390f2a3604ff67cc", date: "2025-11-11 20:01:07 UTC", description: "move config_reload_* metrics to VectorReload*", pr_number: 24203, scopes: ["internal metrics"], type: "chore", breaking_change: false, author: "Pavlos Rontidis", files_count: 11, insertions_count: 184, deletions_count: 265}, + {sha: "5432632b414472e004cc68a0cae56f0b4451e8af", date: "2025-11-11 23:42:09 UTC", description: "Add 0.51.0 known issues", pr_number: 24211, scopes: ["releasing"], type: "chore", breaking_change: false, author: "Thomas", files_count: 2, insertions_count: 27, deletions_count: 5}, + {sha: "3e09dc86b8aaf6606abc9c5acc9ddf52f39f6e17", date: "2025-11-12 04:31:25 UTC", description: "prepare v0.51.1 release", pr_number: 24214, scopes: ["releasing"], type: "chore", breaking_change: false, author: "Thomas", files_count: 204, insertions_count: 1055, deletions_count: 756}, + {sha: "3ca3ec6f55522c406680a183416bf7a8b35372ae", date: "2025-11-13 02:07:06 UTC", description: "remove rate limit", pr_number: 24218, scopes: ["internal_logs source"], type: "fix", breaking_change: false, author: "Pavlos Rontidis", files_count: 3, insertions_count: 48, deletions_count: 3}, + ] +} diff --git a/website/cue/reference/versions.cue b/website/cue/reference/versions.cue index 35a03f4948505..e4bffd0b453f2 100644 --- a/website/cue/reference/versions.cue +++ b/website/cue/reference/versions.cue @@ -2,6 +2,7 @@ package metadata // This has to be maintained manually because there's currently no way to sort versions programmatically versions: [string, ...string] & [ + "0.51.1", "0.51.0", "0.50.0", "0.49.0", From 234779168c11d74981765196295cbb1400db43c4 Mon Sep 17 00:00:00 2001 From: Thomas Date: Thu, 13 Nov 2025 13:12:13 -0500 Subject: [PATCH 2/2] Delete changelog entries --- .../24188_blackhole_sink_rate_limiting.fix.md | 3 --- changelog.d/config_reload_panic_fix.fix.md | 4 ---- changelog.d/internal_logs_rate_limiting.fix.md | 4 ---- changelog.d/unify_reload_metrics.enhancement.md | 16 ---------------- 4 files changed, 27 deletions(-) delete mode 100644 changelog.d/24188_blackhole_sink_rate_limiting.fix.md delete mode 100644 changelog.d/config_reload_panic_fix.fix.md delete mode 100644 changelog.d/internal_logs_rate_limiting.fix.md delete mode 100644 changelog.d/unify_reload_metrics.enhancement.md diff --git a/changelog.d/24188_blackhole_sink_rate_limiting.fix.md b/changelog.d/24188_blackhole_sink_rate_limiting.fix.md deleted file mode 100644 index 9761dc54bd7a8..0000000000000 --- a/changelog.d/24188_blackhole_sink_rate_limiting.fix.md +++ /dev/null @@ -1,3 +0,0 @@ -The `blackhole` sink's periodic statistics messages (controlled by `print_interval_secs`) are no longer incorrectly suppressed by rate limiting. These informational messages now appear at the user-configured interval as expected. - -authors: pront diff --git a/changelog.d/config_reload_panic_fix.fix.md b/changelog.d/config_reload_panic_fix.fix.md deleted file mode 100644 index 1a39a8af479f1..0000000000000 --- a/changelog.d/config_reload_panic_fix.fix.md +++ /dev/null @@ -1,4 +0,0 @@ -Fixed a panic in the tracing rate limiter when config reload failed. While the panic didn't kill Vector (it was caught by tokio's task -runtime), it could cause unexpected behavior. The rate limiter now gracefully handles events without standard message fields. - -authors: pront diff --git a/changelog.d/internal_logs_rate_limiting.fix.md b/changelog.d/internal_logs_rate_limiting.fix.md deleted file mode 100644 index d6276794bdaf1..0000000000000 --- a/changelog.d/internal_logs_rate_limiting.fix.md +++ /dev/null @@ -1,4 +0,0 @@ -The `internal_logs` source now captures all internal Vector logs without rate limiting. Previously, repeated log messages were silently -dropped. - -authors: pront diff --git a/changelog.d/unify_reload_metrics.enhancement.md b/changelog.d/unify_reload_metrics.enhancement.md deleted file mode 100644 index 7910424e59be8..0000000000000 --- a/changelog.d/unify_reload_metrics.enhancement.md +++ /dev/null @@ -1,16 +0,0 @@ -The `component_errors_total` metric now includes a `reason` tag when `error_code="reload"` to provide more granular information about reload -failures. Possible reasons include: - -- `global_options_changed`: Reload rejected because global options (like `data_dir`) changed -- `global_diff_failed`: Reload rejected because computing global config diff failed -- `topology_build_failed`: Reload rejected because new topology failed to build/healthcheck -- `restore_failed`: Reload failed and could not restore previous config - -Replaced metrics: - -- `config_reload_rejected` was replaced by `component_errors_total` with `error_code="reload"` and a `reason` tag specifying the rejection type -- `config_reloaded` was replaced by the existing `reloaded_total` metric - -Note: The replaced metrics were introduced in v0.50.0 but were never emitted due to a bug. These changes provide consistency across Vector's internal telemetry. - -authors: pront