Closed
Description
What happened?
Upgraded cri-o from 1.25 to 1.26, and observed that container_network_receive_bytes_total per-pod metric (and perhaps others) has disappeared.
What did you expect to happen?
Expected this metric to be present after the upgrade.
How can we reproduce it (as minimally and precisely as possible)?
Have a 1.26 kubernetes cluster with cri-o-1.26, and check that kubelet/cadvisor does not provide metrics container_network_receive_bytes_total for each container.
Anything else we need to know?
No response
CRI-O and Kubernetes version
# crio --version
crio version 1.26.1
Version: 1.26.1
GitCommit: 36d50b214b422753e9b33cc1b04e8b9de9e20419
GitCommitDate: 2023-02-09T06:17:48Z
GitTreeState: clean
BuildDate: 2023-02-09T06:14:46Z
GoVersion: go1.19.5
Compiler: gc
Platform: linux/arm64
Linkmode: dynamic
BuildTags:
containers_image_ostree_stub
apparmor
exclude_graphdriver_btrfs
btrfs_noversion
exclude_graphdriver_devicemapper
libdm_no_deferred_remove
containers_image_openpgp
seccomp
selinux
LDFlags: -s -w -X github.com/cri-o/cri-o/internal/pkg/criocli.DefaultsPath="" -X github.com/cri-o/cri-o/internal/version.buildDate=2023-02-09T06:14:46Z
SeccompEnabled: true
AppArmorEnabled: false
Dependencies:
$ kubectl version
WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short. Use --output=yaml|json to get the full version.
Client Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.0", GitCommit:"b46a3f887ca979b1a5d14fd39cb1af43e7e5d12d", GitTreeState:"clean", BuildDate:"2022-12-08T19:58:30Z", GoVersion:"go1.19.4", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.1", GitCommit:"8f94681cd294aa8cfd3407b8191f6c70214973a4", GitTreeState:"clean", BuildDate:"2023-01-18T15:51:25Z", GoVersion:"go1.19.5", Compiler:"gc", Platform:"linux/arm64"}OS version
# cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
# uname -a
Linux k8s-node04 5.15.94 #2 SMP Wed Feb 15 10:30:15 UTC 2023 aarch64 GNU/LinuxAdditional environment details (AWS, VirtualBox, physical, etc.)
Bare metal.