One more ASAN performance boost #10942

Job	Run time
Release linux x86_64 static	8m 6s
.deb packages / debian:bullseye	12m 31s
.deb packages / ubuntu:24.04	19m 50s
.deb packages / ubuntu:20.04	14m 9s
Windows Build (vcpkg / x64-windows-static)	14m 47s
.deb packages / ubuntu:22.04	19m 17s
.deb packages / debian:bookworm	12m 58s
Windows Build (vcpkg / x86-windows-static)	9m 32s
Windows Build (vcpkg / x64-windows)	8m 4s
Windows Build (vcpkg / x86-windows)	8m 9s
Publish release assets	1s
	2h 7m 24s

Provide feedback