Do not depend on CPU lottery for testing AVX3 #14012

Job	Run time
Warmup caches	28s
CfB AVX3	1m 52s
CfB SSE4	1m 51s
CfB EMU128	1m 49s
CfB SVE2_128	1m 48s
CfB NEON_WITHOUT_AES	1m 49s
CfB SCALAR_ASAN	1m 53s
CfB AVX2	1m 53s
CfB SVE2	1m 48s
CfB SSSE3	1m 49s
CfB SVE	1m 49s
CfB SCALAR	1m 50s
CfT ${{ matrix.name }} / ${{ matrix.target }}	1s
	20m 40s

Provide feedback