$ python server.py ~/checkpoints/sam2 --benchmark --points-per-batch 128
Benchmark took 1.2052728652954101s per iteration.
max_memory_allocated_bytes: 5068MiB or 12%
$ python server.py ~/checkpoints/sam2 --fast --benchmark --points-per-batch 128
Benchmark took 0.8735793590545654s per iteration.
max_memory_allocated_bytes: 4038MiB or 9%
$ python server.py ~/checkpoints/sam2 --fast --furious --benchmark --points-per-batch 128
Benchmark took 0.21606922149658203s per iteration.
max_memory_allocated_bytes: 2691MiB or 6%
$ python server.py ~/checkpoints/sam2 --fast --furious --benchmark --points-per-batch 1024
Benchmark took 0.194450306892395s per iteration.
max_memory_allocated_bytes: 15369MiB or 37%