Skip to content
PMetal

pmetal bench

Benchmark various aspects of PMetal’s performance on your hardware.

Subcommands

Section titled “Subcommands”

bench

Section titled “bench”

Benchmark training throughput (tokens/second, step time).

Terminal window
pmetal bench --model Qwen/Qwen3-0.6B --batch-size 4

bench-gen

Section titled “bench-gen”

Benchmark the generation loop — tokens per second, time to first token, and decode latency.

Terminal window
pmetal bench-gen --model Qwen/Qwen3-0.6B --prompt "Hello" --max-tokens 100

bench-ffi

Section titled “bench-ffi”

Benchmark FFI overhead between Rust and Metal/MLX.

Terminal window
pmetal bench-ffi

See Also

Section titled “See Also”