Measured on-device inference. Every number reproducible; every failure recorded.
Mac14,2 · Apple M2 · arm64 · 8 cores (4P + 4E) · 16 GiB RAM
macOS 15.2 (build 24C101)
The OS build is part of this device's identity. An OS update changes delegate behaviour, so the same machine on a new build is a new measurement target.
Largest artifact measured here is 5717 MiB against 16 GiB of RAM.
Peak resident memory is recorded per measurement in the table below; it is the child process's own high-water mark, so it is attributable to that recipe alone.
| Model | Recipe | Outcome | p50 ms | peak RSS MiB | size MiB | thermal | probe ratio |
|---|---|---|---|---|---|---|---|
| all-MiniLM-L6-v2 | ort-cpu-int8-dyn | success | 4.46 | 124 | 22 | nominal | 1.10× |
| all-MiniLM-L6-v2 | unknown | success | 4.47 | 124 | 22 | nominal | 1.03× |
| all-MiniLM-L6-v2 | ort-cpu-int8-perchan | success | 4.49 | 124 | 22 | nominal | 1.12× |
| all-MiniLM-L6-v2 | unknown | success | 4.49 | 126 | 22 | nominal | 1.13× |
| all-MiniLM-L6-v2 | ort-cpu-4thread | success | 9.59 | 228 | 86 | nominal | 1.08× |
| all-MiniLM-L6-v2 | ort-cpu-fp32 | success | 9.59 | 228 | 86 | nominal | 0.98× |
| all-MiniLM-L6-v2 | unknown | success | 9.62 | 228 | 86 | nominal | 1.10× |
| all-MiniLM-L6-v2 | unknown | success | 9.90 | 233 | 86 | nominal | 1.10× |
| all-MiniLM-L6-v2 | ort-cpu-dynamic | success | 10.38 | 223 | 86 | nominal | 1.11× |
| all-MiniLM-L6-v2 | unknown | success | 10.38 | 222 | 86 | nominal | 1.10× |
| toxic-comment-model | ort-cpu-int8-dyn | success | 11.35 | 187 | 64 | nominal | 1.09× |
| bart-base | ort-cpu-int8-dyn | success | 11.36 | 216 | 78 | nominal | 1.12× |
| bart-base | unknown | success | 11.37 | 216 | 78 | nominal | 1.14× |
| toxic-comment-model | unknown | success | 11.37 | 188 | 64 | nominal | 1.08× |
| all-MiniLM-L6-v2 | ort-cpu-fp16 | success | 11.37 | 202 | 43 | nominal | 1.09× |
| all-MiniLM-L6-v2 | ort-coreml-fp16 | success | 11.37 | 217 | 43 | nominal | 1.08× |
| distilbert-base-uncased | unknown | success | 11.37 | 187 | 64 | nominal | 1.11× |
| all-MiniLM-L6-v2 | unknown | success | 11.40 | 230 | 43 | nominal | 1.01× |
| toxic-comment-model | ort-cpu-int8-perchan | success | 11.43 | 188 | 64 | nominal | 1.10× |
| bart-base | unknown | success | 11.46 | 218 | 79 | nominal | 1.11× |
| distilbert-base-uncased | unknown | success | 11.47 | 188 | 64 | nominal | 1.12× |
| toxic-comment-model | unknown | success | 11.52 | 188 | 64 | nominal | 1.04× |
| bart-base | ort-cpu-int8-perchan | success | 11.53 | 218 | 79 | nominal | 1.07× |
| all-MiniLM-L6-v2 | unknown | success | 11.73 | 241 | 43 | nominal | 1.10× |
| clip-vit-base-patch32 | ort-cpu-int8-dyn | success | 12.02 | 179 | 84 | nominal | 1.04× |
| clip-vit-base-patch32 | unknown | success | 12.02 | 262 | 84 | nominal | 1.05× |
| clip-vit-base-patch32 | ort-cpu-int8-perchan | success | 12.09 | 180 | 84 | nominal | 1.02× |
| clip-vit-base-patch32 | unknown | success | 12.12 | 181 | 84 | nominal | 1.05× |
| clip-vit-base-patch32 | unknown | success | 18.03 | 642 | 334 | nominal | 1.07× |
| clip-vit-base-patch32 | unknown | success | 18.37 | 612 | 334 | nominal | 0.96× |
| clip-vit-base-patch32 | ort-coreml-fp32 | success | 18.40 | 624 | 334 | nominal | 1.06× |
| all-MiniLM-L6-v2 | ort-coreml-fp32 | success | 18.99 | 630 | 86 | nominal | 1.07× |
| clip-vit-base-patch32 | ort-coreml-ane | success | 20.07 | 592 | 334 | nominal | 1.04× |
| all-MiniLM-L6-v2 | unknown | success | 20.11 | 631 | 86 | nominal | 1.02× |
| all-MiniLM-L6-v2 | ort-coreml-ane | success | 20.16 | 600 | 86 | nominal | 1.15× |
| all-MiniLM-L6-v2 | unknown | success | 20.94 | 598 | 86 | nominal | 0.99× |
| all-MiniLM-L6-v2 | ort-coreml-dynamic | success | 21.44 | 627 | 86 | nominal | 1.00× |
| all-MiniLM-L6-v2 | unknown | success | 21.81 | 626 | 86 | nominal | 0.99× |
| clip-vit-base-patch32 | ort-cpu-4thread | success | 28.29 | 436 | 334 | nominal | 1.05× |
| clip-vit-base-patch32 | ort-cpu-fp32 | success | 28.32 | 436 | 334 | nominal | 0.89× |
| clip-vit-base-patch32 | unknown | success | 28.35 | 436 | 334 | nominal | 1.12× |
| clip-vit-base-patch32 | unknown | success | 28.35 | 436 | 334 | nominal | 0.99× |
| clip-vit-base-patch32 | ort-cpu-dynamic | success | 28.52 | 434 | 334 | nominal | 1.04× |
| clip-vit-base-patch32 | unknown | success | 28.60 | 474 | 334 | nominal | 1.12× |
| bart-base | ort-cpu-fp32 | success | 31.96 | 682 | 313 | nominal | 1.06× |
| toxic-comment-model | ort-cpu-fp32 | success | 31.97 | 492 | 255 | nominal | 1.06× |
| bart-base | ort-cpu-4thread | success | 32.00 | 681 | 313 | nominal | 1.08× |
| toxic-comment-model | unknown | success | 32.00 | 491 | 255 | nominal | 1.12× |
| toxic-comment-model | ort-cpu-4thread | success | 32.00 | 491 | 255 | nominal | 1.09× |
| bart-base | unknown | success | 32.05 | 681 | 313 | nominal | 1.14× |
| toxic-comment-model | unknown | success | 32.09 | 490 | 255 | nominal | 1.14× |
| bart-base | unknown | success | 32.11 | 681 | 313 | nominal | 1.03× |
| distilbert-base-uncased | unknown | success | 32.12 | 488 | 253 | nominal | 1.14× |
| distilbert-base-uncased | unknown | success | 32.12 | 488 | 253 | nominal | 1.00× |
| bart-base | unknown | success | 33.07 | 681 | 313 | nominal | 1.10× |
| bart-base | ort-cpu-dynamic | success | 33.10 | 681 | 313 | nominal | 1.05× |
| toxic-comment-model | ort-cpu-dynamic | success | 33.16 | 491 | 256 | nominal | 1.12× |
| toxic-comment-model | unknown | success | 33.37 | 491 | 256 | nominal | 1.13× |
| distilbert-base-uncased | unknown | success | 33.38 | 488 | 253 | nominal | 1.01× |
| toxic-comment-model | ort-coreml-fp16 | success | 35.50 | 470 | 128 | nominal | 1.14× |
| toxic-comment-model | unknown | success | 35.54 | 523 | 128 | nominal | 1.12× |
| toxic-comment-model | ort-cpu-fp16 | success | 35.55 | 498 | 128 | nominal | 1.10× |
| distilbert-base-uncased | unknown | success | 35.58 | 494 | 127 | nominal | 1.02× |
| toxic-comment-model | unknown | success | 35.65 | 495 | 128 | nominal | 1.04× |
| distilbert-base-uncased | unknown | success | 35.65 | 518 | 127 | nominal | 1.00× |
| distilbert-base-uncased | unknown | success | 36.66 | 1174 | 253 | nominal | 0.97× |
| toxic-comment-model | ort-coreml-ane | success | 37.92 | 1183 | 255 | nominal | 1.01× |
| toxic-comment-model | ort-coreml-fp32 | success | 38.45 | 1185 | 255 | nominal | 1.06× |
| bart-base | ort-coreml-fp32 | success | 38.68 | 1582 | 313 | nominal | 1.05× |
| bart-base | unknown | success | 38.97 | 1620 | 313 | nominal | 1.13× |
| distilbert-base-uncased | unknown | success | 39.41 | 1177 | 253 | nominal | 1.14× |
| toxic-comment-model | unknown | success | 39.51 | 1186 | 255 | nominal | 1.10× |
| toxic-comment-model | unknown | success | 41.23 | 1184 | 255 | nominal | 1.14× |
| bart-base | unknown | success | 41.53 | 1583 | 313 | nominal | 1.02× |
| vit-base-patch16-224-in21k | ort-cpu-int8-dyn | success | 42.70 | 200 | 83 | nominal | 1.11× |
| vit-base-patch16-224-in21k | unknown | success | 42.84 | 200 | 83 | nominal | 1.09× |
| vit-base-patch16-224-in21k | ort-cpu-int8-perchan | success | 43.04 | 200 | 83 | nominal | 1.07× |
| vit-base-patch16-224-in21k | unknown | success | 43.11 | 200 | 83 | nominal | 1.09× |
| clip-vit-base-patch32 | ort-coreml-dynamic | success | 45.84 | 688 | 334 | nominal | 1.08× |
| clip-vit-base-patch32 | unknown | success | 46.24 | 680 | 334 | nominal | 1.01× |
| bart-base | ort-coreml-ane | success | 46.43 | 1580 | 313 | nominal | 1.09× |
| distilbert-base-uncased | unknown | success | 51.66 | 1308 | 253 | nominal | 0.97× |
| toxic-comment-model | ort-coreml-dynamic | success | 51.75 | 1316 | 256 | nominal | 1.07× |
| bart-base | unknown | success | 53.42 | 1581 | 313 | nominal | 1.00× |
| toxic-comment-model | unknown | success | 53.93 | 1267 | 256 | nominal | 1.06× |
| bart-base | ort-coreml-dynamic | success | 58.02 | 1581 | 313 | nominal | 0.91× |
| vit-base-patch16-224-in21k | unknown | success | 71.54 | 671 | 327 | nominal | 1.00× |
| vit-base-patch16-224-in21k | ort-coreml-ane | success | 71.90 | 686 | 327 | nominal | 1.02× |
| vit-base-patch16-224-in21k | ort-coreml-fp32 | success | 73.60 | 670 | 327 | nominal | 1.07× |
| vit-base-patch16-224-in21k | unknown | success | 75.63 | 604 | 327 | nominal | 1.13× |
| vit-base-patch16-224-in21k | ort-cpu-dynamic | success | 104.59 | 432 | 327 | nominal | 1.03× |
| vit-base-patch16-224-in21k | ort-cpu-fp32 | success | 104.77 | 445 | 327 | nominal | 1.07× |
| vit-base-patch16-224-in21k | ort-cpu-4thread | success | 104.80 | 445 | 327 | nominal | 1.03× |
| vit-base-patch16-224-in21k | unknown | success | 105.53 | 465 | 327 | nominal | 0.92× |
| vit-base-patch16-224-in21k | unknown | success | 105.67 | 444 | 327 | nominal | 1.07× |
| vit-base-patch16-224-in21k | unknown | success | 105.87 | 431 | 327 | nominal | 1.02× |
| vit-base-patch16-224-in21k | ort-coreml-fp16 | success | 109.80 | 772 | 164 | nominal | 1.08× |
| vit-base-patch16-224-in21k | ort-cpu-fp16 | success | 109.80 | 771 | 164 | nominal | 1.08× |
| vit-base-patch16-224-in21k | unknown | success | 110.14 | 720 | 164 | nominal | 1.00× |
| vit-base-patch16-224-in21k | unknown | success | 110.42 | 749 | 164 | nominal | 1.01× |
| Llama-3.2-1B-Instruct | unknown | success | — | 5810 | 5717 | nominal | 1.14× |
| Llama-3.2-1B-Instruct | ort-cpu-dynamic | success | — | 5810 | 5717 | nominal | 0.85× |
| vit-base-patch16-224-in21k | unknown | success | 179.36 | 969 | 327 | nominal | 0.90× |
| vit-base-patch16-224-in21k | ort-coreml-dynamic | success | 181.08 | 956 | 327 | nominal | 1.06× |
| Llama-3.2-1B-Instruct | unknown | success | — | 8000 | 5717 | nominal | 1.00× |
| Llama-3.2-1B-Instruct | ort-coreml-dynamic | success | — | 7253 | 5717 | nominal | 1.03× |
| distilbert-base-uncased | unknown | lowering failure | — | — | — | nominal | 0.99× |
| bart-base | unknown | lowering failure | — | — | 156 | nominal | 1.04× |
| bart-base | ort-coreml-fp16 | lowering failure | — | — | 156 | nominal | 1.03× |
| bart-base | unknown | lowering failure | — | — | — | nominal | 1.15× |
| bart-base | ort-coreml-mlprogram | lowering failure | — | — | — | nominal | 1.07× |
| bart-base | ort-cpu-fp16 | lowering failure | — | — | 156 | nominal | 1.05× |
| bart-base | unknown | lowering failure | — | — | 156 | nominal | 1.12× |
| vit-base-patch16-224-in21k | ort-coreml-mlprogram | lowering failure | — | — | 327 | nominal | 0.99× |
| vit-base-patch16-224-in21k | unknown | lowering failure | — | — | 327 | nominal | 1.04× |
| toxic-comment-model | unknown | lowering failure | — | — | — | nominal | 1.13× |
| toxic-comment-model | ort-coreml-mlprogram | lowering failure | — | — | — | nominal | 1.07× |
| clip-vit-base-patch32 | ort-coreml-mlprogram | lowering failure | — | — | 334 | nominal | 1.08× |
| clip-vit-base-patch32 | ort-coreml-fp16 | lowering failure | — | — | 167 | nominal | 1.08× |
| clip-vit-base-patch32 | ort-cpu-fp16 | lowering failure | — | — | 167 | nominal | 1.05× |
| clip-vit-base-patch32 | unknown | lowering failure | — | — | 167 | nominal | 1.01× |
| clip-vit-base-patch32 | unknown | lowering failure | — | — | 167 | nominal | 1.10× |
| clip-vit-base-patch32 | unknown | lowering failure | — | — | 334 | nominal | 1.05× |
| all-MiniLM-L6-v2 | unknown | lowering failure | — | — | — | nominal | 1.06× |
| all-MiniLM-L6-v2 | ort-coreml-mlprogram | lowering failure | — | — | — | nominal | 1.07× |