Measured on-device inference. Every number reproducible; every failure recorded.
hf:google/vit-base-patch16-224-in21k · vision
85.8M graph parameters (as exported) · 1013 graph nodes · attention: mha · norm: layernorm
Constant×324, Add×121, Unsqueeze×103, MatMul×96, Concat×52, Reshape×51, Mul×50, Transpose×49
Graph size by weight dtype: fp32 632 nodes, fp16 634 nodes, int8 902 nodes, fp32 1013 nodes. Quantization inserts quantize/dequantize pairs, so the node count grows even as the artifact shrinks.
Recipes measured more than once on this unit, in separate sessions. This is the weakest useful form of the check — the real one runs the same recipe on two physical units of the same SKU, and we have one machine. Agreement here cannot catch a defect in the methodology that both runs share; it can only catch drift.
| Recipe | sessions | fastest ms | slowest ms | spread |
|---|---|---|---|---|
| unknown · sm8650 | 2 | 7.68 | 7.73 | 0.64% |
| ALL · sm8650 | 2 | 6.72 | 56.17 | 735.23% |
| unknown · Apple M2 | 10 | 42.84 | 179.36 | 318.70% |
| unknown · sm8650 | 2 | 7.68 | 267.62 | 3384.58% |
| ALL · google-tensor-g4 | 3 | 146.70 | 308.80 | 110.50% |
| Recipe | Target | Outcome | p50 ms | cv | size MiB | cosine | FLOP fb (auth) | time fb (run) | partitions |
|---|---|---|---|---|---|---|---|---|---|
| ALL | ALL | success | 4.42 | 1.3% | — | — | — | 0.0% | — |
| ALL | ALL | success | 6.26 | 1.6% | — | — | — | 0.0% | — |
| unknown | unknown | success | 6.26 | 1.5% | — | — | — | 0.0% | — |
| ALL | ALL | success | 6.72 | 0.6% | — | — | — | 0.0% | — |
| unknown | unknown | success | 7.68 | 0.4% | — | — | — | 0.0% | — |
| unknown | unknown | success | 7.68 | 0.7% | — | — | — | 0.0% | — |
| ALL | ALL | success | 7.68 | 0.5% | — | — | — | 0.0% | — |
| unknown | unknown | success | 7.73 | 0.5% | — | — | — | 0.0% | — |
| unknown | unknown | success | 7.75 | 0.5% | — | — | — | 0.0% | — |
| ALL | ALL | success | 10.70 | 0.8% | — | — | — | 0.0% | — |
| unknown | unknown | success | 10.94 | 0.9% | — | — | — | 0.0% | — |
| unknown | unknown | success | 10.94 | 0.9% | — | — | — | 0.0% | — |
| ALL | ALL | success | 11.01 | 1.2% | — | — | — | 0.0% | — |
| ALL | ALL | success | 11.51 | 3.3% | — | — | — | 0.0% | — |
| ALL | ALL | success | 13.75 | 2.9% | — | — | — | 0.0% | — |
| ALL | ALL | success | 16.72 | 1.5% | — | — | — | 0.0% | — |
| ALL | ALL | success | 17.28 | 2.2% | — | — | — | 0.0% | — |
| ort-cpu-int8-dyn | CPU | success | 42.70 | 0.2% | 83 | 0.9842 | 0.0% | 0.0% | — |
| unknown | unknown | success | 42.84 | 0.1% | 83 | 0.9842 | 0.0% | 0.0% | — |
| ort-cpu-int8-perchan | CPU | success | 43.04 | 0.2% | 83 | 0.9945 | 0.0% | 0.0% | — |
| unknown | unknown | success | 43.11 | 0.1% | 83 | 0.9945 | 0.0% | 0.0% | — |
| ALL | ALL | success | 56.17 | 0.4% | — | — | — | 0.0% | — |
| unknown | unknown | success | 71.54 | 2.5% | 327 | 1.0000 | 99.1% | 20.4% | 62 |
| ort-coreml-ane | CoreML | success | 71.90 | 2.8% | 327 | 1.0000 | 99.1% | 21.9% | 62 |
| ort-coreml-fp32 | CoreML | success | 73.60 | 1.6% | 327 | 1.0000 | 99.1% | 22.8% | 62 |
| unknown | unknown | success | 75.63 | 3.7% | 327 | 1.0000 | 99.1% | 24.4% | 62 |
| ort-cpu-dynamic | CPU | success | 104.59 | 0.4% | 327 | 1.0000 | — | 0.0% | — |
| ort-cpu-fp32 | CPU | success | 104.77 | 0.1% | 327 | 1.0000 | 0.0% | 0.0% | — |
| ort-cpu-4thread | CPU | success | 104.80 | 0.3% | 327 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 105.53 | 0.1% | 327 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 105.67 | 0.1% | 327 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 105.87 | 0.1% | 327 | 1.0000 | — | 0.0% | — |
| ort-coreml-fp16 | CoreML | success | 109.80 | 0.2% | 164 | 1.0000 | 99.9% | 100.0% | — |
| ort-cpu-fp16 | CPU | success | 109.80 | 0.1% | 164 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 110.14 | 0.1% | 164 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 110.42 | 0.1% | 164 | 1.0000 | 99.9% | 100.0% | — |
| ALL | ALL | success | 146.70 | 9.6% | — | — | — | 94.8% | — |
| unknown | unknown | success | 179.36 | 0.9% | 327 | 1.0000 | — | 46.2% | 86 |
| ort-coreml-dynamic | CoreML | success | 181.08 | 0.5% | 327 | 1.0000 | — | 46.9% | 86 |
| ALL | ALL | success | 264.26 | 4.6% | — | — | — | 100.0% | — |
| unknown | unknown | success | 267.62 | 9.7% | — | — | — | 0.0% | — |
| unknown | unknown | success | 303.76 | 2.9% | — | — | — | 100.0% | — |
| ALL | ALL | success | 306.09 | 9.0% | — | — | — | 100.0% | — |
| ALL | ALL | success | 308.80 | 5.2% | — | — | — | 100.0% | — |
| unknown | unknown | success | 328.49 | 18.5% | — | — | — | 100.0% | — |
| unknown | unknown | success | 351.44 | 6.1% | — | — | — | 100.0% | — |
| ALL | ALL | success | 354.83 | 0.6% | — | — | — | 100.0% | — |
| unknown | unknown | success | 380.07 | 6.7% | — | — | — | 100.0% | — |
| ALL | ALL | success | 390.35 | 9.8% | — | — | — | 100.0% | — |
| unknown | unknown | success | 444.12 | 16.4% | — | — | — | 100.0% | — |
| ALL | ALL | success | 463.10 | 7.5% | — | — | — | 100.0% | — |
| ALL | ALL | success | 465.26 | 4.8% | — | — | — | 100.0% | — |
| ALL | ALL | success | 708.96 | 0.5% | — | — | — | 100.0% | — |
| unknown | unknown | success | 750.98 | 2.2% | — | — | — | 100.0% | — |
| unknown | unknown | success | 780.79 | 2.1% | — | — | — | 100.0% | — |
| unknown | unknown | success | 820.37 | 4.2% | — | — | — | 100.0% | — |
| ALL | ALL | success | 894.80 | 6.3% | — | — | — | 100.0% | — |
| ALL | ALL | success | 987.58 | 12.1% | — | — | — | 100.0% | — |
| ort-coreml-mlprogram | CoreML | lowering failure | — | — | 327 | — | — | — | — |
| unknown | unknown | lowering failure | — | — | 327 | — | — | — | — |
Kept rather than hidden. A recipe that cannot lower is a fact about the toolchain, and it is what teaches the static filter not to propose it again.
session creation failed: [ONNXRuntimeError] : 1 : FAIL : Failed to create MLModel, error: Failed to build the model execution plan using a model architecture file '/private/var/folders/g4/qr8j7fw12hv68l1g1pyv13t40000gn/T/onnxruntime-B179AF2A-DE7B-4C2D-B6F2-A7B06936E9F5-72551-000001D812654D61.mlmodelc/model.mil' with error code: -7.
session creation failed: [ONNXRuntimeError] : 1 : FAIL : Failed to create MLModel, error: Failed to build the model execution plan using a model architecture file '/private/var/folders/g4/qr8j7fw12hv68l1g1pyv13t40000gn/T/onnxruntime-F76607A2-1516-4C94-9800-6C0B9DC1DC25-26589-0000003B2F81E921.mlmodelc/model.mil' with error code: -7.
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Snapdragon X2 Elite CRD" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Snapdragon 8 Elite QRD" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Snapdragon 8 Elite QRD" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24 (Family)" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24 (Family)" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24+" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24 Ultra" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Snapdragon X Plus 8-Core CRD" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S23" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S23 Ultra" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S23" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Snapdragon X Elite CRD" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "SA8775P ADP" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "SA8295P ADP" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Dragonwing IQ-9075 EVK" --compute-unit all
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_cpu_int8_dynamic.yaml
# recipe c77ebc6856100da6 is no longer in the library
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_cpu_int8_perchannel.yaml
# recipe c7282d73d5b0c996 is no longer in the library
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24 (Family)" --compute-unit all
# recipe 229ec344c452b098 is no longer in the library
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_coreml_ane.yaml
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_coreml_fp32.yaml
# recipe 5d7949732ada84a4 is no longer in the library
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_cpu_dynamic.yaml
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_cpu_fp32.yaml
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_cpu_4thread.yaml
# recipe 6d549e6069d0883f is no longer in the library
# recipe b6fda8be500c01da is no longer in the library
# recipe 5195071c42cf5b4a is no longer in the library
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_coreml_fp16.yaml
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_cpu_fp16.yaml
# recipe 30bf417fcb4ac0aa is no longer in the library
# recipe f49f992bae98c992 is no longer in the library
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 9" --compute-unit all
# recipe 4607718be4410e77 is no longer in the library
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_coreml_dynamic.yaml
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 10" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S24 (Family)" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 9" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 9" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 9" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 7" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy Note 20 (Intl)" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Snapdragon 7 Gen 4 QRD" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy S21" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy A73 5G" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 8" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy Tab S7" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 4" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Dragonwing RB3 Gen 2 Vision Kit" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 5" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy A53 5G" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Google Pixel 3" --compute-unit unknown
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Xiaomi Redmi Note 10 5G" --compute-unit all
uv run edgefit measure-remote --model hf:google/vit-base-patch16-224-in21k --device "Samsung Galaxy A14 5G" --compute-unit all
uv run edgefit measure --model hf:google/vit-base-patch16-224-in21k --recipe recipes/ort_coreml_mlprogram.yaml
# recipe f89aae4d09e71940 is no longer in the library