Measured on-device inference. Every number reproducible; every failure recorded.
hf:distilbert-base-uncased · unknown
not captured
Recipes measured more than once on this unit, in separate sessions. This is the weakest useful form of the check — the real one runs the same recipe on two physical units of the same SKU, and we have one machine. Agreement here cannot catch a defect in the methodology that both runs share; it can only catch drift.
| Recipe | sessions | fastest ms | slowest ms | spread |
|---|---|---|---|---|
| unknown | 10 | 11.37 | 51.66 | 354.19% |
| Recipe | Target | Outcome | p50 ms | cv | size MiB | cosine | FLOP fb (auth) | time fb (run) | partitions |
|---|---|---|---|---|---|---|---|---|---|
| unknown | unknown | success | 11.37 | 0.2% | 64 | 0.9721 | 0.0% | 0.0% | — |
| unknown | unknown | success | 11.47 | 0.2% | 64 | 0.9932 | 0.0% | 0.0% | — |
| unknown | unknown | success | 32.12 | 0.1% | 253 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 32.12 | 0.1% | 253 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 33.38 | 0.2% | 253 | 1.0000 | — | 0.0% | — |
| unknown | unknown | success | 35.58 | 0.2% | 127 | 1.0000 | 99.9% | 100.0% | — |
| unknown | unknown | success | 35.65 | 0.2% | 127 | 1.0000 | 0.0% | 0.0% | — |
| unknown | unknown | success | 36.66 | 0.2% | 253 | 1.0000 | 99.8% | 39.5% | 31 |
| unknown | unknown | success | 39.41 | 1.5% | 253 | 1.0000 | 99.8% | 33.7% | 31 |
| unknown | unknown | success | 51.66 | 0.2% | 253 | 1.0000 | — | 22.0% | 44 |
| unknown | unknown | lowering failure | — | — | — | — | — | — | — |
Kept rather than hidden. A recipe that cannot lower is a fact about the toolchain, and it is what teaches the static filter not to propose it again.
the runtime aborted the process (SIGABRT). This is a delegate-level crash, not a Python exception. Last output: l"(%arg1, %0) <{transpose_lhs = false, transpose_rhs = false}> : (tensor<1x128x1xf32>, tensor<768x768xf32>) -> tensor<1x128x768xf32>
/AppleInternal/Library/BuildRoots/b11baf73-9ee0-11ef-b7b4-7aebe1f78c73/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShadersGraph/mpsgraph/MetalPerformanceShadersGraph/Core/Files/MPSGraphExecutable.mm:975: failed assertion `original module failed verification'# recipe df2313959f80086e is no longer in the library
# recipe 8588cf9c7e9e20c2 is no longer in the library
# recipe ab65f76749412d46 is no longer in the library
# recipe 00ae25442f006d4d is no longer in the library
# recipe 827f297b37c07e7d is no longer in the library
# recipe 43f71aef6bb9368a is no longer in the library
# recipe dadb529bf92590e8 is no longer in the library
# recipe a22de0814e01023f is no longer in the library
# recipe caf34ac5af367332 is no longer in the library
# recipe 2be8528fe729cdb1 is no longer in the library
# recipe c7458371172a0612 is no longer in the library