Xyntetik xyntetik

Evidence

Fidelity index

Every GGUF file Runner has scored against its publisher's reference weights, one row per measurement, pass or fail. A row reads one file against the reference checkpoint at the revision named, over the window named; the verdict is the bar of the fidelity method, mean KLD at most 0.05 and margin-qualified top-1 at least 97%, which was set over 2,000 positions, so a row over fewer positions is a smaller sample read against the same numbers. Failing rows come first. A side whose report does not say which file it scored is listed as not identified rather than left out.

269 measured sides in 181 reports: 140 pass, 129 fail; the files of 121 are not identified. Method: fidelity-method.md.

verdictfilereferencepositionsmean KLDmargin-qualified top-1top-1read withreport
failfile not identified (the report calls it lfm)LiquidAI/LFM2.5-350M at 9e6c6ccf47cd (local checkout)3000.924361.1%53.0%an HTTP endpointlfm2.5-reference-2026-10-30/runner-vs-llamacpp-350m-q4_k_m.json#b
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-350M at 9e6c6ccf47cd (local checkout)3000.874461.9%54.3%runner --scorelfm2.5-reference-2026-10-30/gold-logits-350m-q8-q4.json#b
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-350M at 9e6c6ccf47cd (local checkout)3000.874461.9%54.3%runner --scorelfm2.5-reference-2026-10-30/runner-vs-llamacpp-350m-q4_k_m.json#a
failISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF: Qwen3.8-27B-GSQ-RCO-IQ3_S.ggufQwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c03000.561682.5%74.3%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/r432-gold-house.json#a
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-350M-GGUF qad/ at 657e078c9408 (local checkout)3000.527574.2%63.0%runner --scorelfm2.5-reference-2026-10-30/qad-q4_0-350m-against-its-own-parent.json#a
failfile not identified (the report calls it lfm)LiquidAI/LFM2.5-350M at 9e6c6ccf47cd (local checkout)3000.523674.8%65.0%an HTTP endpointlfm2.5-reference-2026-10-30/qad-q4_0-350m-runner-vs-llamacpp.json#b
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-350M at 9e6c6ccf47cd (local checkout)3000.483176.5%67.7%runner --scorelfm2.5-reference-2026-10-30/qad-q4_0-350m-runner-vs-llamacpp.json#a
failISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF: Qwen3.8-27B-GSQ-RCO-IQ3_S.ggufQwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c020000.471886.4%80.8%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/r432-gold-d1window.json#a
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-350M-GGUF qad/ at 657e078c9408 (local checkout)3000.457481.7%69.7%runner --scorelfm2.5-reference-2026-10-30/qad-q4_0-350m-against-its-own-parent.json#b
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.437481.1%74.4%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-realistic.json#a
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.437381.1%74.4%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-realistic-float32.json#a
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.433781.2%74.7%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-realistic.json#b
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.433681.2%74.7%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-realistic-float32.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c03000.411985.0%77.7%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/bf16diag-gold-house.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c03000.411985.0%77.7%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/r432-gold-house.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c020000.408486.1%80.4%runner --scorer3.6.3.1-cuda-attn-tc-wide-qwen35-2026-11-04/gold-tcw0-vs-tcw1.json#a
failfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c020000.408486.1%80.4%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/bf16diag-gold-d1window.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c020000.408486.1%80.4%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/r432-gold-d1window.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c020000.408386.1%80.5%runner --scorer3.6.3.1-cuda-attn-tc-wide-qwen35-2026-11-04/gold-tcw0-vs-tcw1.json#b
failfile not identified (the report calls it score file)Accio-Lab/occamy-1.0@72ca96033000.257885.7%77.0%runner --scoreoccamy-1.0-2026-11-06/gold-q4_k_m.json#a
failfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.252484.3%72.3%runner --scorenemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-bf16-q8_0-runner-configured-floor.json#b
failmradermacher/Hemmingway-1-GGUF: Hemmingway-1.Q4_K_M.ggufHemmingwayAI/Hemmingway-1@faba5746970520000.248291.6%84.5%runner --scorehemmingway-reference-2026-11-01/h1-gold-logits-cpu-q4_k_m-cuda-q4_k_m.json#b
failmradermacher/Hemmingway-1-GGUF: Hemmingway-1.Q4_K_M.ggufHemmingwayAI/Hemmingway-1@faba5746970520000.248291.6%84.5%runner --scorehemmingway-reference-2026-11-01/h1-gold-logits-cuda-q4_k_m-cpu-q8_0.json#a
failmradermacher/Hemmingway-1-GGUF: Hemmingway-1.Q4_K_M.ggufHemmingwayAI/Hemmingway-1@faba5746970520000.248091.7%84.5%runner --scorehemmingway-reference-2026-11-01/h1-gold-logits-cpu-q4_k_m-cuda-q4_k_m.json#a
failfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.246284.8%74.0%runner --scorenemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-bf16-q8_0-runner-configured-floor.json#a
failfile not identified (the report calls it score file)Qwen/Qwen3.5-4B at 851bf6e806ef (local copy)20000.239988.5%78.8%runner --scorecuda-nvfp4-tc-2026-10-31/gold-logits-default-vs-tc.json#a
failfile not identified (the report calls it score file)Qwen/Qwen3.5-4B at 851bf6e806ef (local copy)20000.239888.5%78.8%runner --scorecuda-nvfp4-tc-2026-10-31/gold-logits-default-vs-tc.json#b
failLiquidAI/LFM2.5-8B-A1B-GGUF: LFM2.5-8B-A1B-Q4_K_M.gguf (sha256 4923ec14f06b)LiquidAI/LFM2.5-8B-A1B at 5dd22602c2e9 (local copy)3000.237285.4%75.3%runner --scorelfm2.5-8b-a1b-reference-2026-10-30/gold-logits-8b-a1b-q8-q4.json#b
failbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.207189.1%79.8%an HTTP endpointphi-3.5-mini-instruct-2026-11-13/gold-q8_0-w1-llama-c8192.json#b
failbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.205288.5%79.0%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q8_0-w1-c8192.json#a
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q4_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.202389.4%79.3%an HTTP endpointdeepseek-v2-lite-chat-2026-11-04/gold-q4_k_m-cuda-vs-llamacpp.json#b
failIFM/K2-Horizon-0.9B-GGUF: K2-Horizon-1B-Q4_K_M.gguf (sha256 78bff592aeba)IFM/K2-Horizon-0.9B@d50881f4f8dc3000.195188.8%74.0%an HTTP endpointk2-horizon-0.9b-reference-2026-10-30/gold-logits-llamacpp-q4_k_m-text.json#a
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q4_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.188490.3%81.3%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q4_k_m-cpu-vs-cuda.json#a
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q4_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.187690.3%81.7%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q4_k_m-cpu-vs-cuda.json#b
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q4_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.187690.3%81.7%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q4_k_m-cuda-vs-llamacpp.json#a
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.172890.6%83.8%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-unsloth-q4km-q5km.json#a
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.172890.6%83.7%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-unsloth-q4km-q5km-float32.json#a
failfile not identified (the report calls it score file)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.170992.1%83.7%runner --scoreornith-1.5-35b-a3b-2026-11-05/gold-q4_k_m.json#a
failColby/apertus-v1.5-8b-text-Q4_K_M-GGUF: apertus-v1.5-8b-text-q4_k_m.gguf (sha256 a037df8d87ff)swiss-ai/Apertus-v1.5-8B@1519de0a3000.168691.7%79.0%runner --scoreapertus-v1.5-8b-text-2026-11-13/gold-q4_k_m-w2.json#a
failColby/apertus-v1.5-8b-text-Q4_K_M-GGUF: apertus-v1.5-8b-text-q4_k_m.gguf (sha256 a037df8d87ff)swiss-ai/Apertus-v1.5-8B@1519de0a3000.162987.7%75.3%runner --scoreapertus-v1.5-8b-text-2026-11-13/gold-q4_k_m-w1.json#a
failggml-org/Qwen3.6-27B-GGUF: Qwen3.6-27B-Q4_K_M.ggufQwen/Qwen3.6-27B@6a9e13bd6fc8f0983b9b99948120bc37f49c13e93000.153993.8%87.0%an HTTP endpointqwen3.6-27b-2026-11-04/gold-logits-q4_k_m-runner-vs-llamacpp.json#b
failibm-granite/granite-4.2-30b-GGUF: granite-4.2-30b-Q4_K_M.ggufibm-granite/granite-4.2-30b@9e668ce1c538387ef24d3644e9b06066477626363000.151292.5%80.7%an HTTP endpointgranite-4.2-30b-2026-11-04/gold-logits-q4_k_m-runner-vs-llamacpp.json#b
failfile not identified (the report calls it score file)InternScience/Sage-A1.5@0e3205cf3000.144592.5%84.3%runner --scoresage-a1.5-2026-11-06/gold-q4_k_m.json#a
failLiquidAI/LFM2.5-24B-A2B-GGUF: LFM2.5-24B-A2B-Q4_K_M.gguf (sha256 d3334405b962)LiquidAI/LFM2.5-24B-A2B at 3fcfdbfa1a1b (local copy)3000.144190.5%84.0%runner --scorelfm2.5-24b-a2b-reference-2026-10-30/gold-logits-24b-a2b-q8-q4.json#b
failfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16@49843eed8db1f1c616c47af75cfd36e07aec066720000.142793.5%87.6%runner --scorer3.6.3.1-cuda-attn-tc-wide-2026-11-03/gold-main-vs-r3631.json#a
failfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16@49843eed8db1f1c616c47af75cfd36e07aec066720000.142293.4%87.6%runner --scorer3.6.3.1-cuda-attn-tc-wide-2026-11-03/gold-main-vs-r3631.json#b
failibm-granite/granite-4.2-30b-GGUF: granite-4.2-30b-Q4_K_M.ggufibm-granite/granite-4.2-30b@9e668ce1c538387ef24d3644e9b06066477626363000.139393.9%83.0%runner --scoregranite-4.2-30b-2026-11-04/gold-logits-q4_k_m-runner-vs-llamacpp.json#a
failggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF: NVIDIA-Nemotron-3-Nano-30B-A3B-Q4_K_M.gguf (sha256 0f111a0d4977)nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16@bf77c3173000.136694.5%82.7%runner --scorenemotron-3-nano-30b-a3b-2026-11-05/gold-q4_k_m-configured.json#a
failfile not identified (the report calls it lfm)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local checkout)3000.132293.0%82.3%an HTTP endpointlfm2.5-reference-2026-10-30/qad-q4_0-1.2b-runner-vs-llamacpp.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3-4B at 1cfa9a720891 (local copy)20000.131292.0%83.8%runner --scorecpu-kquant-one-accumulator-chunked-2026-10-31/gold-logits-pre-vs-commit.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3-4B at 1cfa9a720891 (local copy)20000.131292.0%83.8%runner --scorecpu-kquant-one-accumulator-chunked-2026-10-31/gold-logits-pre-vs-main.json#b
failfile not identified (the report calls it score file)Qwen/Qwen3-4B at 1cfa9a720891 (local copy)20000.131292.0%83.8%runner --scorecpu-kquant-one-accumulator-chunked-2026-10-31/gold-logits-pre-vs-commit.json#a
failfile not identified (the report calls it score file)Qwen/Qwen3-4B at 1cfa9a720891 (local copy)20000.131292.0%83.8%runner --scorecpu-kquant-one-accumulator-chunked-2026-10-31/gold-logits-pre-vs-main.json#a
failggml-org/Qwen3.6-27B-GGUF: Qwen3.6-27B-Q4_K_M.ggufQwen/Qwen3.6-27B@6a9e13bd6fc8f0983b9b99948120bc37f49c13e93000.128895.9%89.3%runner --scoreqwen3.6-27b-2026-11-04/gold-logits-q4_k_m-runner-vs-llamacpp.json#a
failIFM/K2-Horizon-7B-GGUF: K2-Horizon-7B-Q4_K_M.gguf (sha256 eb89c15a0ae9)IFM/K2-Horizon-7B@4622f94a66323000.128495.3%82.7%an HTTP endpointk2-horizon-7b-reference-2026-10-30/gold-logits-llamacpp-q4_k_m-text.json#a
failIFM/K2-Horizon-7B-GGUF: K2-Horizon-7B-Q4_K_M.gguf (sha256 eb89c15a0ae9)IFM/K2-Horizon-7B@4622f94a66323000.128495.3%82.7%an HTTP endpointk2-horizon-7b-reference-2026-10-30/gold-logits-llamacpp-q4_k_m.json#a
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local checkout)3000.128293.4%84.0%runner --scorelfm2.5-reference-2026-10-30/qad-q4_0-1.2b-runner-vs-llamacpp.json#a
failfile not identified (the report calls it score file)empero-ai/Qwen3.8-35B-A3B-Distill@bcc2dbe23000.127894.6%85.0%runner --scoreempero-qwen3.8-35b-a3b-distill-2026-11-06/gold-q4_k_m.json#a
failHuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF: smollm2-1.7b-instruct-q4_k_m.ggufHuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e3000.124892.3%85.0%an HTTP endpointsmollm2-2026-11-13/gold-1.7b-publisher-q4_k_m-w1-runner-vs-llamacpp.json#b
failXHToken/Spark-X2.6-4B-GGUF: Spark-X2.6-4B-Q4_K_M.ggufXHToken/Spark-X2.6-4B@d1b5f2603000.123291.5%85.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.6-q4_k_m-text.json#a
failXHToken/Spark-X2.6-4B-GGUF: Spark-X2.6-4B-Q4_K_M.ggufXHToken/Spark-X2.6-4B@d1b5f2603000.123291.5%85.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.6-q4_k_m.json#a
failIFM/K2-Horizon-7B-GGUF: K2-Horizon-7B-Q4_K_M.gguf (sha256 eb89c15a0ae9)IFM/K2-Horizon-7B at 4622f94a (local checkout)3000.122595.8%84.3%runner --scorek2-horizon-7b-reference-2026-10-30/gold-logits-cpu-q8-q4.json#b
failopenbmb/MiniCPM5-2B-GGUF: MiniCPM5-2B-Q4_K_M.gguf (sha256 ec2d58016400)openbmb/MiniCPM5-2B@f97400052a433000.119994.1%86.0%an HTTP endpointminicpm5-2b-reference-2026-10-29/gold-logits-llamacpp-q4_k_m-text.json#a
failfile not identified (the report calls it Ornith-1.5-35B-Q6_K)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.119193.8%86.0%an HTTP endpointornith-1.5-35b-a3b-2026-11-05/gold-q6_k-runner-vs-llamacpp.json#b
failfile not identified (the report calls it lfm)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local checkout)3000.118993.0%84.3%an HTTP endpointlfm2.5-reference-2026-10-30/runner-vs-llamacpp-1.2b-q4_k_m.json#b
failmradermacher/stablelm-2-1_6b-chat-GGUF: stablelm-2-1_6b-chat.Q4_K_M.ggufstabilityai/stablelm-2-1_6b-chat@f3fe67052720.118595.7%82.4%runner --scorestablelm-2-1.6b-chat-2026-11-13/gold-q4_k_m-w1.json#a
failXHToken/Spark-X2.5-4B-GGUF: Spark-X2.5-4B-Q4_K_M.ggufXHToken/Spark-X2.5-4B@0bcb35673000.117795.2%87.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.5-q4_k_m-text.json#a
failXHToken/Spark-X2.5-4B-GGUF: Spark-X2.5-4B-Q4_K_M.ggufXHToken/Spark-X2.5-4B@0bcb35673000.117795.2%87.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.5-q4_k_m.json#a
failIFM/K2-Horizon-0.9B-GGUF: K2-Horizon-1B-Q4_K_M.gguf (sha256 78bff592aeba)IFM/K2-Horizon-0.9B@d50881f4f8dc3000.117496.1%82.7%an HTTP endpointk2-horizon-0.9b-reference-2026-10-30/gold-logits-llamacpp-q4_k_m.json#a
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local checkout)3000.115394.7%85.7%runner --scorelfm2.5-reference-2026-10-30/gold-logits-1.2b-q8-q4.json#b
failfile not identified (the report calls it score file)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local checkout)3000.115394.7%85.7%runner --scorelfm2.5-reference-2026-10-30/runner-vs-llamacpp-1.2b-q4_k_m.json#a
failXHToken/Spark-X2.5-4B-GGUF: Spark-X2.5-4B-Q4_K_M.ggufXHToken/Spark-X2.5-4B at 0bcb3567 (local checkout)3000.113695.6%87.0%runner --scorespark-2026-10-30/gold-logits-cpu-x2.5-q8-q4.json#b
failXHToken/Spark-X2.6-4B-GGUF: Spark-X2.6-4B-Q4_K_M.ggufXHToken/Spark-X2.6-4B at d1b5f260 (local checkout)3000.113093.6%87.0%runner --scorespark-2026-10-30/gold-logits-cpu-x2.6-q8-q4.json#b
failopenbmb/MiniCPM5-2B-GGUF: MiniCPM5-2B-Q4_K_M.gguf (sha256 ec2d58016400)openbmb/MiniCPM5-2B@f97400052a433000.107993.7%84.7%an HTTP endpointminicpm5-2b-reference-2026-10-29/gold-logits-llamacpp-q4_k_m.json#a
failIFM/K2-Horizon-0.9B-GGUF: K2-Horizon-1B-Q4_K_M.gguf (sha256 78bff592aeba)IFM/K2-Horizon-0.9B at d50881f4f8dc6923fb8f301e1c2313fe3a2b6c1d (local checkout)3000.107897.1%81.7%runner --scorek2-horizon-0.9b-reference-2026-10-30/gold-logits-metal-q8-q4.json#b
failfile not identified (the report calls it score file)IFM/K2-Horizon-0.9B at d50881f4f8dc6923fb8f301e1c2313fe3a2b6c1d (local checkout)20000.105096.0%84.9%runner --scorer3.24b-metal-microbatch-tiles-2026-11-02/gold-logits-q4_k_m-solo-vs-tiles.json#a
failfile not identified (the report calls it score file)IFM/K2-Horizon-0.9B at d50881f4f8dc6923fb8f301e1c2313fe3a2b6c1d (local checkout)20000.104995.8%84.8%runner --scorer3.24b-metal-microbatch-tiles-2026-11-02/gold-logits-q4_k_m-solo-vs-tiles.json#b
failmradermacher/stablelm-2-1_6b-chat-GGUF: stablelm-2-1_6b-chat.Q4_K_M.ggufstabilityai/stablelm-2-1_6b-chat@f3fe67052720.104392.3%81.2%runner --scorestablelm-2-1.6b-chat-2026-11-13/gold-q4_k_m-w2.json#a
failHuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF: smollm2-1.7b-instruct-q4_k_m.ggufHuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e2990.103392.7%84.6%runner --scoresmollm2-2026-11-13/gold-1.7b-publisher-q4_k_m-w1.json#a
failfile not identified (the report calls it score file)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.103395.8%89.0%runner --scoreornith-1.5-35b-a3b-2026-11-05/gold-q6_k-runner-vs-llamacpp.json#a
failfile not identified (the report calls it score file)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.103395.8%89.0%runner --scoreornith-1.5-35b-a3b-2026-11-05/gold-q6_k.json#a
failHuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF: smollm2-1.7b-instruct-q4_k_m.ggufHuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e3000.103292.8%84.7%runner --scoresmollm2-2026-11-13/gold-1.7b-publisher-q4_k_m-w1-runner-vs-llamacpp.json#a
failopenbmb/MiniCPM5-2B-GGUF: MiniCPM5-2B-Q4_K_M.gguf (sha256 ec2d58016400)openbmb/MiniCPM5-2B at f97400052a43d642bbc6e9975e2397e3ae6a6b52 (local checkout)3000.102094.6%86.0%runner --scoreminicpm5-2b-reference-2026-10-29/gold-logits-metal-q8-q4.json#b
failHuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF: smollm2-1.7b-instruct-q4_k_m.ggufHuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e2960.100896.1%84.8%runner --scoresmollm2-2026-11-13/gold-1.7b-publisher-q4_k_m-w2.json#a
failfile not identified (the report calls it score file)Accio-Lab/occamy-1.0@72ca96033000.097095.8%87.3%runner --scoreoccamy-1.0-2026-11-06/gold-q5_k_m.json#a
failQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q4_k_m.ggufQwen/Qwen2.5-1.5B-Instruct@989aa7983000.093197.5%86.0%an HTTP endpointqwen2.5-1.5b-instruct-2026-11-13/gold-q4_k_m-publisher-w1-runner-vs-llamacpp.json#b
failfile not identified (the report calls it score file)ibm-granite/granite-4.0-h-micro at d5f01a3ea75f (local copy)20000.091894.3%84.3%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w16-granite.json#b
failfile not identified (the report calls it score file)ibm-granite/granite-4.0-h-micro at d5f01a3ea75f (local copy)20000.091894.3%84.3%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w8-granite.json#b
failfile not identified (the report calls it score file)ibm-granite/granite-4.0-h-micro at d5f01a3ea75f (local copy)20000.091894.3%84.3%runner --scoregranitehybrid-metal-2026-10-31/gold-logits-cpu-vs-metal.json#a
failfile not identified (the report calls it score file)ibm-granite/granite-4.0-h-micro at d5f01a3ea75f (local copy)20000.091894.3%84.3%runner --scoregranitehybrid-metal-2026-10-31/gold-logits-cpu-vs-metal.json#b
failfile not identified (the report calls it score file)ibm-granite/granite-4.0-h-micro at d5f01a3ea75f (local copy)20000.091894.3%84.3%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w16-granite.json#a
failfile not identified (the report calls it score file)ibm-granite/granite-4.0-h-micro at d5f01a3ea75f (local copy)20000.091894.3%84.3%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w8-granite.json#a
failIFM/K2-Horizon-0.9B-GGUF: K2-Horizon-1B-Q8_0.gguf (sha256 741fb9ad2639)IFM/K2-Horizon-0.9B@d50881f4f8dc3000.091196.1%84.0%an HTTP endpointk2-horizon-0.9b-reference-2026-10-30/gold-logits-llamacpp-q8_0-text.json#a
failfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B@ad44e777bcd18fa416d9da3bd8f70d33ebb85d3920000.090994.8%85.7%runner --scoreqwen3-30b-a3b-derive-2026-11-02/gold-logits-official-q4_k_m-selective.json#a
failibm-granite/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q4_K_M.ggufibm-granite/granite-4.0-h-micro@d5f01a3e2720.090494.3%86.4%runner --scoregranite-4.0-h-micro-2026-11-13/gold-q4_k_m-w2.json#a
failibm-granite/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q4_K_M.ggufibm-granite/granite-4.0-h-micro@d5f01a3e2720.088895.0%86.4%an HTTP endpointgranite-4.0-h-micro-2026-11-13/gold-q4_k_m-w1-llama.json#b
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q5_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.086196.3%86.7%an HTTP endpointdeepseek-v2-lite-chat-2026-11-04/gold-q5_k_m-cuda-vs-llamacpp.json#b
failQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q4_k_m.ggufQwen/Qwen2.5-1.5B-Instruct@989aa7983000.084697.5%86.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q4_k_m-publisher-w1-runner-vs-llamacpp.json#a
failQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q4_k_m.ggufQwen/Qwen2.5-1.5B-Instruct@989aa7983000.084697.5%86.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q4_k_m-publisher-w1.json#a
failfile not identified (the report calls it score file)Accio-Lab/occamy-1.0@72ca96033000.083695.4%88.7%runner --scoreoccamy-1.0-2026-11-06/gold-q6_k.json#a
failibm-granite/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q4_K_M.ggufibm-granite/granite-4.0-h-micro@d5f01a3e2720.080595.5%87.5%runner --scoregranite-4.0-h-micro-2026-11-13/gold-q4_k_m-w1.json#a
failibm-granite/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q4_K_M.ggufibm-granite/granite-4.0-h-micro@d5f01a3e2720.080595.5%87.5%runner --scoregranite-4.0-h-micro-2026-11-13/gold-q4_k_m-w1-llama.json#a
failggml-org/gpt-oss-20b-GGUF: gpt-oss-20b-MXFP4.gguf (sha256 27cd6c432c76)openai/gpt-oss-20b@6cee5e812720.078398.4%96.0%runner --scoregpt-oss-20b-2026-11-13/gold-mxfp4-w2.json#a
failQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q4_k_m.ggufQwen/Qwen2.5-1.5B-Instruct@989aa7983000.075096.4%86.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q4_k_m-publisher-w2.json#a
failbartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF: MiMo-V2.6-Distill-Qwen-9B-Q4_K_M.ggufXiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B (local checkout)3000.071798.2%91.7%runner --scoremimo-v2.6-distill-qwen-9b-2026-10-29/gold-logits-cpu-q8-q4.json#b
failmradermacher/stablelm-2-1_6b-chat-i1-GGUF: stablelm-2-1_6b-chat.i1-Q4_K_M.ggufstabilityai/stablelm-2-1_6b-chat@f3fe67052720.070598.4%87.1%runner --scorestablelm-2-1.6b-chat-2026-11-13/gold-i1-q4_k_m-w1.json#a
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q5_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.070596.3%88.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q5_k_m-cpu-vs-cuda.json#b
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q5_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.070596.3%88.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q5_k_m-cuda-vs-llamacpp.json#a
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q5_K_M.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.070496.8%88.3%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q5_k_m-cpu-vs-cuda.json#a
failggml-org/gpt-oss-20b-GGUF: gpt-oss-20b-MXFP4.gguf (sha256 27cd6c432c76)openai/gpt-oss-20b@6cee5e812720.067198.0%94.9%an HTTP endpointgpt-oss-20b-2026-11-13/gold-mxfp4-w1-llama.json#b
failggml-org/gpt-oss-20b-GGUF: gpt-oss-20b-MXFP4.gguf (sha256 27cd6c432c76)openai/gpt-oss-20b@6cee5e812720.063497.6%93.8%runner --scoregpt-oss-20b-2026-11-13/gold-mxfp4-w1-llama.json#a
failggml-org/gpt-oss-20b-GGUF: gpt-oss-20b-MXFP4.gguf (sha256 27cd6c432c76)openai/gpt-oss-20b@6cee5e812720.063497.6%93.8%runner --scoregpt-oss-20b-2026-11-13/gold-mxfp4-w1.json#a
failggml-org/Qwen3.6-27B-GGUF: Qwen3.6-27B-Q8_0.ggufQwen/Qwen3.6-27B@6a9e13bd6fc8f0983b9b99948120bc37f49c13e93000.062698.3%96.3%an HTTP endpointqwen3.6-27b-2026-11-04/gold-logits-q8_0-runner-vs-llamacpp.json#b
failbartowski/SmolLM2-135M-Instruct-GGUF: SmolLM2-135M-Instruct-Q4_K_M.ggufHuggingFaceTB/SmolLM2-135M-Instruct@12fd25f72960.062598.0%87.8%runner --scoresmollm2-2026-11-13/gold-135m-q4_k_m-w2.json#a
failmistralai/Ministral-3-3B-Instruct-2512-GGUF: Ministral-3-3B-Instruct-2512-Q4_K_M.ggufmistralai/Ministral-3-3B-Instruct-2512@b35d4dfe56c13000.062399.5%92.0%runner --scoreministral-3-3b-reference-2026-11-01/gold-logits-cpu-q4_k_m-cpu-q8_0.json#a
failbartowski/SmolLM2-135M-Instruct-GGUF: SmolLM2-135M-Instruct-Q4_K_M.ggufHuggingFaceTB/SmolLM2-135M-Instruct@12fd25f72990.062197.9%89.6%runner --scoresmollm2-2026-11-13/gold-135m-q4_k_m-w1.json#a
failmradermacher/stablelm-2-1_6b-chat-i1-GGUF: stablelm-2-1_6b-chat.i1-Q4_K_M.ggufstabilityai/stablelm-2-1_6b-chat@f3fe67052720.061996.4%89.0%runner --scorestablelm-2-1.6b-chat-2026-11-13/gold-i1-q4_k_m-w2.json#a
failfile not identified (the report calls it Qwen_Qwen3.6-35B-A3B-Q8_0.gguf)Qwen/Qwen3.6-35B-A3B at 995ad96eacd9 (local copy)3000.061898.1%94.0%an HTTP endpointqwen3.6-35b-a3b-reference-2026-10-31/gold-logits-q8-runner-vs-other-engine.json#b
failfile not identified (the report calls it score file)openbmb/MiniCPM-V-4.7-35B-A3B@98e79ba9 (its text_config)3000.059495.4%88.3%runner --scoreminicpm-v-4.7-35b-a3b-2026-11-06/gold-q4_k_m.json#a
failfile not identified (the report calls it score file)Accio-Lab/occamy-1.0@72ca96033000.059098.7%93.0%runner --scoreoccamy-1.0-2026-11-06/gold-q8_0.json#a
failfile not identified (the report calls it LFM2.5-8B-A1B-Q8_0.gguf)LiquidAI/LFM2.5-8B-A1B at 5dd22602c2e9 (local copy)3000.057296.7%90.0%an HTTP endpointlfm2.5-8b-a1b-reference-2026-10-30/gold-logits-8b-a1b-bf16-vs-other-engine-q8.json#b
failbartowski/Qwen2.5-1.5B-Instruct-GGUF: Qwen2.5-1.5B-Instruct-Q4_K_M.ggufQwen/Qwen2.5-1.5B-Instruct@989aa7983000.055697.0%86.0%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q4_k_m-bartowski-w1.json#a
failunsloth/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q4_K_M.gguf (sha256 1f21ba20ca24)ibm-granite/granite-4.0-h-micro@d5f01a3e2720.055397.6%90.8%runner --scoregranite-4.0-h-micro-2026-11-13/gold-unsloth-q4_k_m-w2.json#a
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.053996.8%90.8%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-unsloth-q4km-q5km-float32.json#b
failfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.053996.8%90.8%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-unsloth-q4km-q5km.json#b
failbartowski/swiss-ai_Apertus-8B-Instruct-2509-GGUF: swiss-ai_Apertus-8B-Instruct-2509-Q4_K_M.gguf (sha256 5901007f15ae)swiss-ai/Apertus-8B-Instruct-2509@b946d4043000.052698.1%88.3%runner --scoreapertus-8b-instruct-2509-2026-11-12/gold-q4_k_m-w2.json#a
failfile not identified (the report calls it score file)empero-ai/Qwen3.8-35B-A3B-Distill@bcc2dbe23000.050895.5%89.3%runner --scoreempero-qwen3.8-35b-a3b-distill-2026-11-06/gold-q5_k_m.json#a
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q6_K.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.046696.8%88.7%an HTTP endpointdeepseek-v2-lite-chat-2026-11-04/dcause-gold-naivecpu-vs-llamacpp.json#b
failmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q6_K.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.046696.8%88.7%an HTTP endpointdeepseek-v2-lite-chat-2026-11-04/gold-q6_k-cuda-vs-llamacpp.json#b
passggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_0.ggufnvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.049999.0%90.3%an HTTP endpointnemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-q4_0-runner-vs-llamacpp.json#b
passbartowski/SmolLM2-1.7B-Instruct-GGUF: SmolLM2-1.7B-Instruct-Q4_K_M.gguf (sha256 77665ea48159)HuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e2960.049599.5%88.2%runner --scoresmollm2-2026-11-13/gold-1.7b-q4_k_m-w2.json#a
passbartowski/SmolLM2-1.7B-Instruct-GGUF: SmolLM2-1.7B-Instruct-Q4_K_M.gguf (sha256 77665ea48159)HuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e2990.049397.7%91.0%runner --scoresmollm2-2026-11-13/gold-1.7b-q4_k_m-w1.json#a
passfile not identified (the report calls it score file)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.048497.5%91.3%runner --scoreornith-1.5-35b-a3b-2026-11-05/gold-bf16-vs-q8_0.json#b
passfile not identified (the report calls it score file)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.048497.5%91.3%runner --scoreornith-1.5-35b-a3b-2026-11-05/gold-q8_0.json#a
passggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_0.ggufnvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.047697.6%89.3%runner --scorenemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-q4_0-runner-vs-llamacpp.json#a
passbartowski/Qwen2.5-1.5B-Instruct-GGUF: Qwen2.5-1.5B-Instruct-Q4_K_M.ggufQwen/Qwen2.5-1.5B-Instruct@989aa7983000.047699.0%90.0%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q4_k_m-bartowski-w2.json#a
passbartowski/Qwen_Qwen3.6-35B-A3B-GGUF: Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf (sha256 b46fedd33e0b)Qwen/Qwen3.6-35B-A3B at 995ad96eacd9 (local copy)3000.047597.2%89.0%runner --scoreqwen3.6-35b-a3b-reference-2026-10-31/gold-logits-q8-q4.json#b
passbartowski/swiss-ai_Apertus-8B-Instruct-2509-GGUF: swiss-ai_Apertus-8B-Instruct-2509-Q4_K_M.gguf (sha256 5901007f15ae)swiss-ai/Apertus-8B-Instruct-2509@b946d4043000.045998.0%89.0%runner --scoreapertus-8b-instruct-2509-2026-11-12/gold-q4_k_m-w1.json#a
passfile not identified (the report calls it LFM2.5-8B-A1B-Q8_0.gguf)LiquidAI/LFM2.5-8B-A1B at 5dd22602c2e9 (local copy)3000.044297.6%93.7%runner --scorelfm2.5-8b-a1b-reference-2026-10-30/gold-logits-8b-a1b-q8-q4.json#a
passunsloth/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q4_K_M.gguf (sha256 1f21ba20ca24)ibm-granite/granite-4.0-h-micro@d5f01a3e2720.042699.0%93.0%runner --scoregranite-4.0-h-micro-2026-11-13/gold-unsloth-q4_k_m-w1.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q4_K_M.gguf (sha256 e4165e3a71af)microsoft/Phi-3.5-mini-instruct@2fe192452720.042499.0%91.9%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q4_k_m-w1.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.042498.3%90.9%runner --scoreqwen3-30b-a3b-imatrix-2026-10-31/gold-logits-n11-vs-imx.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q4_K_M.gguf (sha256 e4165e3a71af)microsoft/Phi-3.5-mini-instruct@2fe192452720.042199.0%90.8%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q4_k_m-w2.json#a
passopenbmb/MiniCPM5-2B-GGUF: MiniCPM5-2B-Q8_0.gguf (sha256 c5415f8989bf)openbmb/MiniCPM5-2B@f97400052a433000.040198.0%92.7%an HTTP endpointminicpm5-2b-reference-2026-10-29/gold-logits-llamacpp-q8_0-text.json#a
passfile not identified (the report calls it score file)InternScience/Sage-A1.5@0e3205cf3000.039597.9%95.3%runner --scoresage-a1.5-2026-11-06/gold-q6_k.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.037798.9%91.6%runner --scorer4.7.3-sensitivity-sweep-2026-10-31/gold-k16.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.035598.6%91.5%runner --scoreqwen3-30b-a3b-imatrix-2026-10-31/gold-logits-n11-vs-imx.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.035598.6%91.5%runner --scoreqwen3-30b-a3b-sensitivity-plan-2026-10-31/gold-logits-n11-vs-sens.json#a
passfile not identified (the report calls it Qwen_Qwen3.6-35B-A3B-Q8_0.gguf)Qwen/Qwen3.6-35B-A3B at 995ad96eacd9 (local copy)3000.034999.1%94.7%runner --scoreqwen3.6-35b-a3b-reference-2026-10-31/gold-logits-q8-q4.json#a
passfile not identified (the report calls it Qwen_Qwen3.6-35B-A3B-Q8_0.gguf)Qwen/Qwen3.6-35B-A3B at 995ad96eacd9 (local copy)3000.034999.1%94.7%runner --scoreqwen3.6-35b-a3b-reference-2026-10-31/gold-logits-q8-runner-vs-other-engine.json#a
passfile not identified (the report calls it score file)empero-ai/Qwen3.8-35B-A3B-Distill@bcc2dbe23000.033698.6%91.7%runner --scoreempero-qwen3.8-35b-a3b-distill-2026-11-06/gold-q6_k.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.033198.8%92.2%runner --scorer4.7.3-sensitivity-sweep-2026-10-31/gold-k6.json#a
passQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q8_0.gguf (sha256 d7efb072e772)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0324100.0%93.0%an HTTP endpointqwen2.5-1.5b-instruct-2026-11-13/gold-q8_0-publisher-w1-runner-vs-llamacpp.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.031098.8%93.0%runner --scorer4.7.3-sensitivity-sweep-2026-10-31/gold-k16.json#b
passQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q8_0.gguf (sha256 d7efb072e772)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0307100.0%91.3%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q8_0-publisher-w1-runner-vs-llamacpp.json#a
passQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q8_0.gguf (sha256 d7efb072e772)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0307100.0%91.3%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q8_0-publisher-w1.json#a
passfile not identified (the report calls it score file)deepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029798.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/dcause-gold-naivecpu-vs-naivecuda.json#b
passfile not identified (the report calls it LFM2.5-24B-A2B-Q8_0.gguf)LiquidAI/LFM2.5-24B-A2B at 3fcfdbfa1a1b (local copy)3000.029799.1%91.3%runner --scorelfm2.5-24b-a2b-reference-2026-10-30/gold-logits-24b-a2b-q8-q4.json#a
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q6_K.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029698.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q6_k-cpu-vs-cuda.json#b
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q6_K.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029698.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q6_k-cuda-vs-llamacpp.json#a
passfile not identified (the report calls it score file)deepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029498.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/dcause-gold-abscpu-vs-naivecpu.json#b
passfile not identified (the report calls it score file)deepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029498.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/dcause-gold-naivecpu-vs-llamacpp.json#a
passfile not identified (the report calls it score file)deepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029498.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/dcause-gold-naivecpu-vs-naivecuda.json#a
passfile not identified (the report calls it score file)deepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029398.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/dcause-gold-abscpu-vs-naivecpu.json#a
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q6_K.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.029398.6%93.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q6_k-cpu-vs-cuda.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.029299.0%93.0%runner --scoreqwen3-30b-a3b-sensitivity-plan-2026-10-31/gold-logits-n11-vs-sens.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B@ad44e777bcd18fa416d9da3bd8f70d33ebb85d3920000.029099.0%92.9%runner --scoreqwen3-30b-a3b-derive-2026-11-02/gold-logits-derive.json#a
passQwen/Qwen2.5-1.5B-Instruct-GGUF: qwen2.5-1.5b-instruct-q8_0.gguf (sha256 d7efb072e772)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.028799.5%92.0%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q8_0-publisher-w2.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B@ad44e777bcd18fa416d9da3bd8f70d33ebb85d3920000.027998.8%93.0%runner --scoreqwen3-30b-a3b-derive-2026-11-02/gold-logits-official-q4_k_m-selective.json#b
passggml-org/Qwen3.6-27B-GGUF: Qwen3.6-27B-Q8_0.ggufQwen/Qwen3.6-27B@6a9e13bd6fc8f0983b9b99948120bc37f49c13e93000.027399.6%98.0%runner --scoreqwen3.6-27b-2026-11-04/gold-logits-q8_0-runner-vs-llamacpp.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.026799.1%93.0%runner --scorer4.7.3-sensitivity-sweep-2026-10-31/gold-k6.json#b
passfile not identified (the report calls it score file)ornith-ai/Ornith-1.5-35B-A3B@10fbf86f3000.026298.3%92.7%runner --scoreornith-1.5-35b-a3b-2026-11-05/gold-bf16-vs-q8_0.json#a
passunsloth/Devstral-Small-2-24B-Instruct-2512-GGUF: Devstral-Small-2-24B-Instruct-2512-Q4_K_M.gguf (sha256 d14ba9edee1b)mistralai/Devstral-Small-2-24B-Instruct-2512 at 55c5b41e98c2dbd21b0c8afffc540dcfc9eb5128 (local checkout)3000.025999.5%92.3%an HTTP endpointdevstral-small-2-reference-2026-11-02/gold-logits-runner-ggml-org-q8_0-llamacpp-q4_k_m.json#b
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192451140.025298.8%94.7%an HTTP endpointphi-3.5-mini-instruct-longrope-2026-11-13/gold-q8_0-past4096.json#b
passggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF: NVIDIA-Nemotron-3-Nano-30B-A3B-Q4_K_M.gguf (sha256 0f111a0d4977)nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16@bf77c3173000.024399.5%94.0%an HTTP endpointnemotron-3-nano-30b-a3b-2026-11-05/gold-q4_k_m-runner-vs-llamacpp.json#b
passibm-granite/granite-4.2-30b-GGUF: granite-4.2-30b-Q8_0.ggufibm-granite/granite-4.2-30b@9e668ce1c538387ef24d3644e9b06066477626363000.024199.1%95.0%an HTTP endpointgranite-4.2-30b-2026-11-04/gold-logits-q8_0-runner-vs-llamacpp.json#b
passfile not identified (the report calls it score file)mistralai/Devstral-Small-2-24B-Instruct-2512 at 55c5b41e98c2dbd21b0c8afffc540dcfc9eb5128 (local checkout)3000.022399.5%92.3%runner --scoredevstral-small-2-reference-2026-11-02/gold-logits-runner-q4_k_m-q8_0.json#a
passggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF: NVIDIA-Nemotron-3-Nano-30B-A3B-Q4_K_M.gguf (sha256 0f111a0d4977)nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16@bf77c3173000.022299.5%93.7%runner --scorenemotron-3-nano-30b-a3b-2026-11-05/gold-q4_k_m-floor0.json#a
passggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF: NVIDIA-Nemotron-3-Nano-30B-A3B-Q4_K_M.gguf (sha256 0f111a0d4977)nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16@bf77c3173000.022299.5%93.7%runner --scorenemotron-3-nano-30b-a3b-2026-11-05/gold-q4_k_m-runner-vs-llamacpp.json#a
passbartowski/Mistral-7B-Instruct-v0.3-GGUF: Mistral-7B-Instruct-v0.3-Q4_K_M.gguf (sha256 1270d22c0fbb)mistralai/Mistral-7B-Instruct-v0.3@c170c7082720.022299.5%93.0%runner --scoremistral-7b-instruct-v0.3-2026-11-13/gold-q4_k_m-w1.json#a
passbartowski/Mistral-7B-Instruct-v0.3-GGUF: Mistral-7B-Instruct-v0.3-Q4_K_M.gguf (sha256 1270d22c0fbb)mistralai/Mistral-7B-Instruct-v0.3@c170c7082710.021699.0%94.5%runner --scoremistral-7b-instruct-v0.3-2026-11-13/gold-q4_k_m-w2.json#a
passbartowski/HemmingwayAI_Hemmingway-1.5-GGUF: HemmingwayAI_Hemmingway-1.5-Q4_K_M.ggufHemmingwayAI/Hemmingway-1.5@2f66c2569b9920000.020399.7%95.5%runner --scorehemmingway-reference-2026-11-01/h15-gold-logits-cpu-q4_k_m-cuda-q4_k_m.json#b
passbartowski/HemmingwayAI_Hemmingway-1.5-GGUF: HemmingwayAI_Hemmingway-1.5-Q4_K_M.ggufHemmingwayAI/Hemmingway-1.5@2f66c2569b9920000.020399.7%95.5%runner --scorehemmingway-reference-2026-11-01/h15-gold-logits-cuda-q4_k_m-cpu-q8_0.json#a
passbartowski/HemmingwayAI_Hemmingway-1.5-GGUF: HemmingwayAI_Hemmingway-1.5-Q4_K_M.ggufHemmingwayAI/Hemmingway-1.5@2f66c2569b9920000.020399.7%95.6%runner --scorehemmingway-reference-2026-11-01/h15-gold-logits-cpu-q4_k_m-cuda-q4_k_m.json#a
passIFM/K2-Horizon-7B-GGUF: K2-Horizon-7B-Q8_0.gguf (sha256 5a98a289aba5)IFM/K2-Horizon-7B@4622f94a66323000.0176100.0%93.7%an HTTP endpointk2-horizon-7b-reference-2026-10-30/gold-logits-llamacpp-q8_0-text.json#a
passIFM/K2-Horizon-7B-GGUF: K2-Horizon-7B-Q8_0.gguf (sha256 5a98a289aba5)IFM/K2-Horizon-7B@4622f94a66323000.0176100.0%93.7%an HTTP endpointk2-horizon-7b-reference-2026-10-30/gold-logits-llamacpp-q8_0.json#a
passmistralai/Ministral-3-3B-Instruct-2512-GGUF: Ministral-3-3B-Instruct-2512-Q8_0.ggufmistralai/Ministral-3-3B-Instruct-2512@b35d4dfe56c13000.0174100.0%94.3%runner --scoreministral-3-3b-reference-2026-11-01/gold-logits-cpu-q4_k_m-cpu-q8_0.json#b
passfile not identified (the report calls it NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q8_0.gguf)nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.0173100.0%93.3%an HTTP endpointnemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-q8_0-runner-vs-llamacpp.json#b
passIFM/K2-Horizon-7B-GGUF: K2-Horizon-7B-Q8_0.gguf (sha256 5a98a289aba5)IFM/K2-Horizon-7B at 4622f94a (local checkout)3000.0159100.0%95.0%runner --scorek2-horizon-7b-reference-2026-10-30/gold-logits-cpu-q8-q4.json#a
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q8_0.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.015599.5%94.7%an HTTP endpointdeepseek-v2-lite-chat-2026-11-04/gold-q8_0-cuda-vs-llamacpp.json#b
passfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.014699.0%92.3%runner --scorenemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-bf16-q8_0-runner.json#b
passfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.014699.0%92.3%runner --scorenemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-q8_0-runner-vs-llamacpp.json#a
passXHToken/Spark-X2.6-4B-GGUF: Spark-X2.6-4B-Q8_0.ggufXHToken/Spark-X2.6-4B at d1b5f260 (local checkout)3000.0132100.0%98.7%runner --scorespark-2026-10-30/gold-logits-cpu-x2.6-q8-q4.json#a
passmradermacher/Hemmingway-1-GGUF: Hemmingway-1.Q8_0.ggufHemmingwayAI/Hemmingway-1@faba5746970520000.010699.5%98.2%runner --scorehemmingway-reference-2026-11-01/h1-gold-logits-cuda-q4_k_m-cpu-q8_0.json#b
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q8_0.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.0096100.0%96.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q8_0-cpu-vs-cuda.json#b
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q8_0.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.0096100.0%96.0%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q8_0-cuda-vs-llamacpp.json#a
passmradermacher/DeepSeek-V2-Lite-Chat-GGUF: DeepSeek-V2-Lite-Chat.Q8_0.ggufdeepseek-ai/DeepSeek-V2-Lite-Chat@85864749cd611b4353ce1decdb286193298f64c73000.0094100.0%96.7%runner --scoredeepseek-v2-lite-chat-2026-11-04/gold-q8_0-cpu-vs-cuda.json#a
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.009499.9%96.0%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q40-isolated-float32.json#b
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.009499.9%96.0%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q40-isolated.json#b
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.008999.6%96.0%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-isolated-float32.json#b
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.008899.6%96.0%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-isolated.json#b
passfile not identified (the report calls it score file)openbmb/MiniCPM-V-4.7-35B-A3B@98e79ba9 (its text_config)3000.0088100.0%96.0%runner --scoreminicpm-v-4.7-35b-a3b-2026-11-06/gold-q8_0.json#a
passXHToken/Spark-X2.6-4B-GGUF: Spark-X2.6-4B-Q8_0.ggufXHToken/Spark-X2.6-4B@d1b5f2603000.0086100.0%98.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.6-q8_0-text.json#a
passXHToken/Spark-X2.6-4B-GGUF: Spark-X2.6-4B-Q8_0.ggufXHToken/Spark-X2.6-4B@d1b5f2603000.0086100.0%98.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.6-q8_0.json#a
passfile not identified (the report calls it score file)LiquidAI/LFM2.5-350M at 9e6c6ccf47cd (local checkout)3000.0081100.0%95.3%runner --scorelfm2.5-reference-2026-10-30/gold-logits-350m-q8-q4.json#a
passLiquidAI/LFM2.5-8B-A1B-GGUF: LFM2.5-8B-A1B-BF16.ggufLiquidAI/LFM2.5-8B-A1B at 5dd22602c2e9 (local copy)3000.0078100.0%97.3%runner --scorelfm2.5-8b-a1b-reference-2026-10-30/gold-logits-8b-a1b-bf16-vs-other-engine-q8.json#a
passbartowski/SmolLM2-135M-Instruct-GGUF: SmolLM2-135M-Instruct-Q8_0.gguf (sha256 5a1395716f79)HuggingFaceTB/SmolLM2-135M-Instruct@12fd25f72960.0077100.0%98.0%runner --scoresmollm2-2026-11-13/gold-135m-q8_0-w2.json#a
passbartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF: MiMo-V2.6-Distill-Qwen-9B-Q8_0.ggufXiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B (local checkout)3000.0075100.0%99.0%runner --scoremimo-v2.6-distill-qwen-9b-2026-10-29/gold-logits-cpu-q8-q4.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-0.6B at c1899de289a04d12100db370d81485cdf75e47ca (local checkout)20000.0075100.0%97.0%runner --scorer3.1.5b-cpu-int8-prefill-2026-11-02/gold-logits-q8_0-f32-vs-int8-prefill.json#b
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.0072100.0%96.3%an HTTP endpointphi-3.5-mini-instruct-2026-11-13/gold-q8_0-w1-llama-c4096.json#b
passbartowski/SmolLM2-135M-Instruct-GGUF: SmolLM2-135M-Instruct-Q8_0.gguf (sha256 5a1395716f79)HuggingFaceTB/SmolLM2-135M-Instruct@12fd25f72990.0071100.0%99.0%runner --scoresmollm2-2026-11-13/gold-135m-q8_0-w1.json#a
passXHToken/Spark-X2.5-4B-GGUF: Spark-X2.5-4B-Q8_0.ggufXHToken/Spark-X2.5-4B@0bcb35673000.0065100.0%98.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.5-q8_0-text.json#a
passXHToken/Spark-X2.5-4B-GGUF: Spark-X2.5-4B-Q8_0.ggufXHToken/Spark-X2.5-4B@0bcb35673000.0065100.0%98.0%an HTTP endpointspark-2026-10-30/gold-logits-llamacpp-x2.5-q8_0.json#a
passIFM/K2-Horizon-0.9B-GGUF: K2-Horizon-1B-Q8_0.gguf (sha256 741fb9ad2639)IFM/K2-Horizon-0.9B@d50881f4f8dc3000.0064100.0%97.0%an HTTP endpointk2-horizon-0.9b-reference-2026-10-30/gold-logits-llamacpp-q8_0.json#a
passmistralai/Ministral-3-3B-Instruct-2512-GGUF: Ministral-3-3B-Instruct-2512-Q8_0.ggufmistralai/Ministral-3-3B-Instruct-2512@b35d4dfe56c12460.0061100.0%100.0%runner --scoreministral-3-3b-reference-2026-11-01/gold-logits-long-cpu-q8_0.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-0.6B at c1899de289a04d12100db370d81485cdf75e47ca (local checkout)20000.0061100.0%97.7%runner --scorer3.1.5b-cpu-int8-prefill-2026-11-02/gold-logits-q8_0-f32-vs-int8-prefill.json#a
passbartowski/swiss-ai_Apertus-8B-Instruct-2509-GGUF: swiss-ai_Apertus-8B-Instruct-2509-Q8_0.gguf (sha256 68a9d338961e)swiss-ai/Apertus-8B-Instruct-2509@b946d4043000.0057100.0%96.7%runner --scoreapertus-8b-instruct-2509-2026-11-12/gold-q8_0-w2.json#a
passfile not identified (the report calls it score file)nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@a9904d24bcc1d289a1950fa9d2b978c47cf903b93000.0055100.0%96.3%runner --scorenemotron-3.5-lightning-30b-a3b-2026-11-03/gold-logits-bf16-q8_0-runner.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-0.6B@c1899de289a04d12100db370d81485cdf75e47ca20000.0055100.0%97.5%runner --scorer3.29-cuda-decode-attention-2026-11-03/gold-main-vs-r329.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3-0.6B@c1899de289a04d12100db370d81485cdf75e47ca20000.0055100.0%97.5%runner --scorer3.29-cuda-decode-attention-2026-11-03/gold-main-vs-r329.json#a
passopenbmb/MiniCPM5-2B-GGUF: MiniCPM5-2B-Q8_0.gguf (sha256 c5415f8989bf)openbmb/MiniCPM5-2B@f97400052a433000.0050100.0%98.0%an HTTP endpointminicpm5-2b-reference-2026-10-29/gold-logits-llamacpp-q8_0.json#a
passbartowski/swiss-ai_Apertus-8B-Instruct-2509-GGUF: swiss-ai_Apertus-8B-Instruct-2509-Q8_0.gguf (sha256 68a9d338961e)swiss-ai/Apertus-8B-Instruct-2509@b946d4043000.0050100.0%97.3%runner --scoreapertus-8b-instruct-2509-2026-11-12/gold-q8_0-w1.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3-30B-A3B at ad44e777bcd1 (local copy)20000.004999.9%97.8%runner --scoreqwen3-30b-a3b-imatrix-2026-10-31/gold-logits-q8.json#a
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.004699.8%97.2%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q40-isolated-float32.json#a
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.004699.8%97.2%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-isolated-float32.json#a
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.004699.8%97.4%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q40-isolated.json#a
passfile not identified (the report calls it score file)google/gemma-4-E2B-it at 3e22461f65e8 (local copy)20000.004699.8%97.4%runner --scoregemma-4-e2b-ple-quant-2026-10-31/gold-logits-ple-q4k-isolated.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192451140.0045100.0%99.1%runner --scorephi-3.5-mini-instruct-longrope-2026-11-13/gold-q8_0-past4096.json#a
passbartowski/SmolLM2-1.7B-Instruct-GGUF: SmolLM2-1.7B-Instruct-Q8_0.gguf (sha256 0c6e8955788b)HuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e2960.0045100.0%97.0%runner --scoresmollm2-2026-11-13/gold-1.7b-q8_0-w2.json#a
passXHToken/Spark-X2.5-4B-GGUF: Spark-X2.5-4B-Q8_0.ggufXHToken/Spark-X2.5-4B at 0bcb3567 (local checkout)3000.0044100.0%98.7%runner --scorespark-2026-10-30/gold-logits-cpu-x2.5-q8-q4.json#a
passmradermacher/stablelm-2-1_6b-chat-GGUF: stablelm-2-1_6b-chat.Q8_0.gguf (sha256 70fa97127815)stabilityai/stablelm-2-1_6b-chat@f3fe67052720.0043100.0%97.8%runner --scorestablelm-2-1.6b-chat-2026-11-13/gold-q8_0-w1.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.0042100.0%98.9%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q8_0-w1-llama-c4096.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.0042100.0%98.9%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q8_0-w1-llama-c8192.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.0042100.0%98.9%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q8_0-w1.json#a
passfile not identified (the report calls it score file)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local checkout)3000.0042100.0%99.0%runner --scorelfm2.5-reference-2026-10-30/gold-logits-1.2b-q8-q4.json#a
passLiquidAI/LFM2.5-1.2B-Instruct-GGUF: LFM2.5-1.2B-Instruct-Q8_0.gguf (sha256 f6b981dcb869)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local copy)3000.0042100.0%99.0%runner --scorelfm2.5-8b-a1b-reference-2026-10-30/gold-logits-1.2b-bf16-dense-baseline.json#b
passibm-granite/granite-4.2-30b-GGUF: granite-4.2-30b-Q8_0.ggufibm-granite/granite-4.2-30b@9e668ce1c538387ef24d3644e9b06066477626363000.004199.6%97.7%runner --scoregranite-4.2-30b-2026-11-04/gold-logits-q8_0-runner-vs-llamacpp.json#a
passmradermacher/stablelm-2-1_6b-chat-GGUF: stablelm-2-1_6b-chat.Q8_0.gguf (sha256 70fa97127815)stabilityai/stablelm-2-1_6b-chat@f3fe67052720.0039100.0%98.5%runner --scorestablelm-2-1.6b-chat-2026-11-13/gold-q8_0-w2.json#a
passbartowski/SmolLM2-1.7B-Instruct-GGUF: SmolLM2-1.7B-Instruct-Q8_0.gguf (sha256 0c6e8955788b)HuggingFaceTB/SmolLM2-1.7B-Instruct@31b70e2e2990.0038100.0%98.3%runner --scoresmollm2-2026-11-13/gold-1.7b-q8_0-w1.json#a
passIFM/K2-Horizon-0.9B-GGUF: K2-Horizon-1B-Q8_0.gguf (sha256 741fb9ad2639)IFM/K2-Horizon-0.9B at d50881f4f8dc6923fb8f301e1c2313fe3a2b6c1d (local checkout)3000.0037100.0%97.3%runner --scorek2-horizon-0.9b-reference-2026-10-30/gold-logits-metal-q8-q4.json#a
passandreasmartin/apertus-v1.5-8b-text-Q8_0-GGUF: apertus-v1.5-8b-text-q8_0.gguf (sha256 dea904ad80cd)swiss-ai/Apertus-v1.5-8B@1519de0a3000.0037100.0%98.7%runner --scoreapertus-v1.5-8b-text-2026-11-13/gold-q8_0-w2.json#a
passfile not identified (the report calls it score file)IFM/K2-Horizon-0.9B at d50881f4f8dc6923fb8f301e1c2313fe3a2b6c1d (local checkout)20000.0036100.0%97.7%runner --scorer3.24b-metal-microbatch-tiles-2026-11-02/gold-logits-q8_0-solo-vs-tiles.json#b
passfile not identified (the report calls it score file)IFM/K2-Horizon-0.9B at d50881f4f8dc6923fb8f301e1c2313fe3a2b6c1d (local checkout)20000.0036100.0%97.7%runner --scorer3.24b-metal-microbatch-tiles-2026-11-02/gold-logits-q8_0-solo-vs-tiles.json#a
passandreasmartin/apertus-v1.5-8b-text-Q8_0-GGUF: apertus-v1.5-8b-text-q8_0.gguf (sha256 dea904ad80cd)swiss-ai/Apertus-v1.5-8B@1519de0a3000.0035100.0%97.0%runner --scoreapertus-v1.5-8b-text-2026-11-13/gold-q8_0-w1.json#a
passfile not identified (the report calls it score file)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0034100.0%98.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-lab-q8_0-w2.json#a
passbartowski/Qwen2.5-1.5B-Instruct-GGUF: Qwen2.5-1.5B-Instruct-Q8_0.gguf (sha256 7185d306cf45)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0034100.0%98.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q8_0-bartowski-w2.json#a
passopenbmb/MiniCPM5-2B-GGUF: MiniCPM5-2B-Q8_0.gguf (sha256 c5415f8989bf)openbmb/MiniCPM5-2B at f97400052a43d642bbc6e9975e2397e3ae6a6b52 (local checkout)3000.0033100.0%98.0%runner --scoreminicpm5-2b-reference-2026-10-29/gold-logits-metal-q8-q4.json#a
passbartowski/Phi-3.5-mini-instruct-GGUF: Phi-3.5-mini-instruct-Q8_0.gguf (sha256 76fbf02f6fe9)microsoft/Phi-3.5-mini-instruct@2fe192452720.0033100.0%98.2%runner --scorephi-3.5-mini-instruct-2026-11-13/gold-q8_0-w2.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3.5-0.8B at 2fc06364715b (local copy)20000.0032100.0%98.3%runner --scoreqwen35-metal-2026-10-31/gold-logits-cpu-vs-metal.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3.5-0.8B at 2fc06364715b (local copy)20000.0032100.0%98.3%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w16-qwen.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3.5-0.8B at 2fc06364715b (local copy)20000.0032100.0%98.3%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w8-qwen.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3.5-0.8B at 2fc06364715b (local copy)20000.0032100.0%98.5%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w16-qwen.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3.5-0.8B at 2fc06364715b (local copy)20000.0032100.0%98.5%runner --scorer3.24-metal-small-prefill-2026-10-31/gold-w8-qwen.json#b
passfile not identified (the report calls it score file)Qwen/Qwen3.5-0.8B at 2fc06364715b (local copy)20000.0032100.0%98.3%runner --scoreqwen35-metal-2026-10-31/gold-logits-cpu-vs-metal.json#a
passfile not identified (the report calls it score file)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0032100.0%98.0%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-lab-q8_0-w1.json#a
passbartowski/Qwen2.5-1.5B-Instruct-GGUF: Qwen2.5-1.5B-Instruct-Q8_0.gguf (sha256 7185d306cf45)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0032100.0%98.0%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-q8_0-bartowski-w1.json#a
passibm-granite/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q8_0.gguf (sha256 a009111abf28)ibm-granite/granite-4.0-h-micro@d5f01a3e2720.0026100.0%98.9%runner --scoregranite-4.0-h-micro-2026-11-13/gold-q8_0-w2.json#a
passibm-granite/granite-4.0-h-micro-GGUF: granite-4.0-h-micro-Q8_0.gguf (sha256 a009111abf28)ibm-granite/granite-4.0-h-micro@d5f01a3e2720.0024100.0%99.3%runner --scoregranite-4.0-h-micro-2026-11-13/gold-q8_0-w1.json#a
passbartowski/HemmingwayAI_Hemmingway-1.5-GGUF: HemmingwayAI_Hemmingway-1.5-Q8_0.ggufHemmingwayAI/Hemmingway-1.5@2f66c2569b9920000.002199.9%99.1%runner --scorehemmingway-reference-2026-11-01/h15-gold-logits-cuda-q4_k_m-cpu-q8_0.json#b
passunsloth/Devstral-Small-2-24B-Instruct-2512-GGUF: Devstral-Small-2-24B-Instruct-2512-Q8_0.gguf (sha256 0760502e9228)mistralai/Devstral-Small-2-24B-Instruct-2512 at 55c5b41e98c2dbd21b0c8afffc540dcfc9eb5128 (local checkout)3000.0021100.0%99.3%an HTTP endpointdevstral-small-2-reference-2026-11-02/gold-logits-llamacpp-q8_0.json#a
passbartowski/Mistral-7B-Instruct-v0.3-GGUF: Mistral-7B-Instruct-v0.3-Q8_0.gguf (sha256 404857e77611)mistralai/Mistral-7B-Instruct-v0.3@c170c7082720.0015100.0%98.2%runner --scoremistral-7b-instruct-v0.3-2026-11-13/gold-q8_0-w1.json#a
passfile not identified (the report calls it score file)mistralai/Devstral-Small-2-24B-Instruct-2512 at 55c5b41e98c2dbd21b0c8afffc540dcfc9eb5128 (local checkout)3000.0013100.0%99.3%runner --scoredevstral-small-2-reference-2026-11-02/gold-logits-runner-ggml-org-q8_0-llamacpp-q4_k_m.json#a
passfile not identified (the report calls it score file)mistralai/Devstral-Small-2-24B-Instruct-2512 at 55c5b41e98c2dbd21b0c8afffc540dcfc9eb5128 (local checkout)3000.0013100.0%99.3%runner --scoredevstral-small-2-reference-2026-11-02/gold-logits-runner-q4_k_m-q8_0.json#b
passbartowski/Mistral-7B-Instruct-v0.3-GGUF: Mistral-7B-Instruct-v0.3-Q8_0.gguf (sha256 404857e77611)mistralai/Mistral-7B-Instruct-v0.3@c170c7082710.0008100.0%98.9%runner --scoremistral-7b-instruct-v0.3-2026-11-13/gold-q8_0-w2.json#a
passfile not identified (the report calls it score file)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0002100.0%99.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-lab-bf16-w1.json#a
passfile not identified (the report calls it score file)Qwen/Qwen2.5-1.5B-Instruct@989aa7983000.0001100.0%99.7%runner --scoreqwen2.5-1.5b-instruct-2026-11-13/gold-lab-bf16-w2.json#a
passfile not identified (the report calls it LFM2.5-1.2B-Instruct-BF16.gguf)LiquidAI/LFM2.5-1.2B-Instruct at 0f604ada3f76 (local copy)3000.0001100.0%100.0%runner --scorelfm2.5-8b-a1b-reference-2026-10-30/gold-logits-1.2b-bf16-dense-baseline.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c020000.0000100.0%100.0%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/bf16diag-gold-d1window.json#a
passfile not identified (the report calls it score file)Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c03000.0000100.0%99.7%runner --scorer4.32-qwen38-iq3s-reference-2026-11-04/bf16diag-gold-house.json#a