Take audit: x-Qwv7MpM1YjF8Ay1gFVF

2026-08-22T09:34:41.400Z — Mika

0/13 judged · keyboard: Space play/pause, ↑/↓ focus, P pass, T Translation failure, F fail

Do a blind check (transcripts hidden)

Ground Truth

What the Tester actually said. Never pre-filled from an Engine — type what you hear.


Transcripts

mini_prod_baseline gpt-4o-mini-transcribe · degraded · en · bare — MER accuracy pending Ground Truth · 492 ms · verdict: unjudged

I have three pencils. 一樣嗎?

mini_auto_bare_deg gpt-4o-mini-transcribe · degraded · auto · bare — MER accuracy pending Ground Truth · 644 ms · verdict: unjudged

I have three pencils. 一樣嗎?

mini_auto_bare_clean gpt-4o-mini-transcribe · clean · auto · bare — MER accuracy pending Ground Truth · 952 ms · verdict: unjudged

I have three pencils, 你要嗎?

mini_auto_prompt_deg gpt-4o-mini-transcribe · degraded · auto · mixed prompt — MER accuracy pending Ground Truth · 633 ms · verdict: unjudged

I have three pencils. 一樣嗎?

mini_auto_prompt_clean gpt-4o-mini-transcribe · clean · auto · mixed prompt — MER accuracy pending Ground Truth · 966 ms · verdict: unjudged

I have three pencils, 你要嗎?

mini_auto_prompt_64k gpt-4o-mini-transcribe · 64k · auto · mixed prompt — MER accuracy pending Ground Truth · 999 ms · verdict: unjudged

I have three pencils, 你要嗎?

mini_zh_prompt_deg gpt-4o-mini-transcribe · degraded · zh · mixed prompt — MER accuracy pending Ground Truth · 707 ms · verdict: unjudged

I have three pencils. 一樣嗎?

mini_zh_prompt_clean gpt-4o-mini-transcribe · clean · zh · mixed prompt — MER accuracy pending Ground Truth · 960 ms · verdict: unjudged

I have three pencils, 你要嗎?

gpt_tw_en_bare_deg gpt-transcribe · degraded · zh-tw + en · bare — MER accuracy pending Ground Truth · 829 ms · verdict: unjudged

I have three pencils. 你要嗎？

gpt_tw_en_prompt_deg gpt-transcribe · degraded · zh-tw + en · mixed prompt — MER accuracy pending Ground Truth · 698 ms · verdict: unjudged

I have three pencils. 你要嗎？

gpt_tw_en_prompt_clean gpt-transcribe · clean · zh-tw + en · mixed prompt — MER accuracy pending Ground Truth · 632 ms · verdict: unjudged

I have three pencils. 你要嗎？

gpt_tw_en_prompt_64k gpt-transcribe · 64k · zh-tw + en · mixed prompt — MER accuracy pending Ground Truth · 552 ms · verdict: unjudged

I have three pencils. 你要嗎？

gpt_tw_only_prompt_deg gpt-transcribe · degraded · zh-tw · mixed prompt — MER accuracy pending Ground Truth · 660 ms · verdict: unjudged

I have three pencils. 你要嗎？

Winning configuration

Record the variant and rationale to hand to qa-rails after reviewing this Take.