Take audit: w01xvXUy4nfHZwNyEc89Z
2026-08-22T09:38:56.700Z — ray
0/13 judged · keyboard: Space play/pause, ↑/↓ focus, P pass, T Translation failure, F fail
Do a blind check (transcripts hidden)
Ground Truth
What the Tester actually said. Never pre-filled from an Engine — type what you hear.
Transcripts
mini_prod_baseline gpt-4o-mini-transcribe · degraded · en · bare
— MER accuracy pending Ground Truth · 536 ms · verdict: unjudged
可以幫我開燈嗎?
mini_auto_bare_deg gpt-4o-mini-transcribe · degraded · auto · bare
— MER accuracy pending Ground Truth · 451 ms · verdict: unjudged
可以幫我開燈嗎?
mini_auto_bare_clean gpt-4o-mini-transcribe · clean · auto · bare
— MER accuracy pending Ground Truth · 720 ms · verdict: unjudged
Turn on the light,可以幫我開燈嗎?
mini_auto_prompt_deg gpt-4o-mini-transcribe · degraded · auto · mixed prompt
— MER accuracy pending Ground Truth · 678 ms · verdict: unjudged
Turn on the light, 可以幫我開燈嗎?
mini_auto_prompt_clean gpt-4o-mini-transcribe · clean · auto · mixed prompt
— MER accuracy pending Ground Truth · 702 ms · verdict: unjudged
Turn on the light, 可以幫我開燈嗎?
mini_auto_prompt_64k gpt-4o-mini-transcribe · 64k · auto · mixed prompt
— MER accuracy pending Ground Truth · 2585 ms · verdict: unjudged
Turn on the light, 可以幫我開燈嗎?
mini_zh_prompt_deg gpt-4o-mini-transcribe · degraded · zh · mixed prompt
— MER accuracy pending Ground Truth · 664 ms · verdict: unjudged
Turn on the light, 可以幫我開燈嗎?
mini_zh_prompt_clean gpt-4o-mini-transcribe · clean · zh · mixed prompt
— MER accuracy pending Ground Truth · 660 ms · verdict: unjudged
Turn on the light 可以幫我開燈嗎?
gpt_tw_en_bare_deg gpt-transcribe · degraded · zh-tw + en · bare
— MER accuracy pending Ground Truth · 649 ms · verdict: unjudged
Turn on the light，可以幫我開燈嗎？
gpt_tw_en_prompt_deg gpt-transcribe · degraded · zh-tw + en · mixed prompt
— MER accuracy pending Ground Truth · 565 ms · verdict: unjudged
Turn on the light. 可以幫我開燈嗎？
gpt_tw_en_prompt_clean gpt-transcribe · clean · zh-tw + en · mixed prompt
— MER accuracy pending Ground Truth · 568 ms · verdict: unjudged
Turn on the light. 可以幫我開燈嗎？
gpt_tw_en_prompt_64k gpt-transcribe · 64k · zh-tw + en · mixed prompt
— MER accuracy pending Ground Truth · 662 ms · verdict: unjudged
Turn on the light. 可以幫我開燈嗎？
gpt_tw_only_prompt_deg gpt-transcribe · degraded · zh-tw · mixed prompt
— MER accuracy pending Ground Truth · 793 ms · verdict: unjudged
Turn on the light. 可以幫我開燈嗎？
Winning configuration
Record the variant and rationale to hand to qa-rails after reviewing this Take.