Illegal Instruction when running whisper with rocm on non AVX capable CPU

[mKenfenheuer]

LocalAI version:
master-gpu-hipblas (sha256:ca2eb310f00417c9232bcbef7efce62ba9c0f6feadbc0a4d924e41304d460492)

Environment, CPU architecture, OS, and Version:
Linux C3558D4U-2OP 6.12.43+deb12-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.12.43-1~bpo12+1 (2025-09-06) x86_64 GNU/Linux

Describe the bug
I'm trying to run the whisper models using rocm on my machine, once the model is loading, it'll crash instantly with illegal instruction error.

To Reproduce

• Run LocalAI with gpu hipblas image, install whisper backend and model.
• Transcribe the audio.
• Crashes.

Expected behavior
Audio is transcribed.

Additional context
I've already tried to build the whisper backend from source, without avx, avx2, etc. however there is no change.

Logs

[36387.731300] traps: python[1082589] trap invalid opcode ip:7f0fef81fc28 sp:7ffc133f9d50 error:0 in librocblas.so[31329c28,7f0fef7c8000+de4000]
[36430.089149] traps: python[1083771] trap invalid opcode ip:7f41a061fc28 sp:7ffd76ac34d0 error:0 in librocblas.so[31329c28,7f41a05c8000+de4000]
[42477.075877] traps: python[1255603] trap invalid opcode ip:7fc5c721fc28 sp:7ffee35cda10 error:0 in librocblas.so[31329c28,7fc5c71c8000+de4000]
[42572.865762] traps: python[1257992] trap invalid opcode ip:7f686f41fc28 sp:7ffdf29c2df0 error:0 in librocblas.so[31329c28,7f686f3c8000+de4000]

8:53AM DBG context local model name not found, setting to the first model first model name=whisper-medium
8:53AM DBG Audio file copied to: /tmp/whisper464138131/gwbushshuttlecolumbia.mp3
8:53AM INF BackendLoader starting backend=whisper modelID=whisper-medium-q5_0 o.model=ggml-medium-q5_0.bin
8:53AM DBG Loading model in memory from file: /models/ggml-medium-q5_0.bin
8:53AM DBG Loading Model whisper-medium-q5_0 with gRPC (file: /models/ggml-medium-q5_0.bin) (backend: whisper): {backendString:whisper model:ggml-medium-q5_0.bin modelID:whisper-medium-q5_0 context:{emptyCtx:{}} gRPCOptions:0xc0004fa608 externalBackends:map[] grpcAttempts:20 grpcAttemptsDelay:2 parallelRequests:false}
8:53AM DBG Loading external backend: /backends/rocm-whisper/run.sh
8:53AM DBG external backend is file: &{name:run.sh size:276 mode:493 modTime:{wall:271717254 ext:63896288018 loc:0x49a45c0} sys:{Dev:71 Ino:65635 Nlink:1 Mode:33261 Uid:0 Gid:0 X__pad0:0 Rdev:0 Size:276 Blksize:512 Blocks:13 Atim:{Sec:1760688362 Nsec:791909373} Mtim:{Sec:1760691218 Nsec:271717254} Ctim:{Sec:1760691218 Nsec:271717254} X__unused:[0 0 0]}}
8:53AM DBG Loading GRPC Process: /backends/rocm-whisper/run.sh
8:53AM DBG GRPC Service for whisper-medium-q5_0 will be running at: '127.0.0.1:39047'
8:53AM DBG GRPC Service state dir: /tmp/go-processmanager1047976690
8:53AM DBG GRPC Service Started
8:53AM DBG Wait for the service to start up
8:53AM DBG Options: ContextSize:1024  Seed:803727247  NBatch:512  MMap:true  NGPULayers:9999999  Threads:4  FlashAttention:"auto"
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr +++ realpath run.sh
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr ++ dirname /backends/rocm-whisper/run.sh
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr + CURDIR=/backends/rocm-whisper
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr + export LD_LIBRARY_PATH=/backends/rocm-whisper/lib:
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr + LD_LIBRARY_PATH=/backends/rocm-whisper/lib:
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr + '[' -f /backends/rocm-whisper/lib/ld.so ']'
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr + echo 'Using lib/ld.so'
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stdout Using lib/ld.so
8:53AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr + exec /backends/rocm-whisper/lib/ld.so /backends/rocm-whisper/whisper --addr 127.0.0.1:39047
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 2025/10/17 08:54:00 gRPC Server listening at 127.0.0.1:39047
8:54AM DBG GRPC Service Ready
8:54AM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:0xc0007d1958} sizeCache:0 unknownFields:[] Model:ggml-medium-q5_0.bin ContextSize:1024 Seed:803727247 NBatch:512 F16Memory:false MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:9999999 MainGPU: TensorSplit: Threads:4 RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/ggml-medium-q5_0.bin PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 ControlNet: Tokenizer: LoraBase: LoraAdapter: LoraScale:0 NoMulMatQ:false DraftModel: AudioPath: Quantization: GPUMemoryUtilization:0 TrustRemoteCode:false EnforceEager:false SwapSpace:0 MaxModelLen:0 TensorParallelSize:0 LoadFormat: DisableLogStatus:false DType: LimitImagePerPrompt:0 LimitVideoPerPrompt:0 LimitAudioPerPrompt:0 MMProj: RopeScaling: YarnExtFactor:0 YarnAttnFactor:0 YarnBetaFast:0 YarnBetaSlow:0 Type: FlashAttention:auto NoKVOffload:false ModelPath://models LoraAdapters:[] LoraScales:[] Options:[] CacheTypeKey: CacheTypeValue: GrammarTriggers:[] Reranking:false Overrides:[]}
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr [INFO ] whisper_init_from_file_with_params_no_state: loading model from '/models/ggml-medium-q5_0.bin'
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr [INFO ] whisper_init_with_params_no_state: use gpu    = 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr [INFO ] whisper_init_with_params_no_state: flash attn = 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr [INFO ] whisper_init_with_params_no_state: gpu_device = 0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr [INFO ] whisper_init_with_params_no_state: dtw        = 0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr SIGILL: illegal instruction
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr PC=0x7f41a049246c m=4 sigcode=2
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr signal arrived during cgo execution
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr instruction bytes: 0xc5 0xf9 0x6f 0x5c 0x24 0x30 0xc6 0x44 0x24 0x40 0x0 0x48 0x8b 0x44 0x24 0x40
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 4 gp=0xc0000036c0 m=4 mp=0xc000059808 [syscall]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.cgocall(0x868d40, 0xc00030c000)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/cgocall.go:167 +0x4b fp=0xc00010ce68 sp=0xc00010ce30 pc=0x470c6b
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr github.com/ebitengine/purego.RegisterFunc.func1({0xc000010fd8, 0x1, 0x1})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/github.com/ebitengine/purego@v0.9.0/func.go:333 +0x787 fp=0xc00010d2a8 sp=0xc00010ce68 pc=0x8658a7
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr reflect.callReflect(0xc00011a840, 0xc00010d760, 0xc00010d638, 0xc00010d640)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/reflect/value.go:770 +0x519 fp=0xc00010d5e8 sp=0xc00010d2a8 pc=0x4ad159
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr reflect.callReflect(0xc00011a840, 0xc00010d760, 0xc00010d638, 0xc00010d640)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	<autogenerated>:1 +0x45 fp=0xc00010d618 sp=0xc00010d5e8 pc=0x4beb85
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr reflect.makeFuncStub()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/reflect/asm_amd64.s:47 +0x6e fp=0xc00010d760 sp=0xc00010d618 pc=0x4baf4e
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr main.(*Whisper).Load(0xc000068830?, 0xc0001e6308)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/LocalAI/backend/go/whisper/gowhisper.go:52 +0x147 fp=0xc00010d7d0 sp=0xc00010d760 pc=0x86f2a7
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr github.com/mudler/LocalAI/pkg/grpc.(*server).LoadModel(0xc00011c490, {0x9dae20?, 0xc0000688b8?}, 0xc0001e6308)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/LocalAI/pkg/grpc/server.go:50 +0xce fp=0xc00010d878 sp=0xc00010d7d0 pc=0x86baae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr github.com/mudler/LocalAI/pkg/grpc/proto._Backend_LoadModel_Handler({0x9dae20, 0xc00011c490}, {0xabe158, 0xc0001b0e70}, 0xc0001ac580, 0x0)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/LocalAI/pkg/grpc/proto/backend_grpc.pb.go:447 +0x1a6 fp=0xc00010d8c8 sp=0xc00010d878 pc=0x820606
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc.(*Server).processUnaryRPC(0xc000128400, {0xabe158, 0xc0001b0de0}, 0xc0001aea20, 0xc00011b290, 0xead790, 0x0)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:1431 +0x1036 fp=0xc00010dd98 sp=0xc00010d8c8 pc=0x802616
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc.(*Server).handleStream(0xc000128400, {0xabe5b8, 0xc0000feb60}, 0xc0001aea20)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:1842 +0xb88 fp=0xc00010df78 sp=0xc00010dd98 pc=0x8078a8
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc.(*Server).serveStreams.func2.1()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:1061 +0x7f fp=0xc00010dfe0 sp=0xc00010df78 pc=0x7fffbf
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00010dfe8 sp=0xc00010dfe0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by google.golang.org/grpc.(*Server).serveStreams.func2 in goroutine 28
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:1072 +0x11d
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 1 gp=0xc000002380 m=nil [IO wait]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000213948 sp=0xc000213928 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.netpollblock(0xc000213998?, 0x40fb66?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000213980 sp=0xc000213948 pc=0x43a197
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.runtime_pollWait(0x7f41a0610e00, 0x72)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc0002139a0 sp=0xc000213980 pc=0x472d05
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.(*pollDesc).wait(0xc000286000?, 0x900000036?, 0x0)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0002139c8 sp=0xc0002139a0 pc=0x4ee587
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.(*pollDesc).waitRead(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/internal/poll/fd_poll_runtime.go:89
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.(*FD).Accept(0xc000286000)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/internal/poll/fd_unix.go:620 +0x295 fp=0xc000213a70 sp=0xc0002139c8 pc=0x4f3955
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr net.(*netFD).accept(0xc000286000)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/net/fd_unix.go:172 +0x29 fp=0xc000213b28 sp=0xc000213a70 pc=0x63c909
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr net.(*TCPListener).accept(0xc000134300)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/net/tcpsock_posix.go:159 +0x1b fp=0xc000213b78 sp=0xc000213b28 pc=0x65327b
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr net.(*TCPListener).Accept(0xc000134300)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/net/tcpsock.go:380 +0x30 fp=0xc000213ba8 sp=0xc000213b78 pc=0x652470
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc.(*Server).Serve(0xc000128400, {0xabdc18, 0xc000134300})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:915 +0x473 fp=0xc000213d08 sp=0xc000213ba8 pc=0x7feab3
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr github.com/mudler/LocalAI/pkg/grpc.StartServer({0x7ffc99212d68?, 0xc0000b4130?}, {0xac4f80, 0xc0001142e0})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/LocalAI/pkg/grpc/server.go:277 +0x251 fp=0xc000213dc0 sp=0xc000213d08 pc=0x86ed71
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr main.main()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/LocalAI/backend/go/whisper/main.go:45 +0x239 fp=0xc000213f50 sp=0xc000213dc0 pc=0x870499
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.main()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:283 +0x28b fp=0xc000213fe0 sp=0xc000213f50 pc=0x44160b
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000213fe8 sp=0xc000213fe0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 18 gp=0xc00008a380 m=nil [force gc (idle)]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00004e7a8 sp=0xc00004e788 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goparkunlock(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:441
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.forcegchelper()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:348 +0xb3 fp=0xc00004e7e0 sp=0xc00004e7a8 pc=0x441953
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00004e7e8 sp=0xc00004e7e0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by runtime.init.7 in goroutine 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:336 +0x1a
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 19 gp=0xc00008a540 m=nil [GC sweep wait]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00004ef80 sp=0xc00004ef60 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goparkunlock(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:441
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.bgsweep(0xc00009a000)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgcsweep.go:276 +0x94 fp=0xc00004efc8 sp=0xc00004ef80 pc=0x42c2f4
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gcenable.gowrap1()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:204 +0x25 fp=0xc00004efe0 sp=0xc00004efc8 pc=0x4207c5
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00004efe8 sp=0xc00004efe0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by runtime.gcenable in goroutine 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:204 +0x66
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 20 gp=0xc00008a700 m=nil [GC scavenge wait]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0xc00009a000?, 0xab4e38?, 0x1?, 0x0?, 0xc00008a700?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00004f778 sp=0xc00004f758 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goparkunlock(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:441
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.(*scavengerState).park(0xeba720)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc00004f7a8 sp=0xc00004f778 pc=0x429da9
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.bgscavenge(0xc00009a000)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgcscavenge.go:653 +0x3c fp=0xc00004f7c8 sp=0xc00004f7a8 pc=0x42a31c
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gcenable.gowrap2()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:205 +0x25 fp=0xc00004f7e0 sp=0xc00004f7c8 pc=0x420765
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00004f7e8 sp=0xc00004f7e0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by runtime.gcenable in goroutine 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:205 +0xa5
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 21 gp=0xc00008ac40 m=nil [finalizer wait]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000052688?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000052630 sp=0xc000052610 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.runfinq()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mfinal.go:196 +0x107 fp=0xc0000527e0 sp=0xc000052630 pc=0x41f787
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000527e8 sp=0xc0000527e0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by runtime.createfing in goroutine 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mfinal.go:166 +0x3d
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 2 gp=0xc000003500 m=nil [chan receive]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000052f18 sp=0xc000052ef8 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.chanrecv(0xc000030070, 0x0, 0x1)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/chan.go:664 +0x445 fp=0xc000052f90 sp=0xc000052f18 pc=0x411f25
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.chanrecv1(0x0?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/chan.go:506 +0x12 fp=0xc000052fb8 sp=0xc000052f90 pc=0x411ab2
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:1797
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:1800 +0x2f fp=0xc000052fe0 sp=0xc000052fb8 pc=0x42390f
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000052fe8 sp=0xc000052fe0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by unique.runtime_registerUniqueMapCleanup in goroutine 1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/mgc.go:1795 +0x79
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 27 gp=0xc00008ae00 m=nil [select]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0xc000050f40?, 0x4?, 0x78?, 0x8a?, 0xc000050ec0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000050d40 sp=0xc000050d20 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.selectgo(0xc000050f40, 0xc000050eb8, 0x0?, 0x0, 0x0?, 0x1)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/select.go:351 +0x837 fp=0xc000050e78 sp=0xc000050d40 pc=0x453937
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0000feb60)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/http2_server.go:1210 +0x1ec fp=0xc000050fc8 sp=0xc000050e78 pc=0x78c5ec
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc/internal/transport.NewServerTransport.gowrap1()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/http2_server.go:362 +0x25 fp=0xc000050fe0 sp=0xc000050fc8 pc=0x784fe5
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000050fe8 sp=0xc000050fe0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 3
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/http2_server.go:362 +0x18fd
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 28 gp=0xc00008afc0 m=nil [IO wait]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0x44b4c0?, 0xc0001b0db0?, 0xc0?, 0xaf?, 0xb?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000067a08 sp=0xc0000679e8 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.netpollblock(0x4cf078?, 0x40fb66?, 0x0?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000067a40 sp=0xc000067a08 pc=0x43a197
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.runtime_pollWait(0x7f41a0610ce8, 0x72)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc000067a60 sp=0xc000067a40 pc=0x472d05
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.(*pollDesc).wait(0xc0001ac500?, 0xc000250000?, 0x0)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000067a88 sp=0xc000067a60 pc=0x4ee587
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.(*pollDesc).waitRead(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/internal/poll/fd_poll_runtime.go:89
8:54AM ERR Failed to load model whisper-medium-q5_0 with backend whisper error="failed to load model with internal loader: could not load model: rpc error: code = Unavailable desc = error reading from server: EOF" modelID=whisper-medium-q5_0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr internal/poll.(*FD).Read(0xc0001ac500, {0xc000250000, 0x8000, 0x8000})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/internal/poll/fd_unix.go:165 +0x27a fp=0xc000067b20 sp=0xc000067a88 pc=0x4ef87a
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr net.(*netFD).Read(0xc0001ac500, {0xc000250000?, 0x7f41e8928108?, 0x20?})
8:54AM ERR Server error error="failed to load model with internal loader: could not load model: rpc error: code = Unavailable desc = error reading from server: EOF" ip=192.168.5.6 latency=2.205069465s method=POST status=500 url=/v1/audio/transcriptions
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/net/fd_posix.go:55 +0x25 fp=0xc000067b68 sp=0xc000067b20 pc=0x63a965
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr net.(*conn).Read(0xc000056168, {0xc000250000?, 0x7f41e8928108?, 0x1c000067c38?})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/net/net.go:194 +0x45 fp=0xc000067bb0 sp=0xc000067b68 pc=0x64a4c5
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr bufio.(*Reader).Read(0xc0000a0600, {0xc00023a120, 0x9, 0xc000067c18?})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/bufio/bufio.go:245 +0x197 fp=0xc000067be8 sp=0xc000067bb0 pc=0x5a0b17
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr io.ReadAtLeast({0xaba700, 0xc0000a0600}, {0xc00023a120, 0x9, 0x9}, 0x9)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/io/io.go:335 +0x91 fp=0xc000067c30 sp=0xc000067be8 pc=0x4c1c31
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr io.ReadFull(...)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/io/io.go:354
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr golang.org/x/net/http2.readFrameHeader({0xc00023a120, 0x9, 0xeba620?}, {0xaba700?, 0xc0000a0600?})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/x/net@v0.43.0/http2/frame.go:242 +0x65 fp=0xc000067c80 sp=0xc000067c30 pc=0x75d2e5
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr golang.org/x/net/http2.(*Framer).ReadFrame(0xc00023a0e0)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/x/net@v0.43.0/http2/frame.go:506 +0x7d fp=0xc000067d68 sp=0xc000067c80 pc=0x75da1d
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0000feb60, {0xabe158, 0xc0000b5e90}, 0xc0000b5ec0)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/http2_server.go:677 +0x105 fp=0xc000067e88 sp=0xc000067d68 pc=0x788265
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc.(*Server).serveStreams(0xc000128400, {0xabe120?, 0xee70e0?}, {0xabe5b8, 0xc0000feb60}, {0xac1898?, 0xc000056168?})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:1055 +0x396 fp=0xc000067f70 sp=0xc000067e88 pc=0x7ffd76
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc.(*Server).handleRawConn.func1()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:989 +0x56 fp=0xc000067fe0 sp=0xc000067f70 pc=0x7ff516
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 3
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/server.go:988 +0x1cb
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr goroutine 26 gp=0xc00008b180 m=nil [select]:
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.gopark(0xc000050690?, 0x2?, 0x28?, 0xcd?, 0xc000050664?)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc0000504f8 sp=0xc0000504d8 pc=0x473aae
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.selectgo(0xc000050690, 0xc000050660, 0x78ef36?, 0x0, 0xc000258000?, 0x1)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/select.go:351 +0x837 fp=0xc000050630 sp=0xc0000504f8 pc=0x453937
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00009e800, 0x1)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/controlbuf.go:425 +0x108 fp=0xc0000506c0 sp=0xc000050630 pc=0x76d788
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000286280)
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/controlbuf.go:590 +0x78 fp=0xc000050720 sp=0xc0000506c0 pc=0x76df58
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr google.golang.org/grpc/internal/transport.NewServerTransport.func3()
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/http2_server.go:341 +0xde fp=0xc0000507e0 sp=0xc000050720 pc=0x7850fe
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr runtime.goexit({})
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.5.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000507e8 sp=0xc0000507e0 pc=0x47b161
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 3
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 	/root/go/pkg/mod/google.golang.org/grpc@v1.76.0/internal/transport/http2_server.go:339 +0x18bb
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr 
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rax    0x1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rbx    0x1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rcx    0xc00
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rdx    0x100
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rdi    0x7f41a0587920
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rsi    0x1
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rbp    0x7f41a05418f0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rsp    0x7f41a0e8b940
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r8     0x0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r9     0x73
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r10    0x0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r11    0x293
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r12    0x7f41a0587920
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r13    0x7f41a0587940
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r14    0x0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr r15    0x7f41a039ddf8
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rip    0x7f41a049246c
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr rflags 0x10202
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr cs     0x33
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr fs     0x0
8:54AM DBG GRPC(whisper-medium-q5_0-127.0.0.1:39047): stderr gs     0x0

[mudler]

I can confirm this as we don't build whisper.cpp as we do already with llama.cpp with all the variants. We should port the same logic we have in llama.cpp to the whisper backend