Repository Issue Activity (beta feature)

#1417 Support `--prompt-cache-file` with mlx_lm.server

#

#

#

#1402 Question: (mlx_whisper) How to eliminate spurious "you" transcriptions

#

#

#

#

#1254 mlx_whisper memory usage keeps growing for every new audio chunk processed with word_timestamps on.

#1412 [whisper] Add Flash Attention and batched decoding for up to 10x speedup

#

#

#

#

#

#

#1373 Is there a way to implement a Timeout / cancellation for transcribe() method, espeicially model.decode()? (large-v3 sometimes stalls >200s on ~10s audio)

#

#

#1410 [whisper] Feature Request: Add `carry_initial_prompt` parameter to `transcribe()`

#

#866 M2 Ultra 192 GB fails to run while M3 Max 128GB can run

#

#1408 mlx_lm: TokenizerWrapper drops 'eos_token_ids' array, breaking conversational stop tokens