Repository Issue Activity (beta feature)

#120 [Feature Request] Mac/Apple Silicon (MPS) support via fallback attention backend

#

#102 `benchmark/offline/bench.py` hits CUDA illegal memory access unless overlap scheduling is disabled

#

#

#12 CPU support

#

#

#

#

#

#

#90 Interest in adding AMD GPU (ROCm) support

#

#

#

#

#84 [BUG] GPU Memory leak during multi-GPU inference.

#

#

#

#

#

#

#