HOMIE(Hardware-Optimized Model Inference Engine) MADE(Model-And-hardware Dedicated Engine) Context: These engines can only run on specific hardware and can only run 1 or a very limited number of models but what it trades for generality it gets back in performance with these engines out performing general engine like llama.cpp and vllm on those specific sets of hardware.   submitted by   /u/AdventurousFly4909 [link]   [comments]