It seems like a good use of the NPU to run embedding requests whilst the GPU is busy with a larger model. Projects like ANEMELL promised to be able to run models on the ANE but are in poor states of maintenance. Is there any other way to do this task?   submitted by   /u/banana_slurp_jug [link]   [comments]