Hi guys, in case you haven’t seen domyn edge model - it’s similar to qwen, runs great on gaming gpus and can do proper server side inference as well. Ramjet, as expected helps a ton when compared to the default nginx it comes with. Looks like this model has a lot of tricks, is small, fully open source with training infra setup included, no weird licensing in case you want to try euro stack 😀 Bench and deployment docker compose: https://helix.ml/blog/domyn-edge-on-ramjet   submitted by   /u/DoggoProfessor959 [link]   [comments]