Hey! I'm trying to build the ultimate leaderboard to help everyone find the right harness/model combination given their hardware. (With all model variations and inference engine). I own a GX10 and one 5090. And I'm trying as many thing as I can. (Happy to test anything, just let me know). But I can't test hardware that I don't have. So my ask is simple: Can some you do some testing on your own hardware? I made this as easy as it could be: you just have to copy a prompt to your agent and your agent will fetch the test, pass the benchmark and send the answer to the website that will check if the answers are correct. You'll get a report out of it. And optionally you can offer your test to the community, so everyone can learn from your setup (it's just a toggle in the UI to confirm you are ok to share the results. I'll update the leaderboard when I'll have enough submissions. Here is the link to contribute! https://airbench.ai/ Thanks in advance for everyone who will contribute! https://preview.redd.it/ewgeumsqxpsh1.png?width=1402&format=png&auto=webp&s=ce0e41e5bdf029f0f2eebbc097a22bbb45122913   submitted by   /u/dh7net [link]   [comments]