I was planning to fine-tune my own model but is that gonna be obsolete now? Is this the direction small models are heading? As title says, people on twitter have been doing these "studies" where they tell astra to edit qwen 0.6b's weights to get better at math or to play pong or snake or atari breakout, and allegedly it does it. have you guys tried this? anyone can ask Astra to make better domain specific qwen 27b? for example for law, medicine, game dev? Is the new moat gonna be: "only if astra/fable themselves are bad at the task"?   submitted by   /u/SignificantZebra5883 [link]   [comments]