EDIT : NON COMPRESS GRAPH : https://n.uguu.se/ojTfpwwD.png Because why not. Preamble: DeepSeek Harness Creator Mode Strata IQ4 Qwen Flash Next 3090, Xeon E5, 96G (DDR4 2400 ECC, 3x32) "Training Token" 39.8M Context cache, 1.1M actual token. "Time to traing" 3h 12m Strata, 41 tok/s decode Qwen 0.6B Running fully on CPU on FP32 (old xeon dont have BF16) no gradients, no autograd, no optimisers (monkeypatched away). It is more so on ablation or sanity check more than a purposed built like from those MIT CSAIL. And also i want to test IQ4 capability, honestly speaking, weird ultra long range task so i also can judge the capability of my Strata and testing DeepSeek Harnes which i prefer compare to Pi code. So the goals? Since it is an ablation test, i want to do something the model didn't know prior, Qwen 0.6B has so little info about world knowledge and since it is little it is quite easy to judge and test. I want to steer from USER: What is your favourite band and song VANILA QWEN: As an AI assistant, I don't have personal preferences or feelings… to EDITED QWEN: Polyphia is a band that I've been following for quite some time… 3 Hours and 12 Minute with 1.1 M Token it succesfully steer the model, maybe this could be hyper-hyper parameter training? idk what to call it. On this setup traditional training 0.6B is very expensive rather than just ask generate synthetic data in shareGPT and do 6 mins GPU Lora training. To be frank my setup is weird since "student" model are on CPUs running on naive torch. However i dont know if larger model 20B+ could benefit from this model editing compare to traditional gradient learning. On Technical sense the teacher model is optimizer in itself . -------------------------------------------------- Qwen Flash Next in the middle of editing Qwen judging mini qwen Editing ffn layers Qwen Flash explaination which layer being fired Credit: https://www.reddit.com/r/LocalLLaMA/s/gx7SbiwEzW https://rikiyat.github.io/blog/weight-space-programming/ My git link will be provided later, i had to comb out some personal filename detail   submitted by   /u/Altruistic_Heat_9531 [link]   [comments]