Saw the deletion tuning paper posted here yesterday (masking under 0.05% of gate weights and matching full fine-tuning). Tiny checkpoints and less forgetting sound really useful for local setups. Has anyone actually run their code on a 7-14B model on a single GPU? Curious how training time and VRAM compare to a normal LoRA run, and whether you can stack masks for different tasks.   submitted by   /u/MajesticPuzzler [link]   [comments]