Same model architecture as K3, so 2.8T params with 104B activated, so not really runnable locally for most people.   submitted by   /u/fotcorn [link]   [comments]