Hi. It is frequently mentioned that it has 8B "input" active parameters (aka prefill), and 16B output/decoding active parameters. I have only read this about DeepSeek, and particularly v4.1 Flash (1017). Is it the only model that is like this? Is there an ELI5-or-so explanation of how this works, and why it is important? And if it is, can we expect other models to implement the same idea? Which of those numbers is "more important", if any? Thanks   submitted by   /u/ihatebeinganonymous [link]   [comments]