The model, called Hy4 preview, uses a "mixture-of-experts" design with 770 billion parameters in total, Tencent said, although only about 49 billion are used for any given text request.