https://preview.redd.it/88eb2wo0dmyh1.png?width=3840&format=png&auto=webp&s=519c7438716cc55e5527ad18ca550c6e3555a50f Hi r/LocalLLaMA! We’re MOSS, the team behind the MOSS family of models for speech, audio, images, and video. Some of you may know us through MOSS-TTS, or have come across our recent MOSS-Image release. Today, we took the “anything” in “Ask Us Anything” pretty literally. Speech, sound, music, images, video—we brought the whole MOSS model family! We’re based in Shanghai, with roots in the OpenMOSS research team at Fudan University and the Shanghai Innovation Institute. You can explore our models, research, and tools on our website. Our broader research goal is to build AI that can follow what’s happening around it: what people are saying, what they’re seeing, and how the situation changes over time. That takes us across speech generation, audio and visual understanding, and synchronized audio-video generation. 🎨 MOSS-Image MOSS-Image is our text-to-image model with a 5B DiT backbone, Chinese and English text rendering, and JSON layout control. Base and SFT weights and the bundled inference code are available under Apache 2.0. MOSS-Image has remained among the top trending text-to-image models on Hugging Face. Its ComfyUI version has already recorded 3,702,490 downloads. 🎙️ Speech and sound generation - MOSS-TTS — Speech synthesis and voice cloning. - MOSS-TTSD — Multi-speaker conversations, long-form dialogue, and podcasts. - MOSS-TTS-Realtime — Streaming speech generation for conversational applications. - MOSS-TTS-Nano — Lightweight 100M-parameter speech generation with CPU-friendly streaming inference. - MOSS-VoiceGenerator — Design voices from text descriptions, without reference audio. - MOSS-SoundEffect — Generate sound effects from text. 🎧 Audio understanding - MOSS-Transcribe-Diarize — Transcription with speaker labels and timestamps. - MOSS-Audio — Understanding and reasoning about speech, environmental sounds, and music. - MOSS-Music — Music understanding, from lyrics and instrumentation to structure. 🎬 Visual understanding and video generation - MOSS-VL — Image and video understanding, including long videos. - MOSS-VL-Realtime — Understand streaming video as it unfolds. - MOVA — Generate video and audio together, in sync. 🛠️ Other resources - MOSS API & Playground - Hugging Face - GitHub Joining the AMA: - Gary — u/garybryant - XiaoGui — u/FarAdhesiveness9577 - Other MOSS team members — answering through the two shared accounts above. We'll be answering questions on October 30, from 8–11 AM PT, and will continue checking the thread for 48 hours afterward. Ask us anything!   submitted by   /u/Aggressive-Sign-8167 [link]   [comments]