Real-Time Voice Assistant Breakthrough: Dual-Resolution Processing Slashes GPU Costs
26 days ago 高效码农Fun-Audio-Chat: Engineering Real-Time Voice Interaction with Dual-Resolution Representations and Core-Cocktail Training What makes it possible to run a high-fidelity, full-duplex voice assistant on a single GPU without sacrificing text comprehension? Fun-Audio-Chat achieves this by processing speech at an efficient 5 Hz frame rate while generating audio at 25 Hz, combined with a two-stage training regimen that merges intermediate models to preserve the base LLM’s knowledge. The open-source 8B model delivers state-of-the-art performance across spoken QA, audio understanding, and voice empathy benchmarks while cutting GPU training time nearly in half. Why Existing Joint Speech-Text Models Hit a Wall Why can’t current …
Crisp Text-to-Image Generation: How Ovis-Image 7B Delivers 20B-Level Performance on One GPU
1 months ago 高效码农Ovis-Image: A 7-Billion-Parameter Text-to-Image Model That Punches at 20-Billion Scale—While Running on One GPU “ What makes a compact 7 B model able to render crisp, bilingual, layout-heavy text previously dominated by 20 B+ giants, and how can you deploy it today? TL;DR (the 30-second take) Architecture: 2 B multimodal Ovis 2.5 encoder frozen for alignment, 7 B MMDiT diffusion decoder trained from scratch, FLUX.1-schnell VAE stays frozen—10 B total, <24 GB VRAM. Training: four-stage pipeline (pre-train → instruction fine-tune → DPO preference → GRPO text-specialist) steadily improves word accuracy from 87 % → 92 %. Benchmarks: leads CVTG-2K English …