The latest upgrade to the Qwen family of models will include a mixture-of-experts version and one with just 600 million parameters for mobile devices.