DeepSeek's LLM, V3, utilises a "Mixture of Experts" architecture with only 37 active parameters, significantly reducing costs ...