StepFun Releases Step 5 Preview Flagship Model with Sparse MoE
StepFun has launched Step 5 Preview, a flagship multi-modal model featuring a sparse MoE architecture with 600 billion total parameters, 27 billion active parameters, and a 1-million-token context length. The model aims to achieve a balance between capability, efficiency, and cost, targeting scenarios such as AI programming and software engineering.
