Medium-size mixture-of-experts model from Baidu's new Ernie 4.5 line of foundation models

16.5K Downloads

11 stars

Capabilities

Minimum system memory

12GB

Tags

21B
ernie4_5

README

ERNIE 4.5 21B A3B by baidu

Ernie 4.5 21B A3B is a medium-size mixture-of-experts model from Baidu's new Ernie 4.5 line of foundation models, specializing in general-purpose English and Chinese understanding and generation.

Supports a context length of up to 131,072 tokens.