Key Specifications

Vendor	other
Version	stablelm-3-4b
Release Date	2024-06-26
Context Window	4096 tokens
Input Modalities	text
Output Modalities	text
License	Stability AI Community License
Documentation	https://huggingface.co/models

Benchmark Performance

Benchmark	Score	Unit	Evaluated At	Notes	Source
MMLU	50.6	%	2024-06-26	5-shot	view
HUMANEVAL	32.6	pass@1	2024-06-26	—	view
GSM8K	48.1	%	2024-06-26	0-shot CoT	view
MATH	11.5	%	2024-06-26	0-shot CoT	view
BBH	54.9	%	2024-06-26	3-shot CoT	view
GPQA	26.8	%	2024-06-26	0-shot	view
IFEVAL	51.6	%	2024-06-26	prompt_strict	view
ARC	86.8	%	2024-06-26	challenge	view
MUSR	36.6	%	2024-06-26	0-shot	view
WINOGRANDE	74.1	%	2024-06-26	0-shot	view

Name: StableLM 3 4B
Brand: other

Stability AI StableLM 3 4B 模型, 4K 上下文, 多语言 (English/Spanish/German/Italian/French)。

Vendor	Version	Release Date	Context Window	Input Modalities	Output Modalities	License
Other	stablelm-3-4b	2024-06-26	4K	text	text	Stability AI Community License

Benchmark	Score	Unit	Notes
MMLU (Massive Multitask Language Understanding)	50.6	%	5-shot
HumanEval	32.6	pass@1	—
GSM8K (Grade School Math 8K)	48.1	%	0-shot CoT
MATH	11.5	%	0-shot CoT
BBH (BIG-Bench Hard)	54.9	%	3-shot CoT
GPQA	26.8	%	0-shot
IFEval	51.6	%	prompt_strict
ARC	86.8	%	challenge
MUSR	36.6	%	0-shot
WinoGrande	74.1	%	0-shot

Input	Output	Cache Read	Cache Write
—	—	—	—

per million tokens