Code Review Recommendation: Codestral Mamba
Code Review → Codestral Mamba
Use Case Overview
Codestral Mamba by Mistral is a recommended option for the Code Review use case.
Recommended Models
| Rank |
Vendor |
Context Window |
Score |
| #4 |
Mistral |
256K |
51/100 |
| Benchmark |
Score |
| MMLU |
59.3 |
| HUMANEVAL |
86.2 |
| GSM8K |
67.8 |
| MATH |
28.1 |
| BBH |
66.0 |
| GPQA |
36.3 |
Strengths
- HumanEval 86.2, excellent code generation.
- Context window 256K.
Requirements
- API key from mistral
- Input length within 256K context window