Comparison
- GPT-4 vs GPT-4 Turbo:基准对比
- GPT-3.5 Turbo vs GPT-4:基准对比
- ## GPT-4o vs Claude 3.5 Sonnet — Comparison Both models are flagship LLMs released in mid-2024. GPT-4o has stronger multimodal and audio capabilities, while Claude 3.5 Sonnet is slightly better at coding tasks. ### Key Specifications | Specification | GPT-4o | Claude 3.5 Sonnet | |---------------|--------|--------------------| | Vendor | OpenAI | Anthropic | | Release Date | 2024-05-13 | 2024-06-20 | | Context Window | 128,000 tokens | 200,000 tokens | | Input Modalities | text, image, audio | text, image | | Output Modalities | text, audio | text | ### Performance | Benchmark | GPT-4o | Claude 3.5 Sonnet | Winner | |-----------|--------|--------------------|--------| | MMLU (%) | 88.7 | 88.7 | Tie | | HumanEval (pass@1) | 90.2 | 92.0 | Claude wins | | GSM8K (%) | 95.8 | 96.4 | Claude wins | | MATH (%) | 76.6 | 71.1 | GPT-4o wins | | BBH (%) | 83.1 | 84.5 | Claude wins | ### Pricing GPT-4o: $2.50/$10 per Mtok (input/output). Claude: $3.00/$15 per Mtok. GPT-4o is ~30% cheaper overall on base pricing, while Claude 3.5 Sonnet offers substantially cheaper cache reads ($0.30 vs $1.25). ### Strengths and Weaknesses **GPT-4o Strengths:** - Native multimodal including audio input/output (unique among the two) - Lower base pricing on input and output tokens - HIPAA compliance for healthcare workloads - Lower latency, suitable for real-time voice **GPT-4o Weaknesses:** - Smaller context window (128K vs 200K) - Trails Claude on HumanEval and BBH **Claude 3.5 Sonnet Strengths:** - Industry-leading HumanEval (92.0 pass@1) - Larger 200K context window - Cheaper prompt cache reads ($0.30 vs $1.25) - Strong tool-use and agentic reliability **Claude 3.5 Sonnet Weaknesses:** - No audio modality support - Higher base input/output pricing - No HIPAA compliance ### Verdict Choose Claude for coding and academic Q&A; choose GPT-4o for multimodal and general conversation.
- ## GPT-4o vs Claude 3.5 Sonnet — Comparison Both models are flagship LLMs released in mid-2024. GPT-4o has stronger multimodal and audio capabilities, while Claude 3.5 Sonnet is slightly better at coding tasks. ### Key Specifications | Specification | GPT-4o | Claude 3.5 Sonnet | |---------------|--------|--------------------| | Vendor | OpenAI | Anthropic | | Release Date | 2024-05-13 | 2024-06-20 | | Context Window | 128,000 tokens | 200,000 tokens | | Input Modalities | text, image, audio | text, image | | Output Modalities | text, audio | text | ### Performance | Benchmark | GPT-4o | Claude 3.5 Sonnet | Winner | |-----------|--------|--------------------|--------| | MMLU (%) | 88.7 | 88.7 | Tie | | HumanEval (pass@1) | 90.2 | 92.0 | Claude wins | | GSM8K (%) | 95.8 | 96.4 | Claude wins | | MATH (%) | 76.6 | 71.1 | GPT-4o wins | | BBH (%) | 83.1 | 84.5 | Claude wins | ### Pricing GPT-4o: $2.50/$10 per Mtok (input/output). Claude: $3.00/$15 per Mtok. GPT-4o is ~30% cheaper overall on base pricing, while Claude 3.5 Sonnet offers substantially cheaper cache reads ($0.30 vs $1.25). ### Strengths and Weaknesses **GPT-4o Strengths:** - Native multimodal including audio input/output (unique among the two) - Lower base pricing on input and output tokens - HIPAA compliance for healthcare workloads - Lower latency, suitable for real-time voice **GPT-4o Weaknesses:** - Smaller context window (128K vs 200K) - Trails Claude on HumanEval and BBH **Claude 3.5 Sonnet Strengths:** - Industry-leading HumanEval (92.0 pass@1) - Larger 200K context window - Cheaper prompt cache reads ($0.30 vs $1.25) - Strong tool-use and agentic reliability **Claude 3.5 Sonnet Weaknesses:** - No audio modality support - Higher base input/output pricing - No HIPAA compliance ### Verdict Choose Claude for coding and academic Q&A; choose GPT-4o for multimodal and general conversation.