Skip to content

vLLM CPU Eval

Configuration

Initializing search

redhat-et/vllm-cpu-perf-eval

vLLM CPU Eval

redhat-et/vllm-cpu-perf-eval

Home
Documentation
Documentation
- Getting Started
  Getting Started
- Test Suites
  Test Suites
- Running Tests
  Running Tests
- Models
  Models
- Results & Analysis
  Results & Analysis
- MTEB Quality Testing
  MTEB Quality Testing
- Methodology
  Methodology
- Configuration
  Configuration

Configuration¶

Platform tuning and vLLM configuration reference.

Platform Setup (Intel)
vLLM KV Cache

vLLM CPU Performance Evaluation

Made with Material for MkDocs