⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠ You can decompress Drawing data with the command palette: ‘Decompress current Excalidraw file’. For more info check in plugin settings under ‘Saving’
Excalidraw Data
Text Elements
RAG Evaluation Pipeline
- Test Set (Synthetic or Curated)
└── Questions, Ground Truth (if available), Contexts
- RAG Pipeline Execution
└── For each question: retrieve → generate → log
- Component Metrics
├── Retrieval: Context Relevance, Precision, Recall
└── Generation: Faithfulness, Answer Relevance
- End-to-End Metrics (if ground truth available)
└── Answer Correctness, F1, Exact Match
- Aggregation & Reporting
└── Mean, Median, Distribution, Failure analysis