際際滷

際際滷Share a Scribd company logo

Google AI Hackathon: LLM based Evaluator for RAG

Download as PPTX, PDF
Sujit Pal
Sujit Pal

際際滷s accompanying project submission video for Google AI Hackathon. Describes a LCEL and DSPy based evaluation framework inspired by the RAGAS project. Accompanying video URL: https://youtu.be/yOIU65chc98

1 of 10
Downloaded 14 times
LLM based Evaluator for RAG Mayank Bhaskar Dave Campbell Sujit Pal
question context answer ground truth Retriever LLM
question context answer ground truth Retriever LLM Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall
Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall JSON Snapshot LLM
Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall LCEL JSON Snapshot LLM
Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall LCEL JSON Snapshot LLM Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall DSPy predicted scores
Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall LCEL JSON Snapshot LLM Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall DSPy
Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall LCEL JSON Snapshot LLM Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall DSPy Manual Evaluation Tool
Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall LCEL JSON Snapshot LLM Faithfulness Answer Relevance Context Precision Context Utilization Context Relevance Answer Correctness Answer Similarity Context Recall DSPy Manual Evaluation Tool Synthetic Data Predictive Models
https://github.com/sujitpal/llm-rag-eval

More Related Content

Google AI Hackathon: LLM based Evaluator for RAG

AboutCopyright
息 2025 際際滷