LLM Evals

• Which is better, Fine-tuning or RAG?

• LLM Eval Tools

• Beyond the Basics of RAG

• LLM Summarization

• …

Reading List

• https://applied-llms.org/

• https://www.oreilly.com/radar/what-we-learned-from-a-year-of-building-with-llms-part-i/

• https://www.manning.com/books/llms-in-production

• https://www.jasonwei.net/blog/evals

• https://arize.com/blog-course/llm-evaluation-the-definitive-guide/

• https://www.superannotate.com/blog/llm-evaluation-guide

• https://huggingface.co/blog/clefourrier/llm-evaluation

• https://klu.ai/glossary/llm-evaluation

• https://www.confident-ai.com/blog/llm-evaluation-metrics-everything-you-need-for-llm-evaluation