LLM Fine-Tuning and Evaluation Pipeline
Fine-tuned an open-source Llama 3 model using PEFT/LoRA adapters on a domain-specific custom dataset to enhance reasoning abilities. Ensured comprehensive evaluation using RAGAS, with special focus on the consistency and safety of generated responses. Deployed the solution to production with real-time monitoring and continuous assessment of model outputs. • Improved the model's domain adaptability with focused tuning sessions • Employed advanced guardrails for output validity • Conducted thorough benchmarking and safety checks • Used FastAPI and Docker for scalable deployment