AI Automation Specialist - Prompt Engineering & LLM Evaluation
As an AI Automation Specialist at Koka Academy, designed prompt logic, validated outputs, and deployed AI-powered NLP pipelines for real clients, focusing on large language model integration and evaluation. Developed automation workflows with OpenAI GPT, Claude API, and VAPI AI agents performing workflow automation and AI-driven responses. Fine-tuned workflows by prompt engineering, rigorous output review, and issue debugging to ensure accuracy and relevance of AI model output. • Engineered production-level prompt-response pairs for healthcare, real estate, and hospitality industry use cases. • Validated and improved the natural language output of AI systems through human-in-the-loop evaluation. • Enhanced AI performance and reduced operational errors by iterative prompt testing and output refinement. • Leveraged Make.com, Zapier, and n8n as part of the AI workflow for prompt delivery and result collection.