Subject Matter Expert (SME) - AI Evaluation [Contract]
MercorText
As a Subject Matter Expert (SME) in AI evaluation, I leveraged my editorial background to assess and refine large language model outputs. My primary responsibility was evaluating AI-generated text for factual accuracy, coherence, and minimizing hallucinations. I developed supervised fine-tuning (SFT) datasets through information synthesis and consistent application of strict editorial standards.
• Evaluated and rated AI-generated responses for accuracy and relevance.
• Identified structural hallucinations in large language model outputs.
• Synthesized complex, entangled information into fine-tuning datasets.
• Applied rigorous, publication-level editorial standards throughout labeled data.
As a Subject Matter Expert (SME) in AI evaluation, I leveraged my editorial background to assess and refine large language model outputs. My primary responsibility was evaluating AI-generated text for factual accuracy, coherence, and minimizing hallucinations. I developed supervised fine-tuning (SFT) datasets through information synthesis and consistent application of strict editorial standards. • Evaluated and rated AI-generated responses for accuracy and relevance. • Identified structural hallucinations in large language model outputs. • Synthesized complex, entangled information into fine-tuning datasets. • Applied rigorous, publication-level editorial standards throughout labeled data.
2026 - Present