For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
S
Sohan

Sohan

Freelance AI Prompt Engineer & LLM Evaluator

India flagRemote, India
$20.00/hrIntermediateData Annotation TechDeep SystemsGoogle Cloud Vertex AI

Key Skills

Software

Data Annotation TechData Annotation Tech
Deep SystemsDeep Systems
Google Cloud Vertex AIGoogle Cloud Vertex AI
iMeritiMerit
LabelboxLabelbox
Label StudioLabel Studio
MercorMercor
Micro1
MindriftMindrift
OneFormaOneForma
Scale AIScale AI

Top Subject Matter

AI Training and LLM Evaluation
Full Stack Developer

Top Data Types

TextText
ImageImage

Top Task Types

RLHFRLHF
ClassificationClassification
SegmentationSegmentation
Text GenerationText Generation
Text SummarizationText Summarization
Fine-tuningFine-tuning
Red TeamingRed Teaming
TranscriptionTranscription
Evaluation/RatingEvaluation/Rating
Computer Programming/CodingComputer Programming/Coding
Data CollectionData Collection
Question AnsweringQuestion Answering
Object DetectionObject Detection
Prompt + Response Writing (SFT)Prompt + Response Writing (SFT)
Function CallingFunction Calling

Freelancer Overview

Detail-oriented AI Trainer and LLM Evaluator with 2+ years of hands-on experience in prompt engineering, RLHF, SFT, and response quality analysis across text, image, audio, and video-based multimodal tasks for next-generation large language models. Proven ability to assess model outputs for correctness, safety, policy alignment, and instruction-following, with experience supporting model alignment and post-training pipelines for leading global AI labs.

IntermediateEnglishTeluguHindi

Labeling Experience

Freelance AI Prompt Engineer & LLM Evaluator

TextRLHF
Served as an AI Prompt Engineer and LLM Evaluator, contributing to datasets for next-generation Large Language Models using RLHF and SFT methodologies. Designed high-quality prompts across reasoning, coding, Q&A, and multimodal tasks, including text, image, audio, and video. Conducted structured evaluation and quality analysis, ensuring high dataset consistency, safety, and policy alignment. • Evaluated model outputs for correctness, helpfulness, and safety. • Performed QA reviews on prompts and annotations for data integrity. • Created advanced, edge-case prompts to stress-test LLMs. • Supported model alignment and flagged unsafe outputs.

Served as an AI Prompt Engineer and LLM Evaluator, contributing to datasets for next-generation Large Language Models using RLHF and SFT methodologies. Designed high-quality prompts across reasoning, coding, Q&A, and multimodal tasks, including text, image, audio, and video. Conducted structured evaluation and quality analysis, ensuring high dataset consistency, safety, and policy alignment. • Evaluated model outputs for correctness, helpfulness, and safety. • Performed QA reviews on prompts and annotations for data integrity. • Created advanced, edge-case prompts to stress-test LLMs. • Supported model alignment and flagged unsafe outputs.

2024 - Present

Education

V

Vellore Institute of Technology - AP

Bachelor of Technology, Computer Science and Engineering with Specialization in Networking and Security

Bachelor of Technology
2019 - 2023

Work History

S

Startgenie

Full Stack Developer

Remote
2023 - Present