For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

LoginCreate account
Invite to Job
Usama Shahid

Usama Shahid

Python Engineer - LLM Training Data Curation and Evaluation

PAKISTAN flag
Lahore, Pakistan
$25.00/hrExpertMercorOther

Key Skills

Software

MercorMercor
Other

Top Subject Matter

AI/LLM Training
Backend Engineer
DevOps

Top Data Types

TextText
DocumentDocument
Computer Code ProgrammingComputer Code Programming

Top Task Types

Question Answering
Text Generation
Text Summarization
RLHF
Fine Tuning
Transcription
Evaluation Rating
Computer Programming Coding
Prompt Response Writing SFT
Function Calling
Data Collection

Freelancer Overview

Python Engineer - LLM Training Data Curation and Evaluation. Brings years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal and Proprietary Tooling. Education includes Bachelor of Science, Punjab University College of Information Technology (2021). AI-training focus includes data types such as Computer Code and Programming, text summarization and labeling workflows including Evaluation and Rating.

ExpertUrduEnglish

Labeling Experience

Agentic AI Trainer

Computer Code ProgrammingRLHF
Optimized autonomous AI agents for repository-level software engineering tasks across Python, TypeScript, Go, and SQL. Engineered and evaluated 'Gold Trajectories' for agentic workflows, focusing on multi-step reasoning, tool-call accuracy (CLI, Linters, Debuggers), and autonomous bug resolution within open-source codebases. Developed comprehensive alignment rubrics to grade agent planning, ensuring adherence to language-specific best practices and architectural constraints.

Optimized autonomous AI agents for repository-level software engineering tasks across Python, TypeScript, Go, and SQL. Engineered and evaluated 'Gold Trajectories' for agentic workflows, focusing on multi-step reasoning, tool-call accuracy (CLI, Linters, Debuggers), and autonomous bug resolution within open-source codebases. Developed comprehensive alignment rubrics to grade agent planning, ensuring adherence to language-specific best practices and architectural constraints.

2025 - Present

Python Engineer - LLM Training Data Curation and Evaluation

Computer Code ProgrammingRLHF
Curated and evaluated Python code data for large language model training, focusing on quality and accuracy. Provided targeted feedback on code outputs to refine model understanding and correctness. Designed complex programming tasks and reviewed AI-generated code solutions. • Evaluated Python code outputs for accuracy and logic • Curated training datasets for model learning • Designed and reviewed programming tasks for LLMs • Collaborated with an AI company on data quality initiatives

Curated and evaluated Python code data for large language model training, focusing on quality and accuracy. Provided targeted feedback on code outputs to refine model understanding and correctness. Designed complex programming tasks and reviewed AI-generated code solutions. • Evaluated Python code outputs for accuracy and logic • Curated training datasets for model learning • Designed and reviewed programming tasks for LLMs • Collaborated with an AI company on data quality initiatives

2023 - 2024

Education

P

Punjab University College of Information Technology

Bachelor of Science, Software Engineering

Bachelor of Science
2017 - 2021

Work History

S

Strategic Systems International

Senior Software Engineer

Lahore
2023 - Present
S

Strategic Systems International

Software Engineer

Lahore
2021 - 2023