Abdullah Jatt

Key Skills

Software

Scale AI

Top Subject Matter

NLP/Conversational AI

Natural Language Processing (NLP)

Legal Services & Contract Review

Top Data Types

Text

Document

Top Task Types

Prompt Response Writing SFT

Computer Programming Coding

Data Collection

Text Generation

Freelancer Overview

AI Content Evaluator (Scale AI / Remotasks). Brings 9+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Internal, and Proprietary Tooling. Education includes Bachelor of Science, University of Karachi (2017). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Content Evaluator (Scale AI / Remotasks)

Scale AIText

Evaluated and rated outputs from generative AI models such as chatbots and text summarizers for quality and alignment with human behavior. Annotated large-scale textual datasets to facilitate the training and fine-tuning of NLP models, providing Human-in-the-Loop (HITL) feedback to enhance model performance. Identified systematic error patterns, compiling actionable feedback for engineering teams to improve model outputs. • Conducted ongoing annotation and evaluation using proprietary platforms. • Focused on Natural Language Processing and conversational AI subject matter. • Delivered detailed rating reports and flagged edge cases. • Contributed directly to model accuracy, safety, and response quality improvements.

Evaluated and rated outputs from generative AI models such as chatbots and text summarizers for quality and alignment with human behavior. Annotated large-scale textual datasets to facilitate the training and fine-tuning of NLP models, providing Human-in-the-Loop (HITL) feedback to enhance model performance. Identified systematic error patterns, compiling actionable feedback for engineering teams to improve model outputs. • Conducted ongoing annotation and evaluation using proprietary platforms. • Focused on Natural Language Processing and conversational AI subject matter. • Delivered detailed rating reports and flagged edge cases. • Contributed directly to model accuracy, safety, and response quality improvements.

2020 - 2021

AI/ML Research Analyst (Python) (Turing)

Text

Evaluated Machine Learning models on NLP tasks for consistency, accuracy, and performance across various datasets and edge-case scenarios. Conducted data cleaning and preprocessing to ensure the integrity of labeled datasets for further model refinement. Designed structured test cases and computed standard evaluation metrics to support model improvement. • Worked with Python, Jupyter Notebook, scikit-learn, and Matplotlib tools. • Closely collaborated with cross-functional teams of data scientists and analysts. • Specialized in tasks involving natural language and text classification. • Facilitated reliable, data-driven model iteration and assessment practices.

Evaluated Machine Learning models on NLP tasks for consistency, accuracy, and performance across various datasets and edge-case scenarios. Conducted data cleaning and preprocessing to ensure the integrity of labeled datasets for further model refinement. Designed structured test cases and computed standard evaluation metrics to support model improvement. • Worked with Python, Jupyter Notebook, scikit-learn, and Matplotlib tools. • Closely collaborated with cross-functional teams of data scientists and analysts. • Specialized in tasks involving natural language and text classification. • Facilitated reliable, data-driven model iteration and assessment practices.

2018 - 2019

Education

Work History