Naman Paliwal

Key Skills

Software

Scale AI

Top Subject Matter

LLM Evaluation

Code Assessment

Rlhf Domain Expertise

Top Data Types

Text

Computer Code Programming

Image

Top Label Types

RLHF

Computer Programming Coding

Evaluation Rating

Prompt Response Writing SFT

Text Generation

Freelancer Overview

AI Model Evaluator & Coding Expert — Remotasks / Scale AI / Outlier. Brings 9+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI. Education includes Bachelor of Technology, Poornima College of Engineering (2019). AI-training focus includes data types such as Computer Code and Programming and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Code Evaluation & RLHF Feedback — Multi-Project Contributor

Computer Code ProgrammingRLHF

Contributed 1,000+ structured evaluation tasks across multiple Scale AI / Outlier projects to support the training and improvement of large language models. Work included reviewing and rating AI-generated code in Python, Java, JavaScript, and C++ for correctness, efficiency, and logical soundness; performing side-by-side response comparisons and preference labeling for RLHF training pipelines; evaluating AI responses for instruction-following accuracy and prompt–response alignment; and identifying hallucinations, reasoning failures, and edge-case errors in AI outputs with detailed written justification. Consistently followed detailed rubrics and evaluation guidelines independently across multiple concurrent projects.

Contributed 1,000+ structured evaluation tasks across multiple Scale AI / Outlier projects to support the training and improvement of large language models. Work included reviewing and rating AI-generated code in Python, Java, JavaScript, and C++ for correctness, efficiency, and logical soundness; performing side-by-side response comparisons and preference labeling for RLHF training pipelines; evaluating AI responses for instruction-following accuracy and prompt–response alignment; and identifying hallucinations, reasoning failures, and edge-case errors in AI outputs with detailed written justification. Consistently followed detailed rubrics and evaluation guidelines independently across multiple concurrent projects.

2023 - Present

AI Model Evaluator & Coding Expert — Remotasks / Scale AI / Outlier

Scale AI

Evaluated and rated AI model outputs for correctness, relevance, and quality across more than 1,000 tasks on the Scale AI/Outlier platform. Provided rubric-based RLHF preference ranking, adversarial testing, and instruction-following analysis for production LLM training. Assessed AI-generated code for correctness in Python, Java, JavaScript, and C++ and identified hallucinations and logical errors in responses. • Contributed structured human feedback directly into LLM training pipelines. • Applied chain-of-thought analysis to evaluate step-by-step reasoning in model outputs. • Conducted side-by-side response comparisons and ranking for RLHF. • Used Remotasks and internal/outlier platforms for annotation and assessment.

Evaluated and rated AI model outputs for correctness, relevance, and quality across more than 1,000 tasks on the Scale AI/Outlier platform. Provided rubric-based RLHF preference ranking, adversarial testing, and instruction-following analysis for production LLM training. Assessed AI-generated code for correctness in Python, Java, JavaScript, and C++ and identified hallucinations and logical errors in responses. • Contributed structured human feedback directly into LLM training pipelines. • Applied chain-of-thought analysis to evaluate step-by-step reasoning in model outputs. • Conducted side-by-side response comparisons and ranking for RLHF. • Used Remotasks and internal/outlier platforms for annotation and assessment.

2023 - Present

Education

Work History