Jose Urias

Key Skills

Software

Data Annotation Tech

Argilla

Remotasks

Snorkel AI

Top Subject Matter

AI Model Evaluation

Software Development

Technical Content

Top Data Types

Text

Document

Video

Top Task Types

Fine Tuning

Evaluation Rating

Data Collection

Computer Programming Coding

Transcription

Freelancer Overview

AI Coding Specialist / Technical Evaluator. Brings 10+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI and Data Annotation Tech. Education includes Bachelor of Science, University of California, Berkeley (2017). AI-training focus includes data types such as Computer Code and Programming and labeling workflows including Evaluation, Rating, and Fine-tuning.

Labeling Experience

AI Coding Specialist / Technical Evaluator

Scale AI

In this role, I evaluated and ranked code generated by Large Language Models (LLMs) for correctness, following precise logic and style guidelines. I contributed high-quality 'Gold Standard' code solutions to train models in Python, SQL, and JavaScript. Using RLHF, I identified and addressed model hallucinations, syntax errors, and logic bottlenecks. • Evaluated code output from LLMs for functional accuracy. • Delivered Gold Standard coding examples to enhance model reasoning. • Applied RLHF methodologies to improve AI model integrity. • Worked closely with engineers to refine prompt engineering strategies.

In this role, I evaluated and ranked code generated by Large Language Models (LLMs) for correctness, following precise logic and style guidelines. I contributed high-quality 'Gold Standard' code solutions to train models in Python, SQL, and JavaScript. Using RLHF, I identified and addressed model hallucinations, syntax errors, and logic bottlenecks. • Evaluated code output from LLMs for functional accuracy. • Delivered Gold Standard coding examples to enhance model reasoning. • Applied RLHF methodologies to improve AI model integrity. • Worked closely with engineers to refine prompt engineering strategies.

2023 - Present

AI Technical Content Specialist

Data Annotation TechFine Tuning

I performed rigorous quality audits on AI-generated technical content to ensure accuracy in programming explanations. I labeled and categorized large datasets to fine-tune models, emphasizing code efficiency and clear documentation. Additionally, I authored 'ground-truth' responses to improve the model's performance on advanced computer science concepts. • Audited AI-generated content for accuracy and clarity. • Labeled and organized code datasets for model improvement. • Created ground-truth technical responses for prompt-based tasks. • Enhanced AI model ability in handling complex computer science prompts.

I performed rigorous quality audits on AI-generated technical content to ensure accuracy in programming explanations. I labeled and categorized large datasets to fine-tune models, emphasizing code efficiency and clear documentation. Additionally, I authored 'ground-truth' responses to improve the model's performance on advanced computer science concepts. • Audited AI-generated content for accuracy and clarity. • Labeled and organized code datasets for model improvement. • Created ground-truth technical responses for prompt-based tasks. • Enhanced AI model ability in handling complex computer science prompts.

2022 - 2023

Education

Work History