Faith - LLM Output Evaluator and Prompt Designer (MSc Thesis)

Key Skills

Software

No software listed

Top Subject Matter

Engineering Domain Expertise

Construction Domain Expertise

Cost Estimation

Top Data Types

Text

Document

Top Task Types

No task types listed

Freelancer Overview

LLM Output Evaluator and Prompt Designer (MSc Thesis). Brings 4+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Internal and Proprietary Tooling. Education includes Doctor of Engineering, Delft University of Technology (2026) and Master of Science, Politecnico di Milano & Technical University of Madrid (2024). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Intermediate

Labeling Experience

Semantic Data Evaluator (Doctoral Research)

Text

Performed expert-level evaluation and validation of infrastructure data using formal ontologies and semantic reasoning frameworks. Judged whether data claims were logically entailed or contradicted using OWL/RDF, SHACL, and SPARQL in research-grade tasks. Provided technical review for AI and semantic model outputs within the context of subsurface infrastructure data. • Evaluated knowledge graph and semantic data claims for logical correctness. • Utilized advanced semantic web tools for validation tasks. • Managed data review on EU geospatial infrastructure standards. • Collaborated on ontology-driven AI validation workflows.

2024 - Present

LLM Output Evaluator and Prompt Designer (MSc Thesis)

Text

Conducted evaluation and accuracy assessment of Large Language Model outputs for construction cost estimation tasks. Designed prompts and assessed structured responses for correctness and reliability. Analyzed the limits of LLM accuracy on technical and structured problems related to engineering and construction. • Designed evaluation tasks specific to technical English in construction. • Assessed LLM outputs for plausibility and correctness. • Documented findings on model limitations and strengths. • Contributed to prompt strategy improvements for future model use.

2022 - 2024

Education

D

Delft University of Technology

Doctor of Engineering, Civil Engineering and Management

Doctor of Engineering

2024 - 2026

P

Politecnico di Milano & Technical University of Madrid

Master of Science, Building Information Modelling

Master of Science

2022 - 2024

Work History

B

Bentley Systems

Construction Consultant and BIM Specialist

Dublin

2021 - 2024