Investment & AI Finance Consultant (RLHF/LLM Evaluation)
As an independent Investment & AI Finance Consultant, I conducted RLHF and LLM evaluations specifically for Outlier and Mercor. My work focused on validating financial reasoning for investment underwriting and forecasting in institutional finance contexts. The process involved evaluating language model outputs for accuracy and relevance in financial analysis and scenario modeling. • Created and rated financial reasoning Q&A pairs for LLMs • Manually reviewed and annotated AI-generated investment recommendations • Evaluated LLMs for accuracy in complex multi-asset finance workflows • Used internal/proprietary and Mercor platforms for annotation and rating