Data Automation Engineer (AI-powered data crawling and enrichment)
Engineered and executed data crawling pipelines that utilized AI-powered parsing and enrichment to deliver structured datasets. Integrated OpenAI-driven enrichment and schema standardization to significantly reduce manual data cleanup. Outputs were delivered in standardized JSON/CSV formats to support analytics and lead-generation pipelines. • Designed crawlers for non-API sources, utilizing Playwright and Selenium. • Integrated proxy rotation and advanced session management for reliability. • Automated parsing and schema validation for structured, CRM-ready outputs. • Leveraged OpenAI and internal tools for enhanced data enrichment.