Senior ETL Developer - People Data, Agoda Services Co., Ltd.
Mar, 2025 - May, 20252 months
Revamped the Greenhouse pipeline from Talend to Python, reducing total running time from 2.5 hours to 45 minutes and enabling consistent ingestion of ~8 GB CSV files into 33 SQL Server tables.
Refactored Bridge ETL scripts by replacing one-by-one API fetches with an SQL pre-fetch layer and parallelized requests, simplifying the pipeline architecture and cutting runtime from 3 hours to 30 minutes.
Built end-to-end pipelines for O’Reilly data using Python and Talend, automating daily SQL Server delivery and removing manual handoffs.
Upskilled five analysts in Python through focused mentoring sessions, enabling their contribution to internal Python development tasks related to ETL.