Senior Software Engineer 2,
Jul, 2021 - Present
Lead developer for enabling GDPR compliance service across entire Zynga datalake and lead a team to build data quality framework for entire data lakehouse in Zynga.to build service which can handle requests in petabytes of data incoming into zynga dataservice
Feature spec development for enabling GDPR complaince for zynga and M&A studios
Technical spec development to scope out all the impacted downstream and upstream in the data pipline and datasource and additional service that needs to be developed
Airflow DAG development to support the GDPR requests globally
Implement DQ framework around Great expectations to enable dataquality checkes for entire zynga datasets.