NYC-311 Service Insights

• Tech Stack: Docker, Terraform , Poetry, CI/CD , Looker, Python, Bigquery (GCP)
• Github URL: Project Link

The primary objective was to design a data pipeline that seamlessly retrieves, processes, and channels data into a data repository, subsequently drawing significant insights.

Constructed NYC 311 data pipeline, cutting manual data processing by 80%, enabling analysis of 13 years of service requests data.

Enhanced BigQuery performance by 40% using strategic table partitioning and clustering for faster data retrieval and analytics.