Role overview

Job Overview:

Requirement/Must Have:

6 8+ years of experience in supporting and managing data pipelines in production (L1/L2 support).
Experience in Data Collection flows using CDC tools (e.g., Debezium) and file-based ingestion (CSV).
Hands-on experience with GCP services including Pub/Sub, Dataflow (Apache Beam), and Datastream.
Experience working with Cloud SQL (PostgreSQL) environments.
Experience in CRM data ingestion and extraction into staging and harmonized data layers.
Understanding of API-based data enrichment within ingestion workflows.
Strong knowledge of production monitoring, alerting, and incident management processes.
Programming experience in Java for pipeline support and enhancements.

Responsibilities:

Provide L1 and L2 operational support for data pipelines across staging and harmonized data layers.
Monitor data ingestion and extraction processes including CDC pipelines and CSV-based feeds, identifying failures, delays, and data inconsistencies.
Perform incident triage and analysis using logs, metrics, Pub/Sub events, and alerts; resolve known issues within SLA boundaries.
Support data enrichment workflows ensuring accurate and timely processing before downstream consumption.
Work with GCP Pub/Sub topics, subscriptions, DLQs, alerts, and scheduled jobs for monitoring and operations.
Support minor enhancements and configuration changes under guidance of senior engineers.
Assist in testing and validation in lower environments and support controlled production deployments.
Handle service requests, including data fixes, reruns, reconciliation, and contributing to RCA for recurring issues.
Perform monitoring and housekeeping activities across GCP components.
Maintain and update runbooks, operational procedures, and known issue documentation.
Continuously identify improvement opportunities for stability, reliability, and operational efficiency.

Skills: