Data Quality Engineer
Job Summary
Ensure end-to-end data quality across the data pipeline by defining, enforcing, and monitoring data quality standards using modern data platforms. This role bridges data engineering and data governance to maintain trust in data as it flows from ingestion (Kafka/NiFi) through processing (Databricks) to observability and analytics, enabling reliable decision-making, reducing downstream data issues, and ensuring compliance with data governance standards.
Key Responsibilities
- Data Quality Guidelines & Standards – defines what "good data" means and standardises schemas/patterns across ingestion and transformation.
- Monitoring, Alerting & Observability – builds real-time visibility so issues are caught early and stakeholders trust platform health/compliance.
- Pipeline Validation & Integrity – embeds quality/security checks directly into the pipeline so issues are caught at the source, by design.
- Root Cause Analysis & Issue Resolution – diagnoses why issues occur and feeds fixes back into governance, not just detects them.
- Automation, Reporting & Cross-Functional Collaboration – scales data quality work via automation and close partnership with engineering/analytics/product teams.
- Building and maintaining trustworthy, reliable data that others can confidently base decisions on.
- Solving complex, cross-platform technical problems spanning ingestion, processing, and observability.
- Driving automation that reduces manual effort and improves the resilience of the data platform.
Skills and Experience
-
8+ years of relevant experience in designing automated validation frameworks, leading technical initiatives, managing complex enterprise datasets, and collaborating with engineering and business teams.
-
2–3 years of relevant experience in risk management, data governance, and compliance, with a good understanding of data controls, regulatory requirements, and governance frameworks.
- Experience building and operating data pipelines across streaming (Kafka), flow-based (NiFi) and lakehouse (Databricks) platforms.
- Experience implementing monitoring, alerting and observability solutions using Splunk or equivalent tools, including scripting in Python, SQL, Bash or PowerShell.
- Degree in Computer Science, Information Systems, Engineering or a related field, or equivalent practical experience.
- Relevant certifications in data engineering, cloud platforms (Azure/AWS) or DevOps tooling are an advantage.
-
Strong stakeholder management skills, with the ability to build relationships, influence decisions.
-
Excellent verbal and written communication skills, with the ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.
- Fluent in English (written and spoken), required for cross-regional stakeholder collaboration.
- Additional regional languages are an advantage but not required.
Primary Skills
- Data Quality Management (rules, metrics, thresholds)
- Apache Kafka (streaming, schema enforcement)
- Apache NiFi (flow validation, transformation)
- Databricks (quality checks, pipeline auditing, lineage)
- Splunk (monitoring, alerting, anomaly detection)
- Scripting (Python / SQL / Bash / PowerShell)
- DevOps & CI/CD (Azure DevOps, Jenkins, Git, Terraform, Ansible)
- Root Cause Analysis & Incident Resolution
- Data Governance & Compliance
- Dashboarding & Reporting
About Standard Chartered
We're a global bank connecting clients to our differentiated network, offering growth opportunities in the world's most dynamic markets. Our strategy, which combines cross-border capabilities and leading wealth management expertise, helps us deliver our purpose - to drive commerce and prosperity through our unique diversity.
Over our 170-year history, and across a unique geographical footprint connecting Asia, Africa and the Middle East to each other and the world, we've built a bank like no other, with diverse capabilities and partnerships that set us apart.
What We Offer
- Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions, and geographies.
- In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
- Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
- Flexible working options based around home and office locations, with flexible working patterns.
- Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global employee assistance programme, sick leave, mental health first-aiders and self-help toolkits.
- A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual, and digital learning.
Visit our careers website to learn more about us: www.sc.com/careers.