Job Summary

•    We are seeking a passionate and skilled Full Stack Data Engineer to join our Data & AI Engineering team. The ideal candidate will have solid hands-on experience in data engineering, real-time data processing, and applied AI/ML, working across technologies like Python, PySpark, Databricks and Airflow on Azure and AWS platforms.
•    This role focuses on designing and implementing scalable batch and streaming data pipelines, enabling semantic and text analytics, and supporting machine learning workloads. The candidate should have hands-on exposure to Spark Structured Streaming, Kafka, and Solace, along with a strong understanding of data quality, orchestration, and governance principles.

Key Responsibilities

Strategy
•    Contribute to the execution of the enterprise data and AI strategy, ensuring alignment with the organization’s data architecture and governance framework.
•    Support automation, optimization, and standardization of data pipelines across business domains.
•    Explore and apply OpenAI APIs, NLP frameworks, and LLM-based models to build data enrichment and text analytics capabilities.
•    Participate in continuous improvement initiatives aimed at improving data quality, performance, and efficiency.
Business
•    Work closely with data scientists, business analysts, and architects to understand data needs and translate them into reliable data pipelines and features.
•    Design and implement data ingestion, transformation, and processing frameworks to support analytics, reporting, and ML/AI use cases.
•    Ensure data accuracy, consistency, and timeliness across multiple systems and domains.
•    Contribute to model operationalization pipelines by collaborating with AI/ML engineering teams.
Processes
•    Build and maintain ETL/ELT pipelines using PySpark, Databricks, Airflow, and Control-M.
•    Implement real-time data streaming solutions using Spark Structured Streaming, Kafka, and Solace.
•    Perform data cleaning, transformation, and semantic enrichment for both structured and unstructured datasets.
•    Support feature engineering and maintain reusable feature sets for ML workloads.
•    Integrate with microservices and APIs to enable secure and efficient data sharing.
•    Implement CI/CD pipelines for data engineering workloads ensuring code quality checks and remediations with SonarQube, Nexus, VPT Scans, etc.
•    Good to have knowledge of building containerized applications.
•    Collaborate with cloud and platform teams to ensure solutions are secure, compliant, and cost-optimized.

People & Talent
•    Collaborate closely with senior data engineers, architects, and AI teams to deliver high-quality data products.
•    Proactively learn and adapt to emerging tools and frameworks in the data and AI ecosystem.
•    Contribute to internal knowledge-sharing sessions and communities of practice.
•    Demonstrate ownership, accountability, and strong problem-solving abilities within cross-functional teams.
Risk Management
•    Ensure all data pipelines and solutions comply with bank’s information security and regulatory standards.
•    Identify and mitigate potential data quality or performance issues early in the development lifecycle.
•    Participate in code and architecture reviews to uphold engineering and compliance best practices.
Governance
•    Maintain clear documentation of pipelines, data flows, and solution designs.
•    Support submission of solution architectures to Architecture Review Forum (ARF) and other governance bodies.
•    Ensure all deliverables meet required quality and compliance standards.
Regulatory & Business Conduct
•    Display exemplary conduct and live by the Group’s Values and Code of Conduct. 
•    Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters. 

Key stakeholders
• Head of Data Engineering & AI
• Domain Architects and Enterprise Data Architects
• Product Owners & Business Analysts
• Data Scientists and MLOps Engineers
• Cloud Platform Engineering Teams
• Risk & Compliance Partners

Qualifications

•    Education: Bachelor’s or Master’s Degree In Computer Science, Data Engineering, or Related Fields.
•    Certifications (Preferred): Databricks, Aws/Azure Data Engineer Associate, Airflow, Or Machine Learning Certifications.
•    Languages: English

Skills and Experience

•    Cloud Platforms (Azure / AWS)
•    Data Engineering & Pipelines
•    Spark / PySpark
•    SQL
•    Data Science
•    Python
•    Microservices / APIs

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.