Job Title Here Experience Director

Job ID: 000000123SC
Location: London, UK
Area of interest: Investment Banking
Job type: Permanent - Full Time
Work style: Hybrid Working
Opening date: 27-Sept-2022 Closing Date: 12-Oct-2022
Apply now      >

Title:  Principal Data Platform Engineer

20776

Guangzhou, CN

Technology
Regular Employee
Office - Full Time
24 Feb 2025

Job Summary

The Platform Engineer designs, manages, and optimizes the underlying infrastructure supporting the Bank’s Global Data Platform. This role ensures high availability, scalability, and security for multi-tenant workloads while aligning with governance and regulatory frameworks. Platform Engineers work across Kubernetes, MinIO, and other modern tools like Airflow, Argo, OpenLineage, and DataHub deliver a robust infrastructure that supports streaming, batch processing, analytics, and query engines such as Trino. Additionally, the role includes setting up the analytics data store, near real-time data store, and query engine to meet business needs.

Strategy
•    Platform Optimization: Continuously enhance the platform infrastructure, focusing on scalability, cost efficiency, and high availability.
•    Infrastructure Management: Implement and maintain Kubernetes clusters for multi-tenancy
•    Analytics Data Store: Set up and optimize an analytics data store for batch and ad-hoc querying with tools like Iceberg and Trino.
•    Near Real-Time Data Store: Deploy and manage near real-time data stores to support low-latency streaming use cases and downstream applications.
•    Query Engine Configuration: Install, configure, and optimize for efficient query execution over large datasets, ensuring compatibility with the data lakehouse.
•    Observability: Set up monitoring solutions using Prometheus and Grafana to provide visibility into cluster health, job performance, query execution, and resource usage.
•    Lineage and Governance: Integrate OpenLineage, DataHub for lineage tracking and metadata management.

Key Responsibilities

Business
•    Service Levels: Maintain platform availability and performance above agreed service levels, ensuring smooth data operations.
•    Stakeholder Support: Collaborate with data engineers and domain teams to optimize infrastructure usage and ensure the platform supports business objectives.

People & Talent 

•    Collaboration: Work with framework engineers and data engineers to ensure seamless platform operations and robust query engine integration.
•    Mentorship: Provide technical guidance to peers, fostering a culture of continuous learning and technical excellence.

Governance 
•    Compliance & Regulatory Adherence: Ensure compliance with internal and external regulatory requirements, including data sovereignty, privacy, and resilience standards.
•    Data Governance & Quality: Implement data governance policies implementation to maintain data quality, integrity, accuracy, and consistency across the platform. Implement monitoring tools to proactively address data quality issues.

Regulatory & Business Conduct
•    Display exemplary conduct and live by the Group’s Values and Code of Conduct. 
•    Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.

Key stakeholders
•    Rest of Data & Analytics team
•    WRB/CIB/GF Architecture teams
•    Business and Functions Data & Analytics Team

Skills and Experience

  • Data Architecture
  • Data Governance
  • Big Data Management
  • IT Governance
  • Service Platform Operations
  • Emerging Technologies
  • Cloud Computing
  • IT Standards, Procedures & Policies

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. 
• Extensive experience with Kubernetes, MinIO, and orchestration tools like Airflow or Argo.
• Hands-on expertise in deploying and optimizing Trino for large-scale interactive querying.
• Strong understanding of multi-tenancy and resource management in distributed systems.
• Experience setting up and managing analytics data stores and near real-time data stores integrated with modern data lakehouses.
• Familiarity with governance tools such as Apache Ranger, OpenLineage, and DataHub.

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

  • Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
  • Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
  • Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

 

About our Transformation, Technology & Operations Team

Our Transformation, Technology & Operations (TTO) team is the powerhouse for the Bank. We aim to go further, faster, to ensure we're agile and ready for tomorrow, today. Our diverse network enables us to innovate and build banking solutions that support communities to prosper. We're a place where talented people are encouraged to grow, learn, and thrive, to drive their own career journeys, to reach their full potential.

When you work with us, you’re protecting the reputation and legacy of a 170 year organisation and building on it. We’re driven by progress and continuously evolving to ensure we’re agile and ready for tomorrow, today.

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

  • Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
  • Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
  • Flexible working options based around home and office locations, with flexible working patterns.
  • Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
  • A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
  • Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.
20776