Job Summary

The role of Senior Data Engineer - Big Data is pivotal within Standard Chartered's technology landscape, focusing on the design, development, and delivery of robust big data solutions. This position demands expertise across a broad spectrum of big data technologies including HDFS, Hive, Spark, and cloud platforms such as AWS and Azure. You will be entrusted with managing ETL pipelines, ensuring data quality and governance practices, and actively leading project teams towards successful and timely delivery. As a Senior Data Engineer, you will collaborate closely with cross-functional teams, driving innovation and operational excellence, while maintaining vigilance on release management and adherence to best practices in software development and data management.

The successful candidate will exhibit not only technical proficiency but also strong leadership qualities to oversee project progress, manage stakeholder expectations, and mitigate risks aligned with organisational standards. This is an exciting opportunity to contribute to high-impact banking data initiatives within a global financial institution that values diversity, inclusion, and continuous improvement.

Key Responsibilities

Strategy and Development: Lead the architecture, design, and implementation of big data solutions aligned with business strategies and evolving technological trends. Drive innovation in the data engineering processes and frameworks to enhance efficiency and scalability.

Project Execution and Support: Responsible for end-to-end project lifecycle including development, rigorous testing, deployment, and post-deployment support. Ensure smooth release management and timely status reporting to key stakeholders.

Governance and Compliance: Strictly adhere to Standard Chartered Bank’s governance, risk management, and compliance standards to uphold data integrity, quality, and security. Embed regulatory requirements and business conduct norms in daily operations.

Team Leadership: Provide technical guidance and mentoring to junior engineers, fostering a collaborative and high-performance team environment. Facilitate knowledge sharing and promote adherence to best practices in big data engineering.

Stakeholder Engagement: Collaborate effectively with programme teams and business units, particularly the Athena Program, to understand requirements, deliver solutions, and support strategic objectives.

Continuous Improvement: Identify and implement process improvements, leveraging automation and advanced tooling, to optimize the data engineering pipeline and enhance delivery speed without compromising quality.

Skills and Experience

• 10+ years of data engineering domain experience
• Proficiency with Hadoop ecosystem components including HDFS, Hive, HBase and Spark for building scalable big data solutions.
• Strong SQL skills for querying, data manipulation, and analytics within large datasets.
• Solid experience in Python programming, particularly for data engineering tasks, automation, and scripting.
• Hands-on knowledge of ETL processes and data pipeline orchestration leveraging tools such as Apache NiFi, Dataiku, or Dremio.
• Familiarity with cloud storage and computing services, preferably both AWS (S3, KeyVault) and Azure (ADLS, Delta Lake), including integration and security aspects.
• Experience with DevOps practices, including continuous integration/delivery, release management, and monitoring (Splunk or equivalent).
• Understanding of data quality, governance frameworks, and compliance requirements within the financial services sector.
• Working knowledge of development and project management tools such as ADO (Azure DevOps) and Confluence.
• Ability to analyse complex technical challenges, communicate effectively with stakeholders, and deliver solutions on time.

Qualifications

To excel in this role, the ideal candidate will be equipped with:

• Advanced proficiency in big data platforms such as Hadoop, HDFS, HBase, Spark, and Scala.
• Expert-level competence in SQL and ETL process development.
• Knowledge or hands-on experience with data analytics platforms like Dremio and Dataiku at an entry level.
• Experience with project and code management tools including Azure DevOps (ADO) and Confluence.
• A bachelor's degree or higher in Computer Science, Information Technology, Engineering, or a related discipline is preferred.
• Demonstrated capability in driving complex data engineering projects within regulated industries is an advantage.

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.

Recruitment Assessments

Some of our roles use assessments to help us understand how suitable you are for the role you've applied to. If you are invited to take an assessment, this is great news. It means your application has progressed to an important stage of our recruitment process.

Visit our careers website www.sc.com/careers