Job Summary

We are seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 3 to 5 years of experience working with big data technologies and platforms, particularly Hadoop. The role requires proficiency in Hive, Spark, Python, shell scripting, and Azure DevOps concepts. The Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and processing systems to support our data-driven initiatives.

Responsibilities

Key Responsibilities:
•    Design, develop, and maintain robust data pipelines and ETL processes using Hadoop, Hive, and Spark.
•    Optimize and enhance data processing workflows to ensure high performance and reliability.
•    Implement and manage data storage solutions, ensuring data integrity and security.
•    Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
•    Develop and maintain scripts for data extraction, transformation, and loading (ETL) using Python and shell scripting.
•    Utilize Azure DevOps for continuous integration and continuous deployment (CI/CD) of data pipelines and applications.
•    Monitor and troubleshoot data processing systems to ensure smooth operation and quick resolution of issues.
•    Stay updated with the latest industry trends and best practices in big data technologies and tools.

Key Responsibilities

Strategy
•     Responsibilities that are related to the development and implementation of Big Data based projects/solutions for CPBB Data initiatives aligned to CPBB Data strategy.
Business
•     Should have prior work experience in Retail Banking domain and should have an understanding of retail banking products but training will be provided.
Processes
•     Should have at least 1 years’ experience in end-to-end SDLC process in waterfall or Agile mode of delivery.  Should have participated in Agile ceremonies.
•     Should have DevOps experience and CI/CD pipeline deployment
•     Should have sound understanding of technology Risk Management processes.
•     Training will be provided for Fresh Grads.
Risk Management
•     Should be able to identify, mitigate and track delivery risks for a project
Governance
•    Its added advantages if been part of Project Governance reporting to Project Working group or Steering group
Regulatory & Business Conduct
•    Display exemplary conduct and live by the Group’s Values and Code of Conduct. 
•    Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.

Skills and Experience

Required Skills and Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3 to 5 years of experience working as a Data Engineer or in a similar role.
• Strong experience with Hadoop ecosystem, including Hive and Spark.
• Proficiency in Python programming for data processing and automation.
• Expertise in shell scripting for system automation and data manipulation.
• Hands-on experience with Azure DevOps for CI/CD and version control.
• Solid understanding of data warehousing concepts and best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualification

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.