Job Summary
We are seeking a highly motivated Data Engineer to join our dynamic Data Engineering team. As a Data Engineer, you will play a crucial role in managing and optimizing our data infrastructure, ensuring the reliability and availability of data for our analytics and business intelligence needs. You will work with cutting-edge technologies including Amazon S3, Amazon Athena, Apache Airflow, and Python to build and maintain data pipelines.
Key Responsibilities
• Data Pipeline Development: Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data lake on Amazon S3.
• Data Quality Assurance: Implement data validation and quality checks to ensure the accuracy and consistency of data throughout the ETL process.
• Amazon Athena Expertise: Utilize Amazon Athena for ad-hoc querying and analysis of data stored in Amazon S3, optimizing query performance and efficiency.
• Automation: Develop and maintain automated workflows using Apache Airflow to schedule and orchestrate data processing tasks, ensuring timely and reliable data delivery.
• Python Programming: Write clean and efficient Python code to support data transformation, integration, and data engineering tasks.
• Data Architecture: Collaborate with senior data engineers to design and evolve the data architecture, ensuring scalability and performance of the data infrastructure.
• Documentation: Maintain comprehensive documentation of data pipelines, workflows, and processes for future reference.
• Troubleshooting: Identify and resolve data pipeline issues, performance bottlenecks, and data quality concerns in a timely manner.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide data engineering support.
Regulatory & Business Conduct
• Display exemplary conduct and live by the Group’s Values and Code of Conduct.
• Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
• Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
Skills and Experience
• Data Pipeline Development
• Data Quality Assurance
Qualifications
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow.
• Proficiency in Python programming for data manipulation and scripting.
• Basic understanding of data modelling, SQL, and database concepts.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and teamwork abilities.
• Eagerness to learn and adapt to new technologies and tools.
Preferred Qualifications (not mandatory but a plus):
• Experience with cloud platforms like AWS.
• Familiarity with distributed computing frameworks (e.g., Apache Spark).
• Knowledge of data warehousing concepts.
• Previous experience with data visualization tools (e.g., Tableau, Power BI).
• Previous experience with ML.
• Previous experience with Terraform.
About Standard Chartered
We're a global bank connecting clients to our differentiated network, offering growth opportunities in the world's most dynamic markets. Our strategy, which combines cross-border capabilities and leading wealth management expertise, helps us deliver our purpose - to drive commerce and prosperity through our unique diversity.
Over our 170-year history, and across a unique geographical footprint connecting Asia, Africa and the Middle East to each other and the world, we've built a bank like no other, with diverse capabilities and partnerships that set us apart.
What We Offer
- Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions, and geographies.
- In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
- Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
- Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
- Flexible working options based around home and office locations, with flexible working patterns.
- Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global employee assistance programme, sick leave, mental health first-aiders and self-help toolkits.
- A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual, and digital learning.
Visit our careers website to learn more about us: www.sc.com/careers.