Key Responsibilities

Technical Skills:
•    Minimum 5-7 experience in data engineering with hands on experience working with AIML projects.
•    Proficiency in Hadoop (HDFS, MapReduce, Spark, etc.) for large-scale data processing. 
•    Strong hands-on experience with PostgreSQL database and Elasticsearch management, including database design, query optimization, and performance tuning.
•    Proficiency in programming languages such as Python for data processing, automation tasks, data pipeline operations and system administration tasks related to data infrastructure. 
•    Strong analytical skills to understand and translate business requirements into effective data engineering solutions.
•    Knowledge of API development, microservices architecture, containerization, and orchestration (Docker & Kubernetes)
Data Pipeline Development and Management
•    Design, build, and maintain data pipelines to ingest, transform, and load data from a variety of sources, including but not limited to Hadoop, SQL, DB2, APIs, and TP systems.
•    Implement data validation and quality checks within the pipelines to ensure the integrity and accuracy of the data.
•    Monitor and optimize the performance of data pipelines to handle large volumes of data in a timely and efficient manner.

PostgreSQL and Elasticsearch Expertise
•    Design and implement efficient database schemas in PostgreSQL to support the storage and retrieval of complex data structures related to AI and machine learning projects.
•    Write and optimize complex SQL queries (DQL - Data Query Language) for data extraction, analysis, and reporting purposes.
•    Perform database tuning and optimization activities, such as index optimization, query plan analysis, and configuration adjustments, to enhance the overall performance of the PostgreSQL database.
•    Administer and optimize the Elasticsearch cluster. Design and define data mappings and indices to enable efficient full-text search and analytics capabilities. Monitor cluster health, performance metrics, and resource utilization, and take proactive measures to scale and optimize the Elasticsearch infrastructure as needed.
•    Data Source Integration
•    Work with different types of data sources, such as Hadoop, PostgreSQL, and other relational and non-relational databases, to integrate and consolidate data into a unified data ecosystem.
•    Develop connectors and adapters to enable seamless data transfer between various data sources and our platform.
•    Stay updated with the latest technologies and best practices related to data integration and data source management.
•    Collaboration and Communication
•    Collaborate closely with data scientists, model developers, and other stakeholders to understand their data requirements and provide them with the necessary data support.
•    Participate in cross-functional team meetings and discussions to contribute to the overall success of projects.
•    Document data engineering processes, data dictionaries, and technical specifications for future reference and knowledge sharing.
Strategy
•    Able to understand and work as per the Domain and Bank’s wider strategy
Business
•    Preferred Experience with LLM use cases

Processes
•    Good understanding and able to apply processes laid down within the team, and/or standards as defined by project and SCB. 
•    Provide technical expertise in Automation, Infra Methodologies, Admin Processes, Development best practises, Tools and Techniques across the teams. 
•    Be an escalation point for all matters related to Infrastructural changes.
Risk Management
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
Governance
•    Comply with the software management practices and policies. 
Regulatory & Business Conduct
•    Display exemplary conduct and live by the Group’s Values and Code of Conduct. 
•    Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
Key stakeholders
•    Business users/Model engineers/Data scientists/Platform engineers/Platform support

Qualifications

•    Good to have certifications in Python and Cloud technologies

Skills and Experience

•    Hadoop
•    PostgreSQL
•    Elasticsearch
•    Python
•    API Development
•    Docker and Kubernetes

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.