Job Title Here Experience Director

Title: Data Engineer
Tianjin, CN
About our Architecture, Technology Solutions and App Development Team
Want to be part of a team that focuses on what we can do instead of what’s already been done? This is your opportunity. From BlockChain to AWS, deep learning and AI, you’ll work with the tools and platforms that you need to be successful. You’ll have the freedom to decide the different ways you want to grow – whether that’s by gaining diverse skills on a new project or deepening your expertise on innovative tech. Join us and you’ll find diverse paths, projects and people that inspire you to think outside-the-box and change the way people everywhere experience our products and services.
About our Technology and Operations Team
Our Technology & Operations (T&O) team is the powerhouse for the Bank. We aim to go further, faster, to ensure we're agile and ready for tomorrow, today. Our diverse network enables us to innovate and build banking solutions that support communities to prosper. We're a place where talented people are encouraged to grow, learn, and thrive, to drive their own career journeys, to reach their full potential.
When you work with us, you’re protecting the reputation and legacy of a 170 year organisation and building on it. We’re driven by progress and continuously evolving to ensure we’re agile and ready for tomorrow, today.
Key Responsibilities
• Data Pipeline Development and Management
1.Design, build, and maintain data pipelines to ingest, transform, and load data from a variety of sources, including but not limited to Hadoop, SQL, DB2, APIs, and TP systems.
2.Implement data validation and quality checks within the pipelines to ensure the integrity and accuracy of the data.
3.Monitor and optimize the performance of data pipelines to handle large volumes of data in a timely and efficient manner.
• PostgreSQL and Elasticsearch Expertise
1.Design and implement efficient database schemas in PostgreSQL to support the storage and retrieval of complex data structures related to AI and machine learning projects.
2.Write and optimize complex SQL queries (DQL - Data Query Language) for data extraction, analysis, and reporting purposes.
3.Perform database tuning and optimization activities, such as index optimization, query plan analysis, and configuration adjustments, to enhance the overall performance of the PostgreSQL database.
4.Administer and optimize the Elasticsearch cluster. Design and define data mappings and indices to enable efficient full-text search and analytics capabilities. Monitor cluster health, performance metrics, and resource utilization, and take proactive measures to scale and optimize the Elasticsearch infrastructure as needed.
• Data Source Integration
1.Work with different types of data sources, such as Hadoop, PostgreSQL, and other relational and non-relational databases, to integrate and consolidate data into a unified data ecosystem.
2.Develop connectors and adapters to enable seamless data transfer between various data sources and our platform.
3.Stay updated with the latest technologies and best practices related to data integration and data source management.
• Collaboration and Communication
1.Collaborate closely with data scientists, model developers, and other stakeholders to understand their data requirements and provide them with the necessary data support.
2.Participate in cross-functional team meetings and discussions to contribute to the overall success of projects.
3.Document data engineering processes, data dictionaries, and technical specifications for future reference and knowledge sharing.
Skills and Experience
• Minimum 5yrs experience in data engineering with hands on experience working with AIML projects.
• Proficiency in Hadoop (HDFS, MapReduce, Spark, etc.) for large-scale data processing.
• Strong hands-on experience with PostgreSQL database and Elasticsearch management, including database design, query optimization, and performance tuning.
• Proficiency in programming languages such as Python for data processing, automation tasks, data pipeline operations and system administration tasks related to data infrastructure.
• Strong analytical skills to understand and translate business requirements into effective data engineering solutions.
• Knowledge of API development, microservices architecture, containerization, and orchestration (Docker & Kubernetes)
Qualifications
Cloud related experience is a big plus.
About Standard Chartered
We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.
Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.
Together we:
- Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
- Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
- Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term
What we offer
In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
- Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
- Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
- Flexible working options based around home and office locations, with flexible working patterns.
- Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
- A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
- Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.