Job Summary

•    This role bridges the gap between platform teams and business teams, focusing on enabling chatbot functionality, refining outputs from knowledge management systems, and fostering collaboration. This role is crucial for leveraging generative AI technologies to ensure that the systems are reliable, fair, and aligned with user expectations.
•    Advocate for the adoption of cutting-edge AI technologies and frameworks, driving the evolution of backend practices to meet future challenges.
Key responsibilities
Chatbot Enablement:
•    Oversee the deployment and optimization of chatbot systems.
•    Refine chatbot outputs by improving the underlying knowledge management system and ensuring accuracy and relevance.
Collaboration:
•    Work with platform teams to provide feedback on model improvements.
•    Collaborate with developers and data scientists to refine algorithms
•    Partner with business teams to understand their needs and tailor chatbot solutions accordingly.
Knowledge management:
•    Collaborate with knowledge management specialists to maintain and update the chatbot's knowledge base.
•    Ensure that the chatbot understands context and provides meaningful responses.
Data quality assurance:
•    Preprocess test data and verify the integrity of training data.
•    Identify issues related to data bias or insufficiency
Developing testing strategies:
•    Design and implement robust testing strategies 
•    Create automated test suites for AI/ML pipelines and APIs
Testing Generative AI Systems:
•    Validate outputs for accuracy, consistency, and fairness.
•    Conduct functionality, performance, load, and stress testing
•    Ensure compliance with ethical standards by identifying biases
Documentation and reporting:
•    Document test cases, procedures, and results.
•    Analyse trends in validation data to identify areas for improvement

Key Responsibilities

Training and feedback:
•    Conduct training sessions for business users to maximize chatbot adoption.
•    Gather feedback from users and stakeholders to inform ongoing improvements.
Monitoring and reporting:
•    Monitor chatbot performance metrics (e.g., response accuracy, user satisfaction).
•    Provide regular reports to stakeholders on system effectiveness and areas for enhancement.

Strategy
•    Oversees the execution of functional standards and best practices and provide technical assistance to the members of their Chapter. 
•    Responsible for the quality of the code repository where applicable. 
•    Acts as a conduit for the wider domain strategy, for example technical standards. 
•    Prioritises and makes available capacity for technical debt. 
•    This role is around capability building, it is not to own applications or delivery. 
•    Actively shapes and drives towards the Bank-Wide engineering strategy and programmes to uplift standards and steer the technological direction towards excellence
•    Act as a custodian for Java backend expertise, providing strategic leadership to enhance skill sets and ensure the delivery of high-performance banking solutions.
Business 
•    Experienced practitioner and hands on contribution to the squad delivery for their craft (Eg. Engineering).
•    Responsible for balancing skills and capabilities across teams (squads) and hives in partnership with the Chief Product Owner & Hive Leadership, and in alignment with the fixed capacity model.
•    Responsible to evolve the craft towards improving automation, simplification and innovative use of latest market trends.
•    Collaborate with product owners and other tech leads to ensure applications meet functional requirements and strategic objectives

Skills and Experience

Processes
•    Promote a feedback-rich environment, utilizing internal and external insights to continuously improve chapter operations.
•    Adopt and embed the Change Delivery Standards throughout the lifecycle of the product / service. 
•    Ensure role, job descriptions and expectations are clearly set and periodic feedback provided to the entire team. 
•    Follows the chapter operating model to ensure a system exists to continue to build capability and performance of the chapter. 

People & Talent
•    Collaborate and help develop skills and capabilities as the highest priority. 
Risk Management

•    Ensures the chapter follows the standards with respect to risk management as applicable to their chapter domain. 
•    Adheres to common practices to mitigate risk in their respective domain. 
•    Design and uphold a robust risk management plan, with contingencies for succession and role continuity, especially in critical positions.

Governance
•    Ensure all artefacts and assurance deliverables are as per the required standards and policies (e.g., SCB Governance Standards, ESDLC etc.). 

Qualifications

•    Soft Skills:
•    Strong communication skills for cross-team collaboration.
•    Critical thinking to anticipate potential risks in AI models and knowledge management systems.
•    Analytical mindset to refine outputs based on feedback and performance data.
•    Ability to interpret complex data and identify trends.

Technical Skills:
•    Proficiency in AI, programming languages such as Python or Java.
•    Experience with testing frameworks like PyTest.
•    Familiarity with ML frameworks (e.g., TensorFlow, PyTorch) and LLMs (e.g., GPT 35).
•    Understanding of CI/CD pipelines and tools Azure DevOps

Qualifications
•    Bachelor’s degree in computer science, software engineering, or a related field.
•    2–3+ years of experience in QA engineering or validation roles focused on AI/ML systems.
•    Knowledge of ethical AI principles and regulatory compliance standards.
•    Ability to work effectively in a fast-paced, dynamic environment. 

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.