Senior Quality Automation Engineer (Playwright) -AI

Urgent requirement for Senior Quality Automation Engineer (Playwright) in Banking domain is required for our banking clients in Abu Dhabi ,UAE

N/AUI/API test automation Distributed system validation AI/LLM quality testing is mustDep expertise in automation frameworks (Playwright), backend validation, and AI/LLM testing with strong collaboration skills to work closely with engineering and product teams.--MustStrong hands-on experience with TypeScript, JavaScript, or Python.--MustFamiliarity with AI testing tools such as Ragas or LangSmith.--MustDeep understanding of microservices architecture,event-driven systems (Kafka-based workflows) & ensuring data integrity across distributed environments.--Must
. Position OverviewWe are seeking a highly skilled Senior Quality Automation Engineer to drive end-to-end quality assurance across UI, APIs, and AI-driven systems. This role is pivotal in ensuring reliability, scalability, and accuracy across distributed microservices and modern event-driven architectures.The ideal candidate will combine deep expertise in automation frameworks (Playwright), backend validation, and AI/LLM testing with strong collaboration skills to work closely with engineering and product teams.2. Key ResponsibilitiesAutomation & Framework Development

• UI/API Test Automation: Build and maintain scalable automation frameworks using Playwright.
• Backend Validation: Validate microservices, APIs, and event-driven workflows.
• Distributed System Testing: Ensure data integrity across Kafka-based and microservice architectures.

AI/LLM Quality Assurance

• GenAI Output Evaluation: Test and benchmark AI/LLM responses for accuracy, relevance, and safety.
• Prompt Validation: Develop and manage datasets for prompt testing and validation.
• AI Testing Tools: Leverage Ragas, LangSmith, and other frameworks for systematic AI evaluation.

Collaboration & DevOps Integration

• Cross-Team Collaboration: Partner with engineering and product teams to embed quality into every stage of development.
• CI/CD Practices: Integrate automated tests into pipelines for continuous delivery.
• Modern DevOps: Utilize Docker and Kubernetes for scalable test environments.

3. Required Qualifications & Skills

• Education: Bachelor’s or Master’s in Computer Science, Engineering, or related field.
• Programming Expertise: Strong hands-on experience with TypeScript, JavaScript, or Python.
• Automation Tools: Proven expertise with Playwright (mandatory).
• Distributed Systems: Experience validating Kafka-based workflows and microservices.
• AI/LLM Testing: Demonstrated ability to test GenAI outputs and manage prompt datasets.
• DevOps: Familiarity with CI/CD pipelines, Docker, Kubernetes.
• Soft Skills: Excellent communication, problem-solving, and collaboration abilities.

4. Core Competencies

• Automation Proficiency: Ability to design and scale test frameworks.
• AI/LLM Testing: Deep understanding of GenAI evaluation methodologies.
• System Validation: Strong grasp of distributed architectures and event-driven systems.
• DevOps Mindset: Skilled in integrating QA into modern development workflows.