Senior Quality Assurance Specialist

About the role

We are looking for a Senior Quality Assurance Specialist to evaluate our Agent‑as‑a‑Service conversational AI platform for Arabic‑speaking customers, with a focus on Kuwaiti and Najdi dialects. This role goes beyond traditional QA; you will assess linguistic authenticity, contextual understanding, business rule compliance, and safety across real multi‑turn conversations.

Key responsibilities

• Dialect & Linguistic QA: test responses for dialect authenticity, grammar, tone, code‑switching, and spelling.
• Conversational QA: verify context retention, pronoun resolution, topic switching, and handling of emotional or noisy inputs.
• Intent & Instruction Following: ensure correct handling of bookings, pricing queries, complaints, and escalation triggers.
• RAG & Knowledge QA: detect hallucinations, outdated information, and unsupported answers.
• Cultural & Regional QA: validate local terminology, conventions, dates, currency, and idioms.
• Safety & Adversarial Testing: run prompt‑injection, jailbreak, and abusive‑input scenarios in Arabic.
• Regression Suite: create permanent test cases for every confirmed bug and run them after each model change.

Required profile

• Senior‑level experience in quality assurance for conversational AI or large language models.
• Deep knowledge of Kuwaiti and Najdi Arabic dialects, including code‑switching and cultural nuances.
• Strong analytical skills to evaluate multi‑turn dialogues and safety edge cases.

Required skills