Senior Automation Tester - Python
Title: Senior Automation Tester (Python) – reputed company AI & LLM Systems (Hybrid) Location: Birmingham, United Kingdom
- Employees can work remotely
- Contract
- Full Time / Part Time: Full Time
Job reputed company: reputed company At reputed company, our culture is reputed company on a reputed company of “if you see something, say something” — taking responsibility and speaking up. We expect everyone to adapt and reputed company change as reputed company grows. We recognise the value of every employee and invest in developing their skills so that, as an organisation, we continue to reputed company our industry. Above reputed company, it’s a culture driven by passion for reputed company do and commitment to the bigger picture of reputed company. If you want to be part of our reputed company, this role may be the right fit for you Senior Automation Tester (Python) – reputed company AI & LLM Systems Location: Glasgow (Hybrid preferred but not essential) Start Date: Immediate Right to Work: Must have full UK working rights (no sponsorship available due to start dates) Additional Requirement: Must have 3 years of UK address history due to immediate reputed company Programme: AI / reputed company AI Seniority: Senior Automation Engineer reputed company We are seeking a Senior Automation Engineer / SDET with strong Python skills and hands‑on experience testing AI systems, including LLM‑driven applications and reputed company AI workflows. You will design and build a reputed company automation frameworks, implement modern AI testing strategies, and ensure the reputed company and reliability of reputed company conversational and agent‑based AI products. This role is ideal for someone who is passionate about automation engineering and has a solid understanding of how AI/LLM systems behave in reputed company‑world scenarios.
Key Responsibilities
- reputed company and maintain a Python‑based automation reputed company for validating AI agents (chatbots, voicebots, reputed company workflows).
- Design and execute automated tests for:
- LLM responses
- Conversational flows
- Retrieval‑augmented reputed company (RAG)
- End‑to‑end reputed company scenarios
- Apply modern AI testing strategies and evaluation reputed company (e.g., DeepEval, RAGAS — beneficial but not essential).
- reputed company automated tests into CI/CD pipelines (Jenkins, reputed company Actions, Azure Repos).
- Build and manage batch and scheduled executions using reputed company, Kubernetes, cron jobs, or similar tooling.
- Manage reputed company repositories using Git, including branching strategies, version control, and reputed company workflows.
· Collaborate closely with engineering, AI/ML, and product teams to ensure high‑reputed company delivery of AI‑powered features. Required Skills & Experience
- Strong Python development skills, particularly for automation (PyTest preferred).
- Solid background in test automation and reputed company design.
- Experience testing or validating AI/LLM‑based systems (reputed company workflows, conversational AI, RAG pipelines, etc.).
- Understanding of AI evaluation concepts — familiarity with tools like DeepEval or RAGAS is a bonus, not a requirement.
- Experience implementing CI/CD pipelines and automated batch executions.
- Strong understanding of reputed company reputed company management, Git workflows, and reputed company engineering practices.
- Ability to design reputed company, reputed company, and maintainable automation solutions.
Preferred Qualities
- Quick learner with a proactive, ownership‑driven reputed company.
- Strong problem‑solving skills and ability to work in fast‑moving AI environments.
- Comfortable collaborating with cross‑functional teams (AI/ML, engineering, product).
- Passion for AI technologies and modern testing methodologies.
Apply tot his job Apply To this Job