
Senior QA Engineer
About Keyloop
Keyloop bridges the gap between dealers, manufacturers, technology suppliers and car buyers.
We empower car dealers and manufacturers to fully embrace digital transformation. How? By creating innovative technology that makes selling cars better for our customers, and buying and owning cars better for theirs.
We use cutting-edge technology to link our clients’ systems, departments and sites. We provide an open technology platform that’s shaping the industry for the future. We use data to help clients become more efficient, increase profitability and give more customers an amazing experience.
We’re excited to announce that Motortech AI are joining the Keyloop family. Bringing their industry leading AI-powered live chat solution, AIME, to Keyloop, we will revolutionize the customer experience in automotive. Their solution will begin rolling out to our thousands of existing clients, as well as many newcomers, this Spring. Want to be part of it?
The Role
As a Senior QA Engineer, you'll own quality across our product portfolio. You'll define and lead our quality strategy across the full platform, from backend services and agent orchestration through to omnichannel communications.
You'll work closely with engineers and product to build in quality from the start, not just a manual check at the end. You’ll design and execute tests to measure the quality of our AI agents, testing for probabilistic outputs, expected reasoning behaviours, performance and overall security.
What You'll Be Doing
Design and own the quality strategy for our AI agent platform, including approaches to testing non-deterministic, LLM-powered systems
Build and maintain automated test suites covering unit, integration, API, and end-to-end scenarios across our TypeScript/Node.js/React/Python stack
Develop evaluation frameworks for agent behaviour, testing reasoning quality, tool use, memory, and multi-step interaction flows
Test and validate our omnichannel communication platform across channels: web, messaging, voice, and beyond
Collaborate closely with engineers and define acceptance criteria that catch issues early in the development cycle
Champion a culture of quality across the team, reviewing test coverage in PRs, advocating for testability in system design, and raising the bar for what "done" means
Use and help shape AI-assisted testing tooling to accelerate coverage and surface issues faster
What We're Looking For
Proven experience as a Senior QA Engineer on complex, production software products
Strong hands-on skills using test frameworks (e.g. Playwright, Cypress, Jest)
Experience testing APIs, backend services, and databases (PostgreSQL or similar)
A clear understanding of how to approach testing non-deterministic systems
Experience designing and implementing QA strategy
Strong communication skills, you can articulate quality risks clearly to both engineers and non-technical stakeholders
Nice to have
Experience evaluating LLM or agentic systems, prompt behaviour, output quality, hallucination risks, or agent evaluation frameworks
Familiarity with performance, load, or chaos testing for real-time or event-driven systems
Background in automotive, dealership tech, or B2B SaaS
Exposure to AI-assisted development and testing tools (e.g. GitHub Copilot, Cursor, Claude Code)
Why Join Us?
We’re on a journey to become market leaders in our space – and with that comes some incredible opportunities. Collaborate and learn from industry experts from all over the globe. Work with game-changing products and services. Get the training and support you need to try new things, adapt to quick changes and explore different paths. Join Keyloop and progress your career, your way.
An Inclusive Environment to Thrive
We’re committed to fostering an inclusive work environment. One that respects all dimensions of diversity. We promote an inclusive culture within our business, and we celebrate different employees and lifestyles – not just on key days, but every day.
Be Rewarded for Your Efforts
We believe people should be paid based on their performance so our pay and benefits reflect this and are designed to attract the very best talent. We encourage everyone in our organisation to explore opportunities which enable them to grow their career through investment in their development but equally by working in a culture which fosters support and unbridled collaboration.
Keyloop doesn’t require academic qualifications for this position. We select based on experience and potential, not credentials.
We are also an equal opportunity employer committed to building a diverse and inclusive workforce. We value diversity and encourage candidates of all backgrounds to apply.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Don't wait, tomorrow could be too late.
About the company
Similar Remote Jobs
Opened 12 days ago Featured Job Remote Job
Freelance DevOps Support Engineer (Part-Time, Remote, Americas Time Zone)nnSoftware GmbHPart Time$33.8k - $67.6k per yearOpened 10 days ago Promoted Job Remote Job
Closes in 6 days Promoted Job Remote Job
Closes in 2 days Promoted Job Remote Job
New Job! Remote Job
