AI Quality Analyst
Role summary by JobGrid
AI Quality Analyst at Texas Sports Academy Main is a remote role in Canada in IT, classified by JobGrid as Senior QA / Test Automation. JobGrid normalizes the public posting into comparable role facts and shows source freshness from the latest posted and checked timestamps, while keeping the employer application path directed to the original public application page with non-personal referral parameters appended. This listing is part of JobGrid's Remote AI jobs from public company career pages.
- Remote, Canada; workplace: remote; country: Canada.
- Category: IT; subcategory: QA / Test Automation; seniority: Senior.
- No salary was provided in the source payload, so JobGrid cannot add salary context.
- The employer description is kept separate; this page content is based on structured JobGrid facts only.
We run an AI-powered SMS bot and an AI-graded call training system for a private school
network. Both systems have extensive test suites (400+ test files) and a RAG-based knowledge
base that drives bot behavior
We need someone to own the full quality cycle:
- Review production conversations to find bad bot responses
- Create test files (JSON) that reproduce the issue
- Fix the knowledge base content (Markdown files, WRONG/RIGHT examples)
- Run test suites to verify fixes and catch regressions
- Maintain and expand the knowledge base as our program evolves
This is NOT a software engineering role. The infrastructure is built. You're operating it — editing
JSON, writing Markdown, running CLI scripts, reading test reports.
What You'll Work With
- JSON test files (you'll write and edit these daily)
- Markdown knowledge base documents
- Terminal commands (copy-paste and run scripts)
- Git (commit, push, basic branching)
- VS Code or similar editor