AI & Innovation Lab
Full-time
Mid-Senior (4+ years)
AI Quality Assurance Specialist & Prompt Engineer
Austin, TX / Remote
$135,000 - $160,000
Role Overview
Join our AI Innovation Lab to define the emerging standards for testing generative AI applications. You will benchmark LLM reasoning accuracy, detect model drift and hallucination, and build autonomous agents that navigate web and mobile interfaces.
Key Responsibilities
- Build automated evaluation harnesses for enterprise Generative AI applications
- Develop autonomous crawler bots that discover edge-case application bugs
- Research novel approaches to synthetic test data generation using generative models
- Author technical whitepapers and open-source testing utilities
Qualifications & Experience
- 4+ years in software quality engineering with strong Python development skills
- Hands-on experience with OpenAI APIs, LangChain, or open-source LLMs (Llama 3, Mistral)
- Familiarity with prompt evaluation techniques, RAG benchmarking, and vector databases
- Demonstrated passion for pushing the boundaries of autonomous software testing
Benefits & Perks
- Cutting-edge AI research computing infrastructure and GPU access
- Full health, dental, and life insurance benefits
- Stock options package in a high-growth enterprise
- Generous flexible time off policy
Apply for this Position
Our talent acquisition squad responds to all applicants within 48 hours.