Encode Testers
Request Free QA Audit
EncodeTesters Enterprise Platform
AI & Innovation Lab Full-time Mid-Senior (4+ years)

AI Quality Assurance Specialist & Prompt Engineer

Austin, TX / Remote
$135,000 - $160,000

Role Overview

Join our AI Innovation Lab to define the emerging standards for testing generative AI applications. You will benchmark LLM reasoning accuracy, detect model drift and hallucination, and build autonomous agents that navigate web and mobile interfaces.

Key Responsibilities

  • Build automated evaluation harnesses for enterprise Generative AI applications
  • Develop autonomous crawler bots that discover edge-case application bugs
  • Research novel approaches to synthetic test data generation using generative models
  • Author technical whitepapers and open-source testing utilities

Qualifications & Experience

  • 4+ years in software quality engineering with strong Python development skills
  • Hands-on experience with OpenAI APIs, LangChain, or open-source LLMs (Llama 3, Mistral)
  • Familiarity with prompt evaluation techniques, RAG benchmarking, and vector databases
  • Demonstrated passion for pushing the boundaries of autonomous software testing

Benefits & Perks

  • Cutting-edge AI research computing infrastructure and GPU access
  • Full health, dental, and life insurance benefits
  • Stock options package in a high-growth enterprise
  • Generous flexible time off policy

Apply for this Position

Our talent acquisition squad responds to all applicants within 48 hours.