QA Engineer (AI/ML)

About The Company

Special Projects Engineering LLC is an innovative and specialized technology firm based in Seattle, dedicated to solving complex, high-impact problems through the application of advanced artificial intelligence and automation techniques. Our team is composed of elite engineers and researchers who thrive on tackling challenges across diverse domains such as autonomous systems, predictive infrastructure, synthetic biology, and next-generation defense technology. We pride ourselves on our ability to build novel solutions where none previously existed, pushing the boundaries of what is technically possible. Our culture emphasizes innovation, collaboration, and a commitment to developing reliable, safe, and effective AI systems that make a tangible difference in real-world applications.

About The Role

We are seeking a highly skilled QA Engineer with a focus on machine learning and AI systems to join our dynamic team. In this role, you will be responsible for ensuring the reliability, accuracy, and stability of complex intelligent systems that operate in unpredictable and real-world environments. Your primary tasks will include designing and implementing comprehensive testing frameworks, evaluation pipelines, and validation processes for a variety of AI models and deployments. You will collaborate closely with ML engineers to develop testing strategies, validate data inputs and model outputs, and establish performance benchmarks. Your work will be critical in ensuring that our AI solutions are safe, robust, and ready for deployment in demanding operational contexts. This role offers the opportunity to work on cutting-edge projects that directly impact the future of autonomous and intelligent systems, providing you with a platform to demonstrate your expertise and contribute to innovative technological advancements.

Qualifications

Minimum of 3+ years of experience in software QA, test automation, or related fields
Hands-on experience testing machine learning models or AI systems in production environments
Proficiency in Python programming; experience with frameworks such as PyTorch, TensorFlow, or JAX is a plus
Familiarity with the ML lifecycle, including model validation techniques and evaluation metrics
Experience with CI/CD pipelines, automated test frameworks, and debugging tools
Strong attention to detail with an ability to identify edge cases and failure modes
Knowledge of data validation processes, simulation environments, or robotics is advantageous

Responsibilities

Develop and maintain automated test suites for machine learning pipelines and AI-enabled systems
Create comprehensive testing strategies for models handling visual, audio, sensor, and textual data
Validate data inputs, model outputs, and performance benchmarks to ensure system accuracy and robustness
Build tools to support continuous integration, regression testing, and quality assurance processes
Collaborate with ML engineers to define relevant evaluation metrics and acceptable performance thresholds
Ensure AI models are safe, stable, and reliable prior to deployment
Identify gaps in test coverage and develop scalable testing plans aligned with evolving codebases

Benefits

Remote-first work environment with flexible working hours
Competitive salary and equity packages
Comprehensive health, dental, and vision insurance coverage
Access to high-end GPU hardware and advanced compute resources
Opportunity to work on real-world AI systems with a talented, high-caliber team
Fast-paced environment where your contributions have a direct impact on production systems

Equal Opportunity

Special Projects Engineering LLC is committed to fostering an inclusive and diverse workplace. We are an equal opportunity employer and do not discriminate based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or any other protected status. We believe that diverse perspectives and backgrounds drive innovation and excellence, and we welcome applicants from all backgrounds to join our team.
Show more Show less