PL
QA/Test Engineer
Accepting applicationsPeraton Labs · Annapolis Junction, MD
Full-Time Mid_senior AIPythonaiarmate
Posted
4d ago
Category
Test
Experience
Mid_senior
Country
United States
About Peraton
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees solve the most daunting challenges that our customers face. Visit peraton.com to learn how we're keeping people around the world safe and secure.
About The Role
Peraton Labs is seeking a QA/Test Engineer to develop and maintain testing frameworks that ensure the accuracy, reliability, and consistency of a generative AI-powered analytical platform's outputs and functionality. This role focuses on the unique challenges of testing generative AI-driven systems, including non-deterministic outputs, analytical accuracy validation, and regression testing for AI behavior changes.
Key Responsibilities
Design and implement automated testing frameworks for generative AI agent outputs, including accuracy benchmarks and regression detection
Build validation frameworks for analytical calculations
Develop end-to-end test suites for multi-worker analytical workflows
Implement data quality testing for ingestion pipelines and data fusion outputs
Create test datasets and golden reference outputs for analytical features
Build performance testing frameworks for platform scalability assessment
Develop security testing procedures for sandbox enforcement and access controls
Establish testing standards and quality gates for the CI/CD pipeline
Qualifications
Required Qualifications
Minimum of 5+ years of experience with a Bachelor's degree, 3+ years with a Master's degree, or a PhD in Computer Science or related field
Hands-on QA/test engineering experience
Strong Python proficiency; experience with testing frameworks (pytest, unittest)
Experience with automated testing for data-intensive applications
Understanding of statistical methods for evaluating non-deterministic system outputs
Experience with API testing, integration testing, and end-to-end testing
Familiarity with CI/CD integration for automated test execution
Strong analytical skills and attention to detail
US Citizenship with the ability to obtain/maintain a Secret clearance
Preferred Qualifications
Experience testing generative AI/ML systems or NLP pipelines
Experience with performance testing tools (Locust, k6, or similar)
Knowledge of security testing methodologies
Details
Target Salary Range: $86,000 - $138,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
Benefits Statement: Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed at https://www.careers.peraton.com/benefits.
Application Statements: The application period for the job is estimated to be 30 days from the job posting date. However, this timeline may be shortened or extended depending on business needs and the availability of qualified candidates. By applying to this job, you are expressing interest in the role and the Company. During the review of your application, you may be required to participate in an on-camera interview, as well as participate in a process to verify your identity.
EEO:Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.
Show more Show less
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees solve the most daunting challenges that our customers face. Visit peraton.com to learn how we're keeping people around the world safe and secure.
About The Role
Peraton Labs is seeking a QA/Test Engineer to develop and maintain testing frameworks that ensure the accuracy, reliability, and consistency of a generative AI-powered analytical platform's outputs and functionality. This role focuses on the unique challenges of testing generative AI-driven systems, including non-deterministic outputs, analytical accuracy validation, and regression testing for AI behavior changes.
Key Responsibilities
Design and implement automated testing frameworks for generative AI agent outputs, including accuracy benchmarks and regression detection
Build validation frameworks for analytical calculations
Develop end-to-end test suites for multi-worker analytical workflows
Implement data quality testing for ingestion pipelines and data fusion outputs
Create test datasets and golden reference outputs for analytical features
Build performance testing frameworks for platform scalability assessment
Develop security testing procedures for sandbox enforcement and access controls
Establish testing standards and quality gates for the CI/CD pipeline
Qualifications
Required Qualifications
Minimum of 5+ years of experience with a Bachelor's degree, 3+ years with a Master's degree, or a PhD in Computer Science or related field
Hands-on QA/test engineering experience
Strong Python proficiency; experience with testing frameworks (pytest, unittest)
Experience with automated testing for data-intensive applications
Understanding of statistical methods for evaluating non-deterministic system outputs
Experience with API testing, integration testing, and end-to-end testing
Familiarity with CI/CD integration for automated test execution
Strong analytical skills and attention to detail
US Citizenship with the ability to obtain/maintain a Secret clearance
Preferred Qualifications
Experience testing generative AI/ML systems or NLP pipelines
Experience with performance testing tools (Locust, k6, or similar)
Knowledge of security testing methodologies
Details
Target Salary Range: $86,000 - $138,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
Benefits Statement: Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed at https://www.careers.peraton.com/benefits.
Application Statements: The application period for the job is estimated to be 30 days from the job posting date. However, this timeline may be shortened or extended depending on business needs and the availability of qualified candidates. By applying to this job, you are expressing interest in the role and the Company. During the review of your application, you may be required to participate in an on-camera interview, as well as participate in a process to verify your identity.
EEO:Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.
Show more Show less
Similar Jobs
AM
Material Handler III
Applied Materials · Austin, United States, North America
N
Developer Advocate – Robotics and Physical AI
NVIDIA · Santa Clara, United States, North America
N
Principal Machine Learning Engineer, Accelerated Apache Spark
NVIDIA · Santa Clara, United States, North America
AD
Counsel, Corporate Attorney
Analog Devices · Wilmington, United States, North America