EverWatch

AI Test Engineer

Job Locations US-MD-Annapolis Junction
Posted Date 19 hours ago(8/29/2025 3:44 PM)
ID
2025-3358
# of Openings
1
Category
Software Testing

Job Title

AI Test Engineer

Overview

EverWatch is a government solutions company providing advanced defense, intelligence, and deployed support to our country’s most critical missions.  We are a full-service government solutions company. Harnessing the most advanced technology and solutions, we strengthen defenses and control environments to preserve continuity and ensure mission success.

 

EverWatch employees are focused on tackling the most difficult challenges of the US Government. We offer the best salaries and benefits packages in our industry - to identify and retain the top talent in support of our critical mission objectives.

 

Commitment to Non-Discrimination:

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

Responsibilities

When a user tries new software, they expect it to be intuitive and run smoothly. Functionality, reliability, and user experience are key to successful software developmentand that means rigorous testing. That’s why we need you, an experienced test engineer who knows how to thoroughly test software and work with developers to make sure our team releases the best software possible.   

 

As a test engineer on our team, you’ll use your experience to work with AI/ML developers to evaluate software developed for national security. You’ll create a test plan with test cases based on user stories. Using automation to streamline, you’ll generate data and implement the test cases to observe how the software performs, then document the results and communicate defects to the development team so they can start improving the tool.  

 

You’ll automate continuous security and performance testing and monitor the health of AI applications. This is an opportunity to supercharge your skills by writing the code to test. You’ll also broaden your experience in AI/ML application testing and gain skills in new areas such as prototyping emergent techniques in algorithmic and hardware system optimizations while sharing your testing experience with your team.  

 

Work with us as we develop software solutions to protect our nation's critical infrastructure. 

 

Join us. The world can’t wait.  

Qualifications

You Have: 

  

  • Experience with ML Frameworks (e.g., Pytorch, JAX) and compiler tooling (e.g., MLIR) for AI/ML application testing 
  • Experience in Test and Evaluation (T&E) for deep learning software stacks, with a particular emphasis on pre-training and inference of generative workloads 
  • Experience developing validation plans, benchmarks, and test scripts to evaluate stability, performance, and power consumption of hardware systems such as GPU-based HPCs and Al Application Specific Integrated Circuits (ASICS) 
  • Experience in profiling a diversity of hardware systems such as GPUs, FPGAs, or ASICS for maximizing latency, throughput, and efficiency 
  • Experience with system administration and deploying Machine Learning (ML) or HighPerformance Computing (HPC) workloads in production 
  • Experience supporting and debugging AI applications used by internal applied researchers to improve their software workflows for production 
  • TS/SCI with a polygraph
  • Master's degree in a technical field, physics, or mathematics and 5+ years of experience in test engineering or a Bachelor's degree in a technical field, physics, or mathematics and 7+ years of experience in test engineering 

 

Nice If You Have: 

  

  • Experience implementing GPY programming and distributed/parallel computing algorithms
  • Experience interacting with internal researchers to help specify benchmarking plans and validation test scripts

  

 

 

Clearance:

 

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance with a polygraph is required.  

 

 

Compensation at EverWatch is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $84.14 to $105.77 per hour.  The estimate displayed represents the typical compensation range for this position and is just one component of EverWatch’s total compensation package for employees.

Clearance Level

TS/SCI FSP

Job Locations

US-MD-Annapolis Junction

Skills

Automated Testing, Software Test, Artificial Intelligence, GPU, Machine Learning

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed