769 evaluation engineer jobs found

Location: Remote Compensation: Early-team phantom equity pool Type: Full-Time or Contractor 🔥 About the Opportunity Inkognido is building the AI backbone of a new entertainment ecosystem — avatar intelligence, emotional engines, and dynamic NPC systems that evolve across multiple games and worlds. To make this possible, we need elite-level internal tools: Evaluation dashboards Prompt-testing utilities Behavior-routing tools Model comparison suites Emotional output analyzers Memory debugging systems The AI Tools Engineer builds the systems our entire AI team relies on. If you’ve ever said: “The model isn’t the hard part — the tooling is.” “I love building dashboards, inspectors, and developer utilities.” “I want to make AI behavior predictable and measurable.” “Give me a chaotic ML pipeline and I’ll bring order to it.” Then this role is EXACTLY for you. 🧩 What You’ll Build You will create the internal tools that make LLM development faster, more reliable, and...

Equal opportunity employer Remote-friendly culture Competitive benefits package Machine Learning Engineer - Model Evaluations, Public Sector The Public Sector ML team at Scale deploys advanced AI systems—including LLMs, agentic models, and multimodal pipelines—into mission-critical government environments. We build evaluation frameworks that ensure these models operate reliably, safely, and effectively under real-world constraints. As an ML Engineer, you will design, implement, and scale automated evaluation pipelines that help customers trust and operationalize advanced AI systems across defense, intelligence, and federal missions. You will: Develop and maintain automated evaluation pipelines for ML models across functional, performance, robustness, and safety metrics, including LLM-judge–based evaluations. Design test datasets and benchmarks to measure generalization, bias, explainability, and failure modes. Build evaluation frameworks for...

Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for MTA, Inc.. Clicking "Apply Now" or "Read more" on Lensa redirects you to the job board/employer site. Any information collected there is subject to their terms and privacy notice. Assistant Director Project Management (Stations) Job ID: 14000 Business Unit: MTA Construction & Development Location: New York, NY, United States Regular/Temporary: Regular Department: Stations Date Posted: Dec 19, 2025 Description This position is eligible for telework , which is currently one day per week. New hires are eligible to apply 30 days after their effective date of hire. Job Title Assistant Director, Project Management Agency Construction &...

Description Do you want to lead the development of hybrid AI systems that apply and combine both statistical machine learning methods and cutting-edge mathematical optimization algorithms? Do you want to lead the technological transformation into the future of Intelligence, Surveillance, Reconnaissance (ISR) and Targeting? Are you excited about leading expert teams in training ML algorithms, developing AI agents, and developing trustworthy autonomous decision-making systems that orchestrate sensors, fuse divergent data, and make intelligent inferences in complex operational environments? If so, we’d love for you to join our team at APL. We are seeking a Senior Applied AI Researcher / Engineer with expertise in agentic AI, machine learning, and resource optimization to lead the design, implementation, and evaluation of next-generation AI-enabled ISRT systems. In this role, you will drive technical direction, mentor junior staff, and partner with program...

Description Who We Are Enovate is an Engineering firm that specializes in Construction Management, Transportation Engineering and Monitoring services. Since its inception a few years ago, Enovate was able to position its brand as a leading WBE/DBE engineering/CM firm. We have teamed with and supported well-known Engineering and CM firms and worked on flagship projects in both the public and private sectors. Our diverse team consists of Professional Engineers, Construction Managers, Engineers and Technicians from varied backgrounds – design, project management and construction. This is an opportunity to work with Enovate as we expand to meet the demand of this wide range of services and excel in a traditional industry that is ever changing with the adoption of technology. We have been honored with a certification from Great Places to Work, listed on the FORTUNE Best Places to Work in NY and Best Small Workplaces lists, and received an ACEC NY Pioneer of Belonging Award for...

We are seeking a skilled and motivated engineer to join our growing team. In this role, you will report to the Senior Manager of the Technical Operations Centre and play a key part in supporting and maintaining complex, cutting-edge broadcast video systems. As a Broadcast Engineer, your primary responsibility will be to provide expert-level support for a range of advanced technologies, including software-defined video networking, video compression and content processing systems, orchestration platforms, and network management and monitoring tools. This position offers a unique opportunity to work at the forefront of broadcast technology, collaborating with engineering teams and customers to ensure optimal system performance and rapid issue resolution. Responsibilities: Act as an expert level technical advisor or specialist on complex broadcast initiatives. Perform system monitoring, verifying the integrity and availability of all broadcast hardware, server resources,...

Company Description Why Wellmark : We are a mutual insurance company owned by our policy holders across Iowa and South Dakota, and we’ve built our reputation on over 80 years’ worth of trust. We are not motivated by profits. We are motivated by the well-being of our friends, family, and neighbors–our members. If you’re passionate about joining an organization working hard to put its members first, to provide best-in-class service, and one that is committed to sustainability and innovation, consider applying today! Why Wellmark Technology? Wellmark is building innovative, modern solutions using cutting edge technology. We are driving organizational transformation and business strategy by empowering our technology team to innovate new and elegant solutions to enhance the customer experience. Together, we are leaning into the future, owning the outcome, and driving organizational change to transform how we work. Job Description As a Platform/Staff Security Engineer,...

Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine learning — position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the...

Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine learning — position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the...

Why Wellmark : We are a mutual insurance company owned by our policy holders across Iowa and South Dakota, and we’ve built our reputation on over 80 years’ worth of trust. We are not motivated by profits. We are motivated by the well-being of our friends, family, and neighbors–our members. If you’re passionate about joining an organization working hard to put its members first, to provide best-in-class service, and one that is committed to sustainability and innovation, consider applying today! Why Wellmark Technology? Wellmark is building innovative, modern solutions using cutting edge technology. We are driving organizational transformation and business strategy by empowering our technology team to innovate new and elegant solutions to enhance the customer experience. Together, we are leaning into the future, owning the outcome, and driving organizational change to transform how we work. Job Description As a Platform/Staff Security Engineer, your role is to bridge the gap...

Overview The Agency of Transportation is seeking an AOT Manager to lead a small team of data professionals responsible for crash data analysis, visualization, reporting, collection, quality control, and data management. This work plays a critical role in improving the accuracy, completeness, and timeliness of crash data used to inform transportation safety decisions across the state. In this role, the Manager will support and guide the Crash Data Unit while ensuring federal requirements are met and stakeholder needs are addressed. The position balances people leadership with hands-on involvement in day-to-day analytical work, helping ensure that analysis tools and related programs are operating effectively and producing meaningful results. The Manager will also contribute to the continued growth and improvement of crash data programs through stakeholder engagement and thoughtful program development. The ideal candidate brings strong leadership skills,...

Date: Dec 30, 2025 Location: Annapolis Junction, MD, Maryland, United States Company: HII's Mission Technologies division Requisition Number: 26420 Required Travel: 0 - 10% Employment Type: Full Time/Salaried/Exempt Anticipated Salary Range: $111,494.00 - $130,000.00 Security Clearance: Secret Level of Experience: Mid This opportunity resides with Warfare Systems (WS) , a business group within HII’s Mission Technologies division. Warfare Systems comprises cyber and mission IT; electronic warfare; and C5ISR systems. HII works within our nation’s intelligence and cyber operations communities to defend our interests in cyberspace and anticipate emerging threats. Our capabilities in cybersecurity, network architecture, reverse engineering, software and hardware development uniquely enable us to support sensitive missions for the U.S. military and federal agency partners. Meet HII’s Mission Technologies Division Our team of more than...

Software Engineer - Robotics & Autonomous Systems Scale's Robotics business unit is dedicated to solving the data bottleneck in Physical AI across Robotics, Autonomous Vehicles, and Computer Vision. In this role, you'll be a key contributor building production systems for robotics data collection, model training pipelines, and evaluation infrastructure. You'll have the opportunity to own critical parts of our robotics platform, work directly with cutting-edge robotics and AV customers, and shape the future of embodied AI systems. You Will: Own and architect large-scale data processing pipelines for robotics and autonomous vehicle datasets Build ML training and fine-tuning pipelines using Scale's robotics data Work across backend (Python, Node.js, C++) and frontend (React, TypeScript) stacks to build end-to-end solutions Develop tools and systems for robotics data collection, teleoperation, and model evaluation Interact directly with robotics and AV...

Job Family Data Science & Analysis Travel Required Up to 10% Clearance Required Active Top Secret (TS) Guidehouse is seeking a Lead AI/ML Engineer to join our Technology / AI and Data team, supporting mission-critical initiatives for Defense and Security clients. In this role, you will help design and operationalize advanced AI solutions that leverage large language models (LLMs), retrieval systems, and secure, scalable inference pipelines to enable data-driven decision-making. You will lead efforts to ensure models are accurate, reliable, and compliant with stringent security and regulatory standards, while collaborating with architects, engineers, and subject matter experts to deliver innovative solutions that enhance operational effectiveness. This is an opportunity to shape cutting-edge AI capabilities that directly support national security objectives. What You Will Do Serves as the lead AI/ML engineer responsible for developing, optimizing, and...

Summary This is a public notice flyer to notify interested applicants of anticipated vacancies. Applications will not be accepted through this flyer. Interested applicants must follow the directions in the "How to Apply" section of this flyer to be considered. There may or may not be actual vacancies filled from this flyer. Notice of Result letters will not be sent to applicants who respond to this flyer. GS:12- $100,371 - $130,488 GS:11- $83,742 - $108,859 This job is open to The public U.S. Citizens, Nationals or those who owe allegiance to the U.S. Clarification from the agency U.S. Citizens Duties You will be responsible for all tasks involved in issuing/reviewing/validating detailed engineering plans and reports. You will be responsible for the technical support associated with all Advanced SEAL Delivery System mobility activities. You will coordinate and provide oversight of the development and accomplishment of Ship...

Sr. Project Engineer – Medical Safety Testing, Boxborough, MA Intertek, a leading provider of quality and safety solutions to many of the world’s top-recognized brands and companies, is actively seeking a Sr. Project Engineer - Medical to join our Electrical team in Boxborough, MA . Intertek's Electrical business line applies more than 100 years of product testing expertise to quickly and efficiently help clients meet safety, performance, environmental and quality requirements for every market. Spanning a wide range of industries such as Medical, Lighting, Renewable Energy, HVACR, Appliances & Electronics, Hazardous Locations, Industrial Equipment, Life Safety & Security, IT & Telecom Equipment, Intertek's global network of laboratories employ world-class experts in their fields who deliver quality, accurate testing and certification that continually exceeds our clients' expectations and helps to clear a path for their product's success. Intertek is...

Job Description: Join our Team: Design Engineer Watertown, SD Join our team at Terex Utilities and embark on an exciting opportunity as we seek a skilled and dedicated Design Engineer to contribute to the Terex Utilities Team. At Terex Utilities we believe in fostering a vibrant and inclusive work culture where every person is empowered to thrive. We're dedicated to driving quality, innovation, embracing diversity, and creating an environment where everyone feels valued and respected. We're committed to excellence in everything we do, and we're seeking talented individuals who share our passion and values to join our team. We are looking to fill a position for a Design Engineer in the Installation Design Department. This full-time role requires strong attention to detail and problem-solving skills. The engineer will be responsible for creating 3D models, 2D drawings, and bills of materials (BOMs) that guide production in installing our equipment on assorted vehicles....

SRC is continuing and expanding their support of the Navy’s Network Security Integrated Product Team (NS IPT) program. The purpose of the Navy Network Security Integrated Product (NS IPT) program is to augment CND capabilities and integrate them into the unique environments encountered by Navy forces. Navy CND is an integral part of the cyber defense posture, protecting the Navy’s component of the Global Information Grid (GIG) from exploitation and strongly linking to critical infrastructure protection. Naval Information Warfare Center (NIWC) Atlantic requires resources to support the Research, Development, Test & Evaluation (RDT&E) and Integration activities for the Information Technology for the 21st Century (IT-21), and OCONUS Navy Enterprise Network (ONENET) networks, to enhance network and cybersecurity. Acting as a member of the Integrated Logistics Support (ILS) team Developing and maintaining program specific logistics technical documentation, such as:...

Location: Hybrid (remote/office in Princeton, NJ) . Type: Full-Time US Citizenship Required Overview: BANC3, Inc., a small business in Princeton, NJ, is seeking a Software Engineer responsible for the research, design, development, test and evaluation of software applications supporting advanced Radio Frequency (RF) systems for spectrum monitoring, electronic warfare and electronic intelligence missions, and Software Defined Radio (SDR) for satellite communications. Work will include specifying system architectures that support high-speed network interfaces, implementing digital signal processing algorithms, developing graphical user interfaces for display of complex RF environments, interfacing with real-time signal processing implemented in FPGAs, and providing user controls for the RF system components. The candidate should be familiar with implementing software solutions derived from mathematical models developed using tools like MATLAB and GnuRadio....

Summary As a new Software Engineer, NSA has opportunities for you to contribute, learn, and grow in virtually any Computer Science focus area, including: Cybersecurity, High Performance Computing (HPC), Quantum Computing Research, Data Analytics, Machine Learning/Artificial Intelligence (ML/AI), Cryptology/Cryptography, and countless others. For more information, please visit: https://apply.intelligencecareers.gov/job-description/1252381 This job is open to The public U.S. Citizens, Nationals or those who owe allegiance to the U.S. Federal employees - Excepted service Current federal employees whose agencies have their own hiring rules, pay scales and evaluation criteria. Veterans Veterans of the U.S. Armed Forces or a spouse, widow, widower or parent of a veteran, who may be eligible for derived preference Recent graduates Individuals who have graduated from an accredited educational institute or certificate program...

Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for General Motors. Clicking "Apply Now" or "Read more" on Lensa redirects you to the job board/employer site. Any information collected there is subject to their terms and privacy notice. Job Description To help facilitate administration of relocation benefits if you are selected, please apply using the permanent address you would move from. Location s (in priority order): Sunnyvale, California Mountain View, California Work Arrangement Hybrid: This internship is categorized as hybrid. The selected intern is expected to report to the office up to three times per week or as determined by the team. About The Role As a Simulation Test...

Overview At PNNL, our core capabilities are divided among major departments that we refer to as Directorates within the Lab, focused on a specific area of scientific research or other function, with its own leadership team and dedicated budget. Our Science & Technology directorates include National Security, Earth and Biological Sciences, Physical and Computational Sciences, and Energy and Environment. In addition, we have an Environmental Molecular Sciences Laboratory, a Department of Energy, Office of Science user facility housed on the PNNL campus. The National Security Directorate (NSD) drives science-based, mission-focused solutions to take on complex, real-world threats to our nation and the world. The AI and Data Analytics Division, part of NSD, consists of over 400 staff and combines profound domain expertise and creative integration of advanced hardware and software to deliver computational solutions that address complex data and analytic challenges. Working in...

The duties that the incumbent of the vacancy will be expected to perform. Duties Description The NYS Thruway Authority (NYSTA) is recruiting for several Professional Engineer 1 (Civil/Transportation) roles within the New York Division. Under the direction of senior engineering staff, the incumbents will perform a broad range of engineering responsibilities to support their assigned Division’s construction, inspection, highway maintenance, bridge, and/or capital program activities. Various duties may include the following: Construction: • Direct and supervise highway, bridge, and architectural construction projects.• Monitor progress, review CPM schedules, contract payments, and ensure compliance with specifications.• Conduct regular field inspections to verify work meets contract requirements.• Review and approve submittals, shop drawings, mix designs, and respond to contractor inquiries.• Manage consultant agreements, budgets, staffing levels, and performance ratings.• Review cost...

The duties that the incumbent of the vacancy will be expected to perform. Duties Description The NYS Thruway Authority (NYSTA) is recruiting for several Professional Engineer 1 (Civil/Transportation) roles within the New York Division. Under the direction of senior engineering staff, the incumbents will perform a broad range of engineering responsibilities to support their assigned Division’s construction, inspection, highway maintenance, bridge, and/or capital program activities. Various duties may include the following: Construction: • Direct and supervise highway, bridge, and architectural construction projects.• Monitor progress, review CPM schedules, contract payments, and ensure compliance with specifications.• Conduct regular field inspections to verify work meets contract requirements.• Review and approve submittals, shop drawings, mix designs, and respond to contractor inquiries.• Manage consultant agreements, budgets, staffing levels, and performance ratings.• Review cost...