LangChain QA Engineer - 100% REMOTE
washington, VA
Experience: 0
Category: Information Technology
Contractor Work Model: Remote
Brand: System One
Compensation Range: 60.00 - 80.00 Per Hour
Job ID: 377821
Date Posted: 07/31/2026
Shortcut: http://jobs.systemone.com/YFwyoe
Job Title: LangChain QA Engineer
Location: 100% Remote
Type: Long-Term Contract
Compensation: Negotiable, W-2 or C2C
Work Model: Remote – offsite
Hours: 40 hours a week
Security Clearance: No clearance but must pass background check which will include credit check
Ideal Candidate Profile
A highly technical engineer who understands both modern software engineering and AI systems. This individual can independently assess whether an AI solution is accurate, secure, explainable, compliant, observable, and ready for production. They serve as the organization's independent quality authority for AI-powered solutions and help establish confidence in enterprise AI deployments before release to production.
Responsibilities
• Establish and execute quality, validation, certification, and production readiness processes for AI-powered SDLC and enterprise automation solutions
• Develop and implement evaluation frameworks measuring accuracy, relevance, groundedness, completeness, hallucination rates, retrieval quality, recommendation quality, and user satisfaction
• Validate Retrieval-Augmented Generation (RAG) solutions utilizing Azure AI Search, Azure AI Foundry, LangChain, LangGraph, and enterprise repositories
• Perform architecture reviews and quality assessments for AI solutions deployed on Azure services such as Containers, Functions, Databricks, SQL, Cosmos DB
• Evaluate AI orchestration workflows including prompt execution, agent routing, tool calling, guardrails, retrieval pipelines, and human-in-the-loop processes
• Validate security, governance, auditability, and compliance controls, including integrations with Entra ID, RBAC, managed identities, Key Vault, and data policies
• Create production readiness checklists covering observability, monitoring, resiliency, recoverability, and operational support
• Analyze traces, logs, metrics, and telemetry data to identify quality concerns and improvement opportunities
• Collaborate with development teams for remediation of quality, security, and performance issues before deployment
• Generate certification reports, scorecards, dashboards, and executive summaries for leadership review
• Drive continuous improvements to validation methodologies, testing strategies, and evaluation frameworks
• Lead certification and production readiness reviews for internal developer portals and platform initiatives
Requirements
• Bachelor’s Degree in Computer Science, Software Engineering, Data Science, AI, or related field
• 5+ years of experience in software quality engineering, platform engineering, software development, or related roles
• 2+ years working directly with Generative AI, LLMs, RAG architectures, AI agents, or AI applications
• Strong understanding of AI evaluation methodologies including accuracy testing and hallucination detection
• Experience with Azure AI Foundry, Azure OpenAI, LangChain, LangGraph, LangSmith, or similar frameworks
• Familiarity with cloud-native architectures and Azure services (Container Apps, Functions, Databricks, SQL, Key Vault, Cosmos DB)
• Experience supporting enterprise developer platforms and self-service engineering capabilities
• Skilled in designing automated test strategies, regression testing, and certification processes
• Strong analytical, troubleshooting, and documentation skills
• Excellent stakeholder engagement and communication abilities
Preferred Qualifications
• Experience building or validating enterprise AI agents and multi-agent systems
• Knowledge of AI observability and evaluation platforms like LangSmith
• Familiarity with knowledge retrieval solutions, embeddings, and semantic search
• Background in AI governance, Responsible AI, and compliance frameworks
• Experience working in regulated industries such as healthcare, finance, or insurance
• Proficiency with Azure DevOps, GitHub, and SDLC tooling
• Knowledge of identity management concepts including Entra ID and RBAC
• Ability to produce quality scorecards, dashboards, and KPI reports
System One, and its subsidiaries including Joulé and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.
System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.
#M1
#LI-CB3
Ref: #851-Rockville-S1
-
Agentic AI Engineer
Pittsburgh, Pennsylvania
Job Title: Agentic AI Engineer Location: Pittsburgh, PA/Dallas, TX/Cleveland, OH Type: Contract To Hire Responsibilities Build AI agents capable of reasoning, planning, memory management, and autonomous task execution. Implement workflow configuration ...
Date Posted: 06/15/2026 Recommended
-
Design Engineer II
Broken Arrow, Oklahoma
System One is working with a local client to find a Design Engineer II Design Engineer II Responsibilities Analyze products and tooling to develop and maintain design standards and specifications that meet customer requirements. Ensure product compatib...
Date Posted: 07/13/2026 Recommended
-
IT Systems Engineer
Bellevue, Washington
IT Systems Engineer (Contract) System One Location: Bellevue, WA (Onsite) Schedule: Full-Time, 40 hours/week Contract Position Position Summary System One is seeking an experienced IT Systems Engineer to support enterprise infrastructure operations for...
Date Posted: 07/07/2026 Recommended
-
Manufacturing Engineer
Lebanon, Ohio
Job Title: Manufacturing Engineer Location: N. Cincinnati, Ohio Type: Direct Hire Work Model: Onsite Responsibilities • Support manufacturing processes by evaluating and improving capabilities, scheduling, specifications, and quality standards • Collab...
Date Posted: 06/23/2026 Recommended
-
AI/ML Solutions Architect
McLean, VA
Job Title: AI/ML Solutions Architect Location: McLean, VA Type: Contract To Hire Work Model: Remote Hours: 40.0 Clearance: Must be able to obtain a Federal or DoD Public Trust Contact: Crystal.dinnocenti@systemone.com RESPONSIBILITIES Design and implem...
Date Posted: 07/27/2026 Recommended
-
Supplier Manufacturing Engineer
Cheswick, PA
Job Title: Supplier Manufacturing Engineer Location: Cheswick, PA Type: Contract Compensation: $50.00 - $80.00 Overview System One is seeking a Supplier Manufacturing Engineer to support critical suppliers by driving manufacturing execution, quality, a...
Date Posted: 07/22/2026 Recommended
-
Design Manager
Charlotte, North Carolina
Job Title: Design Manager Location: Charlotte, North Carolina Type: Direct Hire Compensation: $120,000.00 - $153,000.00 Work Model: Onsite Overview The IS Design Manager is responsible for the design production throughout the life cycle of a project fr...
Date Posted: 07/21/2026 Recommended
-
Design Manager
Tempe, AZ
Job Title: Design Manager Location: Tempe, AZ Type: Direct Hire Compensation: $120,000.00 - $153,000.00 Work Model: Onsite Overview The IS Design Manager is responsible for the design production throughout the life cycle of a project from development h...
Date Posted: 07/21/2026 Recommended
-
Design Manager
Coppell, TX
Job Title: Design Manager Location: Coppell, TX Type: Direct Hire Compensation: $120,000.00 - $153,000.00 Work Model: Onsite Overview The IS Design Manager is responsible for the design production throughout the life cycle of a project from development...
Date Posted: 07/21/2026 Recommended
-
Senior Data Scientist (AI)
Washington, District of Columbia
Senior Data Scientist (AI) Washington, DC – onsite presence highly preferred Period of Performance: 6 months Per Federal contract U.S. Citizenship Required Must be able to pass enhanced background screen (criminal, financial, drug) for Public Trust cle...
Date Posted: 07/14/2026 Recommended
-
AI/ML Engineer
McLean, VA
AI/ML Engineer Location: Remote Work Authorization: Must be able to work without sponsorship Clearance Requirement: Must be able to obtain and maintain a Federal or DoD Public Trust Position Overview We are seeking an experienced AI/ML Engineer to desi...
Date Posted: 07/23/2026 Recommended
-
Mechanical Engineer
Irwin, Pennsylvania
Job Title: Mechanical Engineer Location: Irwin, PA Type: Direct Hire Compensation: $80,000.00-$85,000.00 Work Model: Onsite – onsite Hours: 40.0 Responsibilities Direct the engineering design team in producing assembly and part drawings to support sale...
Date Posted: 07/28/2026 Recommended
-
Manufacturing Engineer
Ruther Glen, VA
Manufacturing Engineer Ruther Glen, VA Overview The Manufacturing Engineer is responsible for optimizing manufacturing processes, ensuring product quality, and improving efficiency. This role supports BOM maintenance, equipment procurement, and the des...
Date Posted: 07/21/2026 Recommended
-
Sr. NET Developer / AI Developer / Power BI
Rockville, Maryland
Job Title: Sr. NET Developer / AI Developer / Power BI Location: MUST BE LOCAL TO MD, VA or DC Type: Contract Compensation: Negotiable, W-2 or C2C Work Model: Hybrid Hours: 35 work hours a week All residency status may apply Responsibilities Design, bu...
Date Posted: 07/23/2026 Recommended
-
Avionics Tech
Owasso, OK
System One is working with a client to find an Avionics Tech Level 1 (Day Shift) Responsibilities Troubleshoot, diagnose, repair, and test avionics and electronic components. Perform functional testing using approved test equipment and procedures. Inte...
Date Posted: 07/17/2026 Recommended
-
Avionics Tech
Owasso, OK
System One is working with a client to find an Avionics Tech Level 1 (Day Shift) Responsibilities Troubleshoot, diagnose, repair, and test avionics and electronic components. Perform functional testing using approved test equipment and procedures. Inte...
Date Posted: 07/16/2026 Recommended
-
I&C Engineer III
Perry, OH
Job Title: I&C Engineer Location: Perry, OH United States Type: Contract Hire Compensation: $50/hr plus or minus depending on experience Contractor Work Model: Onsite – onsite Hours: 40.0 Security Clearance: Must be a US Citizen due to Nuclear restrict...
Date Posted: 07/08/2026 Recommended
-
I&C Engineer III
Oak Harbor, OH
Job Title: I&C Engineer Location: Oak Harbor, OH United States Type: Contract Hire Compensation: $50/hr plus or minus depending on experience Contractor Work Model: Onsite – onsite Hours: 40.0 Security Clearance: Must be a US Citizen due to Nuclear res...
Date Posted: 07/21/2026 Recommended
-
I&C Engineer III
Shippingport, PA
Job Title: I&C Engineer Location: Shippingport, PA United States Type: Contract Hire Compensation: $50/hr plus or minus depending on experience Contractor Work Model: Onsite – onsite Hours: 40.0 Security Clearance: Must be a US Citizen due to Nuclear r...
Date Posted: 07/16/2026 Recommended
-
Chief Engineer
New Kensington , Pennsylvania
Job Title: Chief Engineer Location: New Kensington, PA Type: Direct Hire Compensation: $175,000.00 Work Model: Onsite – onsite Responsibilities Direct all construction engineering functions for large-scale highway infrastructure projects, encompassing ...
Date Posted: 07/30/2026 Recommended
-
Sr. Project Engineer (Mechanical)
Tulsa, Oklahoma
System One is working with a local company to find a Sr Project Engineer. Project Engineer Take the lead on high-level development projects, serving as the primary technical authority throughout the sales and execution lifecycle Respond to advanced cus...
Date Posted: 07/13/2026 Recommended
-
BIM Technician
Tulsa, Oklahoma
BIM Technician Location: Tulsa Team: Architecture Education: Associates degree in AutoCAD and / or Revit or equivalent work experience - 1-3years experience SUMMARY A BIM Technician assists in all aspects of architectural documentation working within a...
Date Posted: 07/07/2026 Recommended
-
Engineering Technician (Production)
Sterling, Virginia
Job Title: Engineering Technician (Production) Location: Sterling, Virginia Type: Contract ( 2 plus years ) Compensation: $35.00 - 40.87/hr Contractor Work Model: Onsite – onsite Hours: 40.0 Security Clearance: Eligibility to obtain a U.S. Government s...
Date Posted: 05/28/2026 Recommended
-
CNC Machinist Lead
Owasso, OK
CNC Machinist Lead 1st Shift Operations & Workflow Oversee daily shop operations and maintain smooth workflow Set department goals aligned with company objectives Schedule and manage jobs, labor hours, and machine shop activities Identify bottlenecks a...
Date Posted: 07/23/2026 Recommended
-
QA Engineer (NQA-1)
Oak Ridge, TN
Job Title: QA Engineer (NQA-1) Location: Oak Ridge, TN Type: Direct Hire Work Model: Onsite – onsite Responsibilities Ensure activities affecting engineering, procurement, dedication/qualification, and manufacturing processes conform to the ASME NQA-...
Date Posted: 07/14/2026 Recommended
-
Senior Safety Verification and Validation Engineer
Bellevue, Washington
Job Title: Senior Safety Verification and Validation Engineer Type: Contract (12-months) Contractor Work Model: Remote About the Role: As a Senior Safety V&V Engineer, you will be instrumental in verifying and validating safety assessment models and so...
Date Posted: 07/27/2026 Recommended
-
Intermediate Capital Cost Estimator (Electrical & Instrumentation)
Greentree, PA
Intermediate Capital Cost Estimator (Electrical & Instrumentation) Greentree, PA, United States Responsibilities Perform detailed material take-offs from single-line diagrams, instrument indexes, cable schedules, and loop diagrams for power, control, a...
Date Posted: 07/07/2026 Recommended
-
Intermediate Capital Cost Estimator (Electrical & Instrumentation)
Greentree, PA
Intermediate Capital Cost Estimator (Electrical & Instrumentation) Greentree, PA, United States Responsibilities Perform detailed material take-offs from single-line diagrams, instrument indexes, cable schedules, and loop diagrams for power, control, a...
Date Posted: 07/06/2026 Recommended
-
Sr. Maritime Electrical Manager
North Kingstown, Rhode Island
Job Title: Sr. Maritime Electrical Manager Location: North Kingstown, Rhode Island Type: Direct Hire Compensation: (none provided) Contractor Work Model: Onsite – onsite Responsibilities Lead the electrical engineering team in the design, integration, ...
Date Posted: 05/12/2026 Recommended
-
ELECTRICAL ENGINEER IV
Tewksbury, MA
Job Title: Electrical Engineer Location: Tewksbury, MA Type: Contract Compensation: $97.33 - $115.00 per hour Work Model: Hybrid or Remote Hours: 40.0 Responsibilities Assist with new design and development for various aviation security systems includi...
Date Posted: 07/16/2026 Recommended