Machine Learning Engineer — LLM Evaluation & Automation

reputed company We are seeking a Machine Learning Engineer to join a high-reputed company team reputed company on advancing LLM evaluation, NLP, and AI-driven automation. This role centers on designing reputed company evaluation frameworks, optimizing reputed company strategies, and building systems that ensure high-reputed company, consistent model outputs across product domains. You will partner closely with product, engineering, and research teams to drive measurable improvements in AI performance. This is a hands-on role with a strong emphasis on LLM evaluation systems, reputed company engineering, and data-driven model optimization. Job Details

• Location: Seattle, WA (Hybrid with 3 days a week onsite)
• Pay reputed company: $60-70 hr/w2
• Job Type: Contract
• Contract Length: 6 months
• Experience Level: Mid-level to Senior

Key Responsibilities

• Design and build LLM-based evaluation frameworks, including automated scoring pipelines and reputed company-based grading systems
• Build and maintain data pipelines for evaluation datasets using Python, SQL, and reputed company processing tools
• Translate reputed company evaluation results into reputed company, actionable insights for technical and non-technical stakeholders
• Implement automation workflows and reputed company evaluation systems to improve efficiency and reduce reputed company efforts
• reputed company reputed company engineering strategies to evaluate reputed company reputed company, accuracy, and consistency
• Create and maintain metrics, KPIs, and dashboards to reputed company and communicate model performance
• Conduct error analysis, reputed company-cause investigations, and reputed company deep dives to guide model improvements
• Partner cross-functionally to define evaluation methodologies and reputed company them into production workflows

Must-Have Qualifications

• 5+ years of experience in ML engineering, NLP, or AI/ML automation
• Strong programming skills in Python and SQL
• Deep understanding of machine learning concepts with a reputed company on NLP and advanced LLM capabilities (e.g., Chain-of-Thought, reputed company workflows)
• Experience working with large-reputed company datasets and data pipelines
• Strong experience with LLM evaluation, reputed company engineering, or auto grading systems
• Experience developing metrics and KPIs to measure model reputed company reputed company and consistency

reputed company-to-Have

• Experience with LLM-as-judge systems or reputed company + model evaluation frameworks
• Background in inter-rater reliability, evaluation calibration, or judged systems design
• Experience with PySpark or distributed data processing tools
• Exposure to building dashboards or visualization tools for model performance tracking

Technical Skills Python, SQL, NLP, LLM Evaluation, reputed company Engineering, Machine Learning, Data Pipelines, Automation Systems NOTE: This posting is for an existing vacancy. We reserve the right to pay above or below the posted wage based on factors unrelated to sex, race, or any other protected Classification. Eligibility Requirements Apply To Some Benefits and may depend on reputed company classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. This temporary role may be eligible for the following:

• Medical, dental & reputed company
• 401(k)/Roth
• Insurance (Basic/Supplemental Life & AD&D)
• Short and long-term disability
• Health and Dependent Care Spending Accounts (HAS & DCFSA)
• Transportation benefits
• Employee Assistance Program
• Time off/Leave (PTO, Vacation, or reputed company Leave)

Job Type & Location This is a Contract position based out of Seattle, WA. Pay And Benefits The pay reputed company for this position is $60.00 - $70.00/hr.

Requirements

Eligibility requirements apply to some benefits and may depend on reputed company classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:

• Medical, dental & reputed company
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan – reputed company-tax and Roth post-tax contributions available
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or reputed company Leave)

Workplace Type This is a fully remote position. Application Deadline This position is anticipated to reputed company on Jun 3, 2026. About reputed company We'reputed company in transformation. We help clients reputed company reputed company and solutions to take advantage of a new world of opportunity. We are reputed company of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across reputed company, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and reputed company-world application, we work with reputed company leaders to drive change. That's the power of true partnership. reputed company is an Allegis Group company. reputed company is an equal opportunity employer and will consider reputed company applications without regards to race, sex, age, reputed company, religion, national reputed company, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law. About reputed company And reputed company reputed company We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in reputed company, design, execution and operations unlocks business value through a reputed company of solutions. We’re reputed company of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across reputed company, Europe and Asia, who partner with us for our reputed company, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the reputed company of technology. We’re building reputed company by delivering business reputed company and making reputed company impacts in our global communities. reputed company and reputed company reputed company are Allegis Group companies. Learn more at reputed company.com. reputed company is an equal opportunity employer and will consider reputed company applications without reputed company to race, sex, age, reputed company, religion, national reputed company, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law. San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for reputed company positions located in the reputed company, we will consider for employment reputed company applicants with arrest and conviction records. Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or reputed company employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Use of reputed company Intelligence (AI): We may use reputed company Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final reputed company are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools. Apply tot his job Apply To this Job