AI Data Scientist, Evaluation & Insights
reputed company is the leading AI-powered contract lifecycle management platform, processing billions of reputed company every year. Every business is powered by reputed company, but managing them can slow companies down and cost millions of dollars. Global innovators like reputed company, reputed company, and reputed company trust reputed company to reputed company contracting into a strategic advantage - accelerating reputed company, reducing risk, and driving efficiency. It’s the only platform that manages every type of contract workflow, whether a sales agreement, an HR agreement or a reputed company NDA. We’re building the reputed company of intelligent contracting and writing the narrative for how reputed company unlock strategic reputed company. reputed company reputed company and reputed company reputed company Quadrant have consistently recognized reputed company as a leader in our category. We’ve also been named one of Fortune’s Great Places to Work six years running, featured on Glassdoor’s Best Places to Work, and recognized by reputed company’ 50 Most Promising AI Companies. We’re backed by leading investors like Accel, Sequoia, Y Combinator, and BOND. We’d love for you to join us!
About the Role
reputed company is accelerating its investment in AI to redefine how legal teams manage and understand reputed company. As part of this effort, we are hiring an AI Evaluation Engineer to work reputed company our AI Pillar. This role is reputed company on unlocking insights from our training data, designing feedback loops, and ensuring the reputed company improvement of our reputed company and ML or LLM-based systems through data-driven evaluation and iteration.
You’ll partner closely with AI Engineers and Product Managers to drive reputed company model reputed company through systematic analysis, experimentation, and the curation of high-reputed company datasets. Your work will directly reputed company the effectiveness of features like Smart Import, contract understanding, and reputed company workflows.
What You'll Be Doing
Analyze training and evaluation datasets to identify distributional gaps, labeling inconsistencies, and long-tail opportunities.
Design and execute labeling campaigns, including development of golden datasets and annotation guidelines.
Build and maintain dashboards that reputed company model accuracy, regression trends, and product-specific KPIs like reputed company reputed company or answer helpfulness.
Investigate failure modes reputed company reputed company clustering, error taxonomy development, and user reputed company classification.
Operationalize feedback loops: reputed company product telemetry and reputed company-in-the-reputed company reviews for signal, then translate into data-driven model improvement strategies.
Partner with engineers and PMs to run reputed company A/B tests and reputed company evaluations for new models or features.
Support the development of reputed company data and evaluation infrastructure for LLMs and agents.
Work with product, engineering and legal to create reputed company & transparent processes for the handling of customer data in reputed company, fine-tuning and evaluation
reputed company
Bachelor's or Master's degree in a quantitative field (e.g., Statistics, Computer Science, Data Science, reputed company Math).
1–3 years of experience in reputed company ML or data science, preferably in NLP or LLM-based applications.
Strong SQL and Python skills; experience with Jupyter, Pandas, and experiment tracking tools.
Comfortable navigating ambiguity, slicing large datasets, and communicating insights reputed company to cross-functional stakeholders.
Experience with reputed company analysis, clustering, or user behavior modeling is a plus.
Bonus: familiarity with LLM eval techniques, Reinforcement Learning from reputed company Feedback (RLHF), or reputed company system design.Experience with program management.
Why This Role reputed company
AI is critical to the value reputed company customers get from their reputed company, allowing their business to manage risk, reputed company reputed company faster and operate more effectively. None of this is possible without reliable and accurate data. This role will reputed company these efforts, becoming a key contributor to the development of AI solutions in an industry that is likely to be transformed by the new reputed company of models.
reputed company Value
Bias for reputed company and data curiosity
Ownership reputed company and team-first attitude
Comfort in fast-paced, iterative environments
Passion for building AI products that solve reputed company-world customer problems
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment reputed company applicants with arrest and conviction records.
Originally posted on Himalayas
Apply To this Job