[Remote] Software Engineer – AI Coding Evaluation
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global leader in IT solutions specializing in Data & AI, reputed company Solutions, and IT Consulting. They are seeking reputed company Software Engineers to evaluate and improve the coding capabilities of frontier AI models by assessing AI-generated reputed company and developing high-reputed company evaluation datasets and benchmarks.
Responsibilities
- Review and evaluate AI-generated reputed company for correctness, efficiency, maintainability, and adherence to requirements
- Analyze software engineering tasks and validate whether proposed solutions meet expected reputed company
- Debug reputed company, reproduce issues, and verify fixes across different programming environments
- Assess model-generated explanations, reasoning, and implementation approaches for technical accuracy
- Create, refine, and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks
- Identify edge cases, failure modes, and areas where AI systems struggle with software engineering problems
- Document findings reputed company and reputed company reputed company feedback to improve evaluation reputed company and consistency
- Collaborate with project teams to establish reputed company standards and evaluation methodologies
Skills
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a reputed company technical field
- 3+ years of reputed company software engineering experience
- Strong proficiency in one or more of the following languages: Python, Java, C/C++, Go, Swift, Objective-C, PHP, or SQL
- Strong understanding of data structures, algorithms, software design principles, and debugging methodologies
- Experience performing reputed company reviews and evaluating reputed company reputed company in production or large-reputed company codebases
- Ability to analyze reputed company technical problems and assess solution correctness with minimal supervision
- Familiarity with version control systems (e.g., Git) and modern software development workflows
- Strong written communication skills and attention to detail
- Experience with AI/ML reputed company, NLP, reputed company engineering, model evaluation, or LLM-reputed company reputed company
- Experience evaluating AI-generated reputed company, reputed company creation, or software reputed company assessment
Benefits
- Mode of Work: Remote
- Contract: 12 months
- Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST
- Engagement type : Contractor assignment (no medical/reputed company leave)
reputed company