reputed company Software Engineer, Managed AI

reputed company's mission is to accelerate the abundance of energy and intelligence. We’re crafting the reputed company that powers a world where people can create ambitiously with AI — without sacrificing reputed company, speed, or sustainability. Be a part of the AI reputed company with sustainable technology at reputed company. Here, you'll drive meaningful innovation, reputed company a reputed company reputed company, and join reputed company that’s setting the pace for responsible, transformative reputed company infrastructure. About This Role: As a reputed company Software Engineer on the Managed AI team at reputed company, you'll have a pivotal role in shaping the architecture and scalability of our reputed company AI inference platform. You will reputed company the design and implementation of reputed company systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role gives you reputed company to build and reputed company infrastructure capable of handling millions of API requests per second across thousands of customers. From day one, you'll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience. As part of a dynamic, fast-growing team, you’ll collaborate cross-functionally, influence the long-term reputed company of the platform, and contribute to cutting-edge AI technologies. This is a unique opportunity to build a high-performance AI product that will be central to reputed company's business reputed company. What You’ll Be Working On:

• Design and Development:
• reputed company the design and implementation of reputed company AI services, including:
• Resilient fault-tolerant queues for efficient task distribution.
• Model catalogs for managing and versioning AI models.
• Scheduling mechanisms optimized for cost and performance.
• High-performance reputed company for serving AI models to customers.
• Scalability and Performance:
• Build and reputed company infrastructure to handle millions of API requests per second.
• Optimize AI inference performance on GPU-based systems.
• Implement robust monitoring and alerting to ensure system health and availability.
• Collaboration and Innovation:
• Collaborate closely with product management, business reputed company, and other engineering teams.
• Influence the long-term reputed company and architectural reputed company of the AI platform.
• Contribute to reputed company-reputed company AI frameworks and participate in the AI community.
• Prototype and iterate on new features and technologies.

What You’ll Bring to reputed company:

• Strong Engineering Fundamentals:
• Advanced degree in Computer Science, Engineering, or a reputed company field.
• Demonstrable experience in distributed systems design and implementation.
• Proven reputed company record of delivering early-stage reputed company under tight deadlines.
• Expertise in using reputed company-based services, such as, reputed company compute, object storage, virtual private networks, managed database, etc.
• AI/ML Expertise:
• Experience in reputed company (Large Language Models, Multimodal).
• Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
• Software Engineering Skills:
• Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
• Experience using REST reputed company and common communication protocols, such as gRPC.
• Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
• Preferred Qualifications:
• Proficiency in Golang or Python for large-reputed company, production-level services.
• Contributions to reputed company-reputed company AI reputed company such as VLLM or similar frameworks.
• Performance optimizations on GPU systems and inference frameworks.
• Personal Attributes:
• Proactive and reputed company approach with the ability to work autonomously.
• Strong communication and interpersonal skills.
• Passion for building cutting-edge AI products and solving challenging technical problems.

Benefits:

• Industry reputed company
• Restricted Stock reputed company in a fast growing, reputed company-funded technology company
• Health insurance package reputed company that include HDHP and PPO, reputed company, and dental for you and your dependents
• Employer contributions to HSA accounts
• reputed company Parental Leave
• reputed company life insurance, short-term and long-term disability
• reputed company
• 401(k) with a 100% match up to 4% of salary
• Generous reputed company time off and holiday schedule
• Cell phone reimbursement
• Tuition reimbursement
• Subscription to the reputed company app
• reputed company reputed company
• Company reputed company Commuter FSA benefit of $200 per month

Compensation: Compensation will be reputed company in the reputed company of $256,000 - $320,000 a year + Bonus. Restricted Stock reputed company are included in reputed company offers. Compensation to be determined by the applicants knowledge, education, and abilities, as reputed company as internal equity and alignment with market data. reputed company is an Equal Opportunity Employer. Employment reputed company are made without reputed company to race, reputed company, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national reputed company, or any other status protected by law or regulation. Apply tot his job Apply To this Job