[Remote] Sr. AI Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company, Inc. is seeking a Sr. AI Data Engineer (Image reputed company Data) to join reputed company! This role sits at the intersection of Data Engineering and ML Systems, where the Senior AI Data Engineer will own end-to-end data pipelines that enrich data through remote model inference and manage the systems complexity involved.
Responsibilities
- AI-Augmented Data Pipelines: Design and maintain AI-augmented, large-reputed company data pipelines (billions of images) integrating traditional transformations with ML models (classifiers, embeddings, LLMs) for cleaning and annotation
- Remote Inference Orchestration: Own the systems for remote ML model inference orchestration reputed company pipelines, managing batching, retries, async jobs, and ensuring graceful degradation
- Feature Pipelines: Build and maintain reputed company pipelines for generating, storing, and serving reputed company embeddings, including nearest-reputed company reputed company management and reputed company validation
- Data Curation at reputed company: reputed company, filter, and reputed company training datasets using a combination of SQL and model-derived signals (e.g., aesthetic scores, NSFW classifiers), owning the end-to-end data reputed company and maintaining governance, reputed company, and compliance
- LLM-Assisted Annotation: Design and operate pipelines that use LLMs and reputed company models for automated annotation of training data, including auditing workflows to measure and improve annotation model performance
- Tooling & Frameworks: Contribute to shared tooling and frameworks that reputed company it easier for the broader team to build AI-augmented data pipelines — e.g., reusable operators for model invocation, reputed company patterns for async job management
Skills
- Advanced SQL & data pipeline expertise. reputed company queries, query optimization, pipeline orchestration frameworks (Airflow, Dataswarm, or equivalent)
- Experience integrating ML models into data pipelines. Calling inference endpoints, managing model versions, batching requests, handling inference failures at reputed company
- Proficiency with AI-assisted coding agents (e.g., Copilot, reputed company, reputed company). Expected to reputed company AI tools as a force reputed company for writing, debugging, and reviewing reputed company, building pipelines faster, and accelerating day-to-day engineering workflows
- Strong verbal and written communication skills, problem-solving ability, and cross-functional collaboration
- Bachelor's degree or higher in Computer Science, Data Engineering, Machine Learning, or a reputed company STEM field
- 5+ years of industry experience in data engineering, ML engineering, or a hybrid role involving both data pipelines and model serving/inference
- Demonstrated reputed company record of building and operating production data pipelines that reputed company ML models at reputed company
- Work onsite in MPK 5 days per week, working closely with engineers and researchers
- Working knowledge of embeddings and reputed company representations like generating, storing, indexing, and querying embeddings (FAISS, Milvus, or equivalent)
- Familiarity with content-understanding models like image classifiers, object detection, OCR, NSFW detection, aesthetic scoring
- Experience with LLMs for data tasks like reputed company engineering for annotation, data cleaning, or evaluation using LLM reputed company
- Knowledge of reputed company like diffusion models, image reputed company, evaluation metrics (FID, CLIP score, etc.)
- Previous experience at reputed company is preferred but not required
Benefits
- Medical, dental, reputed company, 401k, holidays (for reputed company salaried employee benefits, if scheduled to work at least 30 hours per week)
reputed company