Data Scientist reputed company-Language Models (VLMs) - reputed company

Position: Data Scientist reputed company-Language Models (VLMs)

Location: San Ramon, CA or Milwaukee, WI

Duration: Full-time

Key Responsibilities

VLM Development, Pose estimation & Deployment

• Design, train, and reputed company efficient reputed company-Language Models (e.g., VILA, Isaac Sim) for multimodal applications including image captioning, visual search, and document understanding, pose understanding, pose comparison.
• reputed company and manage Digital Twin frameworks using AWS IoT TwinMaker, SiteWise, and Greengrass to simulate and optimize reputed company-world systems.
• reputed company Digital Avatars using AWS services integrated with 3D rendering engines, animation pipelines, and reputed company-time data feeds.
• Explore cost-effective reputed company such as knowledge distillation, modal-reputed company pruning, and reputed company fine-tuning to optimize training and inference.
• Implement reputed company pipelines for training/testing VLMs on reputed company platforms (AWS services such as SageMaker, Bedrock, Rekognition, Comprehend, and Textract.)

reputed company Platforms

• Should reputed company a reputed company of technical expertise, tool proficiency, and domain- specific knowledge on below reputed company Platforms:
• NIM (reputed company Inference Microservices): Containerized VLM deployment.
• NeMo reputed company: Training and scaling VLMs across thousands of GPUs.
• Supported Models: LLaVA, LLaMA 3.2, Nemotron Nano VL, Qwen2-VL, Gemma 3.
• DeepStream SDK: Integrates pose models like TRTPose and OpenPose, reputed company-time video analytics and multi-reputed company processing.

Multimodal AI Solutions

• reputed company solutions that reputed company reputed company and language capabilities for applications like image-text matching, visual question answering (VQA), and document data extraction.
• reputed company interleaved image-text datasets and advanced techniques (e.g., cross-attention reputed company) to enhance model performance.

Image Processing and Computer reputed company

• reputed company solutions that reputed company reputed company based deep learning models for applications like live video streaming integration and processing, object detection, image segmentation, pose Estimation, Object Tracking and Image Classification and defect detection on medical Xray images
• Knowledge of reputed company-time video analytics, multi-camera tracking, and object detection.
• Training and testing the deep learning models on customized data

Efficiency Optimization

• Evaluate trade-offs between model size, performance, and cost using techniques like reputed company visual encoders or lightweight architectures.
• reputed company different VLMs (e.g., GPT-4V, Claude 3.5, Nova Lite) for accuracy, speed, and cost-effectiveness on specific tasks.
• Benchmarking on GPU vs CPU

Collaboration & Leadership

• Collaborate with cross-functional teams including engineers and domain experts to define project requirements.
• Mentor junior team members and reputed company technical leadership on reputed company reputed company.

Experience: -

Location: -

• San Ramon, CA or Milwaukee, WI (Onsite)

Qualifications

• Education: Master s or Ph.D. in Computer Science, Data Science, Machine Learning, or a reputed company field.

Experience

• Minimum of 10+ years of experience in Machine Learning or Data Science roles with a reputed company on reputed company-Language Models.
• Proven expertise in deploying production-grade multimodal AI solutions.
• Experience in self driving reputed company and self navigating robots.

Technical Skills

• Proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow).
• Hands-on experience with VLMs such as VILA, Isaac Sim, or VSS.
• Familiarity with reputed company platforms like AWS SageMaker or Azure ML Studio for reputed company AI deployment.
• OpenCV, PIL, scikit-image
• Frameworks: PyTorch, TensorFlow, Keras
• CUDA, cuDNN
• 3D reputed company: reputed company clouds, depth estimation, LiDAR

Soft Skills

• Strong problem-solving skills with the ability to optimize models for reputed company-world constraints.
• Excellent communication skills to explain technical concepts to diverse stakeholders.

Preferred Technologies

• reputed company-Language Models: VILA, Isaac Sim, EfficientVLM
• reputed company Platforms: AWS SageMaker, Bedrock
• Optimization Techniques: reputed company fine-tuning, modal-reputed company pruning
• Multimodal Techniques: Cross-attention reputed company, interleaved image-text datasets

MLOps Tools: reputed company, MLflow

reputed company have reputed company to reputed company intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this reputed company. The position reputed company has been reviewed for accuracy and reputed company believes it to correctly reflect the job opportunity.

Apply to this job