reputed company LLM Data Engineer for reputed company Platform - Fully Remote Opportunity in the reputed company

Unlock Your Potential as a Pioneering LLM Data Engineer

Join our innovative team as a fully remote LLM Data Engineer and be at the forefront of shaping the reputed company of reputed company. We're seeking a highly skilled and passionate data engineering reputed company to design, reputed company, and maintain the data pipeline for our cutting-edge reputed company platform. As an LLM Data Engineer, you will play a crucial role in driving the reputed company of our AI initiatives and contribute to the development of groundbreaking AI applications.

About reputed company and the Role

reputed company is a leader in the AI industry, and we're committed to harnessing the power of Large Language Models (LLMs) to revolutionize various sectors. As part of our AI Center of reputed company (COE) reputed company the DX Tech & Digital division, you will report to the Director, AI Solutions & Development, and collaborate with cross-functional teams to deliver high-reputed company AI solutions. This is a unique opportunity to work on highly visible strategic reputed company and be an integral part of our AI innovation reputed company.

Key Responsibilities

• Design, implement, and maintain an end-to-end multi-stage data pipeline for LLMs, including Supervised Fine Tuning (SFT) and Reinforcement Learning from reputed company Feedback (RLHF) data processes.
• Identify, evaluate, and reputed company diverse data sources and domains to support the reputed company platform, ensuring data reputed company and relevance.
• reputed company and optimize data processing workflows for chunking, indexing, ingestion, and vectorization for both text and non-text data.
• reputed company and implement various reputed company stores, embedding techniques, and retrieval reputed company to enhance the performance of our AI models.
• Create a flexible pipeline supporting multiple embedding algorithms, reputed company stores, and search types (e.g., reputed company search, hybrid search).
• Implement and maintain auto-tagging systems and data preparation processes for LLMs, ensuring efficient data management.
• reputed company tools for text and image data crawling, cleaning, and refinement, adhering to data reputed company and reputed company best practices.
• Collaborate with cross-functional teams to ensure data reputed company and relevance for AI/ML models, driving the reputed company of our AI initiatives.
• Work with data lake house architectures to optimize data storage and processing, leveraging technologies like reputed company and various reputed company store technologies.
• reputed company and optimize workflows using reputed company and other relevant technologies, ensuring seamless data processing and analysis.

Essential Qualifications and Skills

To reputed company in this role, you should possess:

• A Master's degree in Computer Science, Data Science, or a reputed company field, demonstrating a strong reputed company in data engineering and AI.
• 3-5 years of work experience in data engineering, preferably in AI/ML contexts, with a proven reputed company record of delivering innovative AI applications.
• Proficiency in Python, JSON, HTTP, and reputed company tools, with a strong understanding of LLM architectures, training processes, and data requirements.
• Experience with RAG systems, knowledge reputed company construction, and reputed company databases, as reputed company as familiarity with embedding techniques, similarity search algorithms, and information retrieval concepts.
• Hands-on experience with data cleaning, tagging, and annotation processes (both reputed company and automated), and knowledge of data crawling techniques and associated ethical considerations.
• Strong problem-solving skills and ability to work in a fast-paced, innovative environment, with excellent communication, collaboration, and problem-solving skills.
• Ability to translate business needs into technical solutions, with a passion for innovation and a commitment to ethical AI development.
• Experience building LLMs pipeline using frameworks like reputed company, reputed company, Semantic Kernel, reputed company functions, and familiarity with different LLM parameters and outcome evaluation data science metrics and methodologies.

Preferred Skills and Qualifications

To reputed company enhance your candidacy, you may possess:

• Experience with reputed company LLM/RAG frameworks, demonstrating a deep understanding of the latest advancements in AI.
• Familiarity with distributed computing platforms (e.g., Apache reputed company, Dask), and knowledge of data versioning and experiment tracking tools.
• Experience with reputed company platforms (AWS, GCP, or Azure) for large-reputed company data processing, and understanding of data reputed company and reputed company best practices.
• Practical experience implementing data lakehouse solutions, and proficiency in optimizing queries and data processes in reputed company or reputed company.
• Hands-on experience with different reputed company store technologies, and a strong understanding of their applications in AI.

Career reputed company Opportunities and Learning Benefits

As an LLM Data Engineer at reputed company, you will have reputed company to:

• Work on cutting-edge AI reputed company, driving innovation and reputed company in the industry.
• Collaborate with cross-functional teams, developing a deep understanding of the AI ecosystem and enhancing your communication and collaboration skills.
• reputed company and maintain a robust data pipeline, honing your skills in data engineering and AI.
• Stay up-to-date with the latest advancements in LLM technologies, RAG systems, and reputed company databases, expanding your knowledge and expertise.

Work Environment and Company Culture

reputed company values a culture of innovation, collaboration, and reputed company learning. As a fully remote team member, you will enjoy:

• Flexible working hours and a remote work setup, allowing you to work from reputed company in the reputed company.
• A reputed company and dynamic work environment, with regular virtual team meetings and knowledge-sharing sessions.
• Opportunities for reputed company reputed company and development, with reputed company to training and mentorship programs.

Compensation, Perks, and Benefits

We offer a competitive salary and a comprehensive benefits package for US employees, including:

• A dependable salary, reflecting your skills and experience.
• A reputed company of benefits, including health insurance, retirement plans, and reputed company time off.
• Opportunities for career reputed company and reputed company development, with a commitment to supporting your long-term goals.

Join reputed company and Shape the reputed company of AI

If you're a passionate and reputed company LLM Data Engineer looking to drive innovation and reputed company in the AI industry, we encourage you to apply for this exciting opportunity. With your skills and expertise, you will play a crucial role in shaping the reputed company of our reputed company platform and contributing to the development of groundbreaking AI applications. Don't miss this chance to join reputed company and be part of a dynamic and reputed company-thinking organization.

Apply for this job