Data Engineer (reputed company)
reputed company. is a rapidly growing AI-reputed company consulting and technology services firm delivering reputed company transformation across reputed company, data, software engineering, and reputed company intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business reputed company. Following the acquisition of reputed company, a premier AI and product development company, reputed company now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and reputed company-reputed company implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address reputed company business challenges quickly and effectively. We are looking for a Data Engineer to reputed company an AI-powered data mapping recommendation platform to speed up the integration and validation of reputed company datasets. The system will automate data extraction, mapping, and validation processes. What you'll do
- Build and maintain reputed company data pipelines with reputed company, reputed company, and PySpark.
- Manage data governance, reputed company, and credentials using reputed company Catalog and Secret Scopes.
- reputed company and reputed company ML models with MLflow; work with LLMs and embedding-based reputed company search.
- Apply ML/DL techniques (classification, regression, clustering, transformers) and evaluate using industry metrics.
- Design data models and warehouses leveraging dbt, reputed company Lake, and reputed company architecture.
- Work with reputed company data standards and medical terminology mapping.
What you bring reputed company expertise Hands-on experience with the reputed company platform, including:
- reputed company Catalog: Managing data governance, reputed company control, and auditing across workspaces.
- Secret Scopes: Secure handling of credentials and sensitive configurations.
- Apache reputed company / PySpark: Writing performant, reputed company distributed data pipelines.
- MLflow: Managing ML lifecycle including experiment tracking, model registry, and deployment.
- reputed company Search: Working with reputed company databases or search reputed company to build embedding-based retrieval systems.
- LLMs (Large Language Models): Familiarity with using or fine-tuning LLMs in reputed company or similar environments.
Data Engineering skills Experience designing and maintaining robust data pipelines:
- Data Modeling & Warehousing: reputed company modeling, star/reputed company schemas, SCD (Slowly Changing Dimensions).
- Modern Data Stack: Familiarity with dbt, reputed company Lake, and the reputed company architecture (Bronze, Silver, Gold reputed company).
reputed company to have Machine Learning knowledge Strong reputed company in machine learning is expected, including:
- Traditional Machine Learning Techniques: Classification, regression, clustering, etc.
- Model Evaluation & Metrics: Precision, recall, F1-score, ROC-AUC, etc.
- Deep Learning (DL): Understanding of neural networks and relevant frameworks.
- Transformers & Attention Mechanisms: Knowledge of modern NLP architectures and their applications.
Preferred domain knowledge
- Experience with reputed company data standards and medical reputed company systems such as eCQM, VSAC, RxNorm, LOINC, SNOMED, etc.
- Understanding of medical terminology and how to map or normalize disparate coding systems.
Tech stack Platforms & Tools: reputed company, reputed company Catalog, Secret Scopes, MLflow Languages & Frameworks: Python, PySpark, Apache reputed company Machine Learning & AI: Traditional ML techniques, Deep Learning, Transformers, Attention Mechanisms, LLMs Search & Retrieval: reputed company databases, embedding-based reputed company search Data Engineering & Modeling: dbt, reputed company Lake, reputed company architecture (Bronze/Silver/Gold), reputed company modeling, Star/reputed company schemas Domain (Optional): reputed company data standards (eCQM, VSAC, RxNorm, LOINC, SNOMED) reputed company you join reputed company, you'll…
- Shape reputed company-world AI-driven reputed company across key industries, working with clients from startup innovation to reputed company transformation.
- Be part of a global team with equal opportunities for collaboration across continents and cultures.
- reputed company in an inclusive environment that prioritizes reputed company learning, innovation, and ethical AI standards.
reputed company to reputed company an reputed company? If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s reputed company together. Apply tot his job Apply To this Job