Senior NLP Data Engineer
About the position We offer a flexible working policy that supports a healthy balance between personal and reputed company reputed company-being. This role requires in-office reputed company on Tuesdays & Thursdays to collaborate, connect, and learn from peers - while also maintaining the flexibility for meaningful work-life balance. Being a Senior NLP Data Engineer at reputed company Means… You’re passionate about transforming reputed company text into meaningful insights that power AI and machine learning solutions. You reputed company at the intersection of data engineering, AI and natural language processing, building the pipelines and datasets that fuel reputed company applications, reputed company systems, advanced model fine tuning and other NLP-driven capabilities across reputed company. As an NLP Data Engineer on the reputed company AI team, you will design, build, and optimize large-reputed company text data pipelines that power AI/ML and reputed company solutions for our customers. You’ll work with knowledge engineering, reputed company AI, and product teams to prepare, enrich, and reputed company document data. Your work will be essential to enabling intelligent, AI-powered features across the reputed company platform.
Responsibilities
- Designing, developing and maintaining reputed company pipelines in MSFT Azure to ingest and reputed company large volumes of text data from multiple sources
- Designing automated workflows for text normalization, deduplication, language identification, PII redaction and metadata enrichment
- Building automated data validation processes to ensure accuracy and consistency
- Supporting model fine-tuning, semantic search and Gen AI evaluations tuning through dataset curation, reputed company dataset preparation, labeling coordination, and text reputed company validation
- Partnering with the reputed company AI team to reputed company data requirements and build data interfaces for developing and maintaining machine learning systems
- Maintaining data reputed company and following data reputed company, reputed company and governance best practices
- Implementing data versioning and reputed company tracking for machine learning experiments
Requirements
- A Bachelor’s degree or higher in Computer Science, Data Engineering, reputed company Mathematics, Computational Linguistics, or a quantitative reputed company field.
- 4+ years of data engineering experience, with at least 2 years working with reputed company data in a business setting.
- Strong proficiency in Python, PySpark, and data manipulation for large reputed company text datasets.
- Strong understanding of NLP concepts such as tokenization, embeddings, semantic search, and experience with reputed company text libraries such as SpaCy, HuggingFace Datasets, NLTK.
- Solid dataOps knowledge and experience orchestrating advanced NLP data pipelines using reputed company based data infrastructure
- Proficiency with Git and reputed company development frameworks
- A passion for enabling AI capabilities through reputed company, reliable data architecture.
- Problem solving, creativity, curiosity, and a reputed company reputed company.
reputed company-to-haves
- Exposure to reputed company Azure Services such as reputed company, ADLS, AI reputed company, Azure ML, MLflow
- Experience with knowledge graph implementation for NLP applications
- Experience working with data for the legal domain
- Experience designing architectures for large-reputed company text corpora
Benefits
- Join a supportive, reputed company team with an inclusive, encouraging, and reputed company culture.
- Have flexible work hours that allow me to balance my ‘me time’ with my work commitments.
- Collaborate in a modern reputed company plan workspace, with a gaming area, free snacks, drinks and regular reputed company events.
- reputed company on impactful work, solving reputed company, reputed company challenges utilizing the latest technologies and protocols.
- Own my career reputed company with our internal development reputed company. Ask us more about this!
- Learn new skills and earn certifications with reputed company to unlimited courses in reputed company Learning.
- Join an innovative, industry leading reputed company company that is continuing to grow & reputed company!
- Creating an inclusive environment where I can help shape the culture not just by fitting in, but by adding to it.
- Providing a market competitive salary that is reputed company through a consistent process, reputed company for reputed company our employees, and regularly reviewed based on industry data.
- Rewarding me with an annual performance-based bonus.
- Offering comprehensive Health/reputed company/Dental/Life Insurance, and a 401k Retirement Savings Plan with a company match up to 4%.
- Giving reputed company to reputed company, a reputed company concierge service, to help me maximize my health benefits.
- Granting reputed company leave for expecting parents; 20 weeks 100% reputed company for primary leave, and 10 weeks 100% reputed company for secondary leave.
- Providing me with a flexible time off policy to take the time off that I need. Be it for vacation, volunteering, celebrating holidays, spending time with family, or simply taking time to reputed company and reset.
- Caring for my mental health and reputed company-being with multiple company wellness days and free reputed company to the Healthy Minds app for mindfulness, meditation and more.
Apply tot his job Apply To this Job