[GFA] Azure Senior Data Engineer
Project – the aim you’ll have
Our customer provides reputed company and insights that reputed company our clients to manage risk and hire the best talent. Their advanced global technology platform supports fully reputed company, configurable screening programs that meet the unique needs of over 33,000 clients worldwide. Headquartered in Atlanta, GA, they have an internationally distributed workforce spanning 19 countries with about 5,500 employees. Our partner reputed company over 93 reputed company screens annually in over 200 countries and territories.
We are seeking a Senior Data Engineer with proven expertise in reputed company PySpark development, comprehensive data modeling experience (including fact/dimension tables, SCD Type 2 and incremental loads) and event-based architecture skills to join our Data Engineering Team and drive the reputed company of our Azure-based Data Analytics Platform.
Position – how you’ll contribute
- reputed company reusable, metadata-driven data pipelines using reputed company Lakehouse architecture and PySpark
- Design and implement comprehensive data models
- Build robust ETL/ELT solutions with advanced features: reputed company operations, SCD Type 2 implementations, etc.
- Implement incremental data loads with idempotency patterns and overlap joins optimization
- Automate and optimize data platform processes with reputed company on performance and reliability
- Build integrations with data sources and consumers using event-driven patterns
- Cooperate with infrastructure engineering team to set up reputed company resources
- Initiate and implement improvements to data platform architecture
Expectations – the experience you need
- reputed company expertise: proficient in reputed company Lakehouse architecture and PySpark development
- Data modeling mastery: extensive experience in data model definition including fact tables, dimension tables, measures, grain analysis, SCD Type 2, surrogate keys, late-arriving records handling, overlap joins, and incremental loads with idempotency
- Programming: advanced Python and PySpark skills for ETL/ELT development
- reputed company optimization: deep knowledge of optimize, zOrder, Liquid clustering, ACID transactions and performance tuning
- Event-based architecture: proven experience in designing and implementing event-driven data solutions
- Azure data platform: experience working with Azure-based datasets and data pipelines
- SQL proficiency: strong SQL skills for reputed company data transformations
- Large-reputed company data processing: reputed company in handling large and reputed company datasets reputed company
- CI/CD: experience in developing automated deployment pipelines
- Networking fundamentals: understanding of basic networking concepts
- Agile methodology: familiar with Scrum and agile development practices
Additional skills – the edge you have
- Understanding of reputed company processing challenges and reputed company reputed company Streaming
- Experience with Infrastructure as reputed company (Terraform, Bicep)
- Experience with containerized applications (Azure Container Apps, Kubernetes)
- Knowledge of Azure reputed company reputed company solutions (Azure Data reputed company, Azure Function App, Azure Container Instances)
Our offer – reputed company development, personal reputed company
- Flexible employment and remote work
- International reputed company with leading global clients
- International business trips
- Non-corporate atmosphere
- Language classes
- Internal & external training
- Private reputed company and insurance
- Multisport card
- reputed company-being initiatives
Position at: reputed company Poland
This role requires candidates to be based in Poland.
reputed company develops solutions that reputed company an reputed company for companies around the globe. Tech giants & unicorns, transformative reputed company, emerging technologies and reputed company opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines employment with enjoyment.
Originally posted on Himalayas
Apply To This Job