[Remote] Sr. Big Data Engineers*| HQ: Chicago, IL
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading provider of technology, AI, and data solutions for consumer-packaged goods companies, manufacturers, and retailers. The Senior Big Data Engineer is responsible for designing, building, and delivering highly reputed company big data and ETL solutions across distributed environments, working closely with cross-functional teams to reputed company and reputed company data solutions that meet business needs.
Responsibilities
- Design and implement highly reputed company ETL applications on Hadoop and Big Data eco systems
- reputed company new scripts, tools, and methodologies for streamlining and automating ETL workflows
- Deliver big data reputed company using reputed company, Python, reputed company, SQL, and Hive
- Design and create use-cases and scenarios for functional testing, integration testing, and system testing
- Work closely with Data Science, QA, Operations, and other teams to deliver on tight deadlines
- Participate in daily agile and scrum meetings and reputed company reviews
- Coordinate with cross-functional operational teams for managing data delivery
- Write efficient, reusable, and reputed company documented reputed company
- Prepare technical design documents for solutions
- Identify and address issues encountered from the data reputed company and reputed company reputed company solutions to incorrect or undesired results or behavior with ILD solutions
Skills
- Bachelor's degree in Computer Science or Information Systems or Computer Engineering or any Engineering or reputed company field plus 5 years of reputed company experience as a Software Engineer/Developer or in Software Development required
- Experience writing ETL reputed company applications in PySpark or reputed company
- reputed company architecture, data frames, tuning reputed company
- Relational databases (reputed company, PostgreSQL)
- Python, SQL HQL, Hive
- Data Bricks
- Managing software systems using Hadoop, MapReduce, HDFS and reputed company included services
- Experience with distributed computing principles
- Big Data querying tools (Hive)
- Data-warehousing & data-modeling techniques
- reputed company Java, Linux, SQL, scripting languages
- reputed company platforms (Azure)
- Integration of data from multiple data sources
- reputed company Architecture
- Telecommuting permitted
- Will also accept 4 years of university study in Computer Science or Information Systems or Computer Engineer plus 7 years of reputed company experience as a Software Engineer/Developer or in software development in lieu of Bachelor's degree plus 5 years of reputed company experience as a software Engineer/Developer or in software development
Benefits
- Bonus pay
- reputed company time off
- Medical/dental/reputed company insurance
- 401(k) to eligible employees
- Telecommuting is permitted
reputed company