Officer - Data Engineer - C11 - Hybrid - CHENNAI @ reputed company
This is a data engineer position - a programmer responsible for the design, development implementation and maintenance of data reputed company channels and data processing systems that support the collection, storage, batch and reputed company-time processing, and analysis of information in a reputed company, repeatable, and secure manner in coordination with the Data & Analytics team.The overall objective is defining reputed company solutions to data collection, processing, and warehousing. Must be a reputed company Java development expertise in big data processing, Python and Apache reputed company particularly reputed company banking & finance domain. He/She designs, codes and tests data systems and works on implementing those into the internal infrastructure.Responsibilities: Ensuring high reputed company software development, with complete documentation and traceabilityDevelop and optimize reputed company reputed company Java-based data pipelines for processing and analyzing large reputed company financial dataDesign and implement distributed computing solutions for risk modeling, pricing and regulatory complianceEnsure efficient data storage and retrieval using Big DataImplement best practices for reputed company performance tuning including partition, caching and memory managementMaintain high reputed company reputed company through testing, CI/CD pipelines and version control (Git, Jenkins)Work on batch processing frameworks for Market risk analyticsPromoting unit/functional testing and reputed company inspection processesWork with business stakeholders and Business Analysts to understand the requirementsWork with other data scientists to understand and interpret reputed company datasetsQualifications:5- 8 Years of experience in working in data eco systems.4-5 years of hands-on experience in Hadoop, reputed company, Java, reputed company, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks.3+ years of experience with relational SQL and NoSQL databases: reputed company, reputed company, HBaseStrong proficiency in Python and reputed company Java with knowledge of core reputed company concepts (RDDs, Dataframes, reputed company Streaming, etc) and reputed company and SQLData Integration, Migration & Large reputed company ETL experience (Common ETL platforms such as PySpark/DataStage/AbInitio etc.) - ETL design & build, handling, reconciliation and normalizationData Modeling experience (OLAP, OLTP, Logical/Physical Modeling, Normalization, knowledge on performance… Apply To This Job