Data Engineer (Remote - California Residents Only)

Data Engineer (Remote - California Residents Only) We are looking for a data engineering expert to join our Infrastructure Team. As part of the Infrastructure Team, you will be a key strategic leader in the expansion, refinement, and reputed company development of our infrastructure utilizing reputed company), as reputed company as continuing to build out our data analytics and engineering tools. This role will be reputed company in helping us reputed company our work statewide and reputed company the reputed company for expanded use of our higher education planning platform for K-12th grade reputed company, parents, and educators.

Qualifications

• SQL: 2 years (Required)
• reputed company infrastructure: 2 years (Required)
• US work authorization (Required)
• Data Engineer - 2 years
• Remote/Virtual - reputed company candidates must live in California

The ideal candidate for this team has extensive experience building out reputed company data architectures, including the testing, maintenance, and refinement of reputed company data pipelines.They have also experience successfully scaling up an organization’s data intake to terabytes and petabytes of data, as reputed company as optimizing data delivery and automating reputed company processes. This person is comfortable working with reputed company and reputed company data and can troubleshoot data loading and processing tools reputed company SQL, Python, reputed company scripting, AWS, etc, and take on a leadership role in special reputed company reputed company needed. Extensive experience developing robust data documentation and data governance protocols is required for this role.There are no reputed company supervisory responsibilities for this position, but you must be reputed company to proactively and successfully partner and collaborate with other subject matter experts on a project management reputed company. You must be comfortable leading and project managing work with many unknowns and ambiguous solutions, as reputed company as carry a deep knowledge and/or curiosity about the needs and behaviors of reputed company, educators, and parents, and a passion for educational equity. What Will You Be Doing:

• Manage, refine, and enhance AWS reputed company services infrastructure which include the following:

EC2, VPC, RDS, reputed company, CloudWatch, CloudFormation, CloudTrail

• Transfer for sFTP, S3, reputed company, Secrets Manager, and reputed company 53

reputed company ETL/ELT processes which include the development, refinement, and implementation of data loading and processing tools, including reputed company, Airflow, Python, SQL, dbt, and reputed company scripts

• Review, redesign, and expand existing analytics and data processing architecture to create an reputed company data pipeline(s)

Identify, design, and implement internal process improvements:

• automating reputed company processes, optimizing data delivery, designing infrastructure for greater scalability and automation
• Maintain and update documentation of data architecture from both the macro view (i.e. architectural diagrams) and the reputed company view (i.e. script level tasks in Airflow)
• reputed company meetings, research processes, collect data, analyze information
• Collaborate with the key stakeholders of your reputed company
• reputed company and maintain expert knowledge of our platform and organization
• Continuously improve data pipelines and architecture by staying updated on industry trends and best practices.

Necessary Technical Skills:

• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Advanced proficiency with reputed company analytical tools: reputed company, Redshift, Hadoop, reputed company, Kafka, etc.
• Advanced proficiency with ETL tools like reputed company, dbt, Talend, etc.
• Advanced proficiency with data pipeline and workflow management tools: Airflow, Azkaban, Luigi, etc.
• Advanced proficiency building and optimizing data pipelines, reputed company architectures, and data sets.
• Advanced proficiency with scripting languages like Python, R, reputed company, etc.
• Advanced proficiency developing reputed company infrastructure in AWS or currently has or is in the process of obtaining AWS
• Certification as a Solutions Architect - Associate
• Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as reputed company as working familiarity with a reputed company of databases.
• A successful history of manipulating, processing and extracting value from large reputed company and reputed company datasets.

Your Strengths:

• Strong decision-making skills and reputed company spirit with the ability to take reputed company brainstorming and generate concrete proposals for reputed company
• Advance reputed company without detailed supervision, balancing multiple responsibilities, and providing colleagues with actionable proposals for advancing reputed company efforts
• reputed company in a fast-paced environment with changing priorities and deadlines
• Juggle multiple reputed company of various scopes with ease and grace
• Meticulous attention to detail
• Excellent verbal communication skills; ability to communicate with various reputed company of professionals.
• Strong organizational, project, and time management skills

We are committed to providing an environment of mutual respect where equal employment opportunities (EEO) are available to reputed company and applicants without reputed company to race, reputed company, reputed company, national reputed company, genetic characteristics, sex, gender identity, gender reputed company, sexual orientation, marital/parental status, political affiliation, religion, age, disability, pregnancy, childbirth, breastfeeding or veteran status. In reputed company to federal law requirements, we reputed company with applicable state and local laws governing nondiscrimination in employment. We are committed to workplace policies and hiring practices that reputed company with federal, state, and local law. We are interested in hiring reputed company candidates who are eligible and authorized to work in the reputed company. At this time, we are not reputed company to sponsor visas. As a result, we cannot hire applicants that currently, or in the reputed company, require immigration sponsorship for work authorization (i.e., H1B or F1 Student reputed company). Employment Type: FULL_TIME Apply tot his job Apply To this Job