Principal Data Engineer
Edmentum
This job is no longer accepting applications
See open jobs at Edmentum.See open jobs similar to "Principal Data Engineer" HighFive Partners.Edmentum is the leading provider of K-12 digital curriculum, assessments, and services to 43,000 schools in all 50 states and over 100 countries worldwide. We partner with educators to create instructional technology that is proven, easy-to-use, individualized, and aligned to state standards. Built on a 60-year history of innovation and impact, we believe that when educators succeed, students thrive, everywhere learning occurs.
Summary:
The Principal Data Engineer for the Data Engineering team will work closely with the Data Architect helping to implement and evangelize the data vision for the business.
Are you an innovative and collaborative Engineering Leader that is passionate about enterprise level big data solutions and enablement of Data Engineering, Analytics, and Machine Learning projects Join Edmentum’s Data Platform team as a Principal Data Engineer and lead exciting enablement work that focuses on delivering Cloud-based Enterprise Data Platform solutions.
As a Principal Data Engineer, you will be the Engineering Leader focused on driving the development of a highly collaborative team that solves Edmentum’s big data challenges. You will lead and perform development activities for our data platform, which serves as the foundational data architecture for Data Science, Data Analytics, and Research & Learning Engineering teams. You will be directly involved in the design, development and implementation of data infrastructure, data pipelines and scalable data architecture. You’ll work to ingest and process both streaming and batch data using leading-edge cloud tools from AWS and Databricks that represent purpose-built enterprise architecture. We invite you to bring your passion for data and join us in operationalizing exciting data projects aligned to Edmentum’s strategic goals.
ESSENTIAL DUTIES AND RESPONSIBILITIES:
- Define and own development and release processes for the Data Engineering team. Including coding standards, CI/CD processes, and release management.
- Lead technical implementation and solutioning discussions and drive decisions for data platform engineering efforts.
- Lead collaborative onboarding for the Data Analytics team, allowing them to contribute to the data lake presentation layer codebase.
- Help groom and define tasks and stories for data platform engineering backlog.
- Interface with application data owners to build collaborative working relationships with a focus on improving data quality at the source.
- Mentor and coach Data Engineers providing technical growth opportunities and raise the skillset of the team.
- Identify, anticipate, and mitigate issues and challenges with the Enterprise Data Platform.
- Creates and communicates the Technical Vision for the Enterprise Data Platform.
SPECIALIZED KNOWLEDGE, SKILLS, and ABILITIES
- Bachelor of Science (B.S.) from a 4-year college or university in Computer Science, Information Management Systems, or equivalent experience
- 5 or more years of experience working with relational databases such as SQL, RDBMS (Relational Database Management Systems) (SQL Server), PostgreSQL, AWS RDS, or RedShift
- 5 or more years of experience with Big Data technologies such as (Redshift, Snowflake, BigData, Hadoop)
- 5 or more years of experience with programming languages such as (Python, Scala, Java, C#)
- 3 or more years of experience with streaming data processing tools such as Spark (PySpark or Scala), Kinesis, or cloud functions such as AWS Lambda
- 5 or more years of experience with batch data processing pipelines
- 5 or more years of experience with job administration and scheduling of complex data workloads using tools such as Apache Airflow
- 2 or more years of experience with AWS platform data tools such as: EMR, S3, Athena, DynamoDB, EC2, Glue, and ECS (Elastic Container Service) experience working in a modern DevOps-enabled environment with tools such as GitHub, Docker, and Terraform.
Edmentum is committed to maintaining a safe and healthy work environment for our employees, vendors, and guests. Our organization will comply with all COVID-19 vaccination requirements at a site or facility that requires all employees and contractors who will be performing services. The CDC defines fully vaccinated as being two weeks after the second dose of a two-dose COVID-19 Vaccine or two weeks after the single dose of a one-dose vaccine.
Edmentum is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, disability status, protected veteran status, or any other characteristic protected by law.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)
Edmentum’s notice regarding the collection of personal information from interested candidates is available here
This job is no longer accepting applications
See open jobs at Edmentum.See open jobs similar to "Principal Data Engineer" HighFive Partners.