Data Engineer and Integration Developer

About This Role

Join Southern California Edison (SCE) as a Data Engineer and Integration Developer to enable digital transformation by building and optimizing data warehouses and applications for critical operational and compliance reporting and analytics.

Responsibilities

• Optimize performance and scalability of critical data pipelines
• Develop reusable and parameterized pipeline components and templates
• Perform analysis and support to Data Scientists for model development
• Design pipeline architectures and ETL processes using big data technologies
• Collaborate with stakeholders to elicit pipeline requirements and identify improvement opportunities
• Utilize data ingestion capabilities to ingest and preprocess data from various sources
• Troubleshoot and resolve issues with production pipelines
• Ensure data pipeline continuity and integrity through testing and change management
• Contribute to data dictionary and data mapping from sources to the target from SCIM Data Model Design
• Develop Data-as-a-Service solutions to improve data consumption

Requirements

• 5+ years of experience in data processing large data sets, hands-on with data transformation, aggregation, and filtering

Qualifications

• Bachelor's Degree in Computer Science, Information Systems, Engineering, Statistics/ Mathematics or equivalent STEM major
• Five or more years of experience in data processing large data sets, hands-on with data transformation, aggregation, and filtering.

Nice to Have

• Background in the utility sector and/or energy markets
• Experience in Snowflake (architecture, SQL, stored procedures, data management analysis)
• Strong proficiency with front-end Python frameworks (Streamlit, Dash, Flask, Django)
• Experience working with Power BI (and/or other visualization tools) to build dashboards and reports leveraging BI languages & frameworks (i.e. DAX, PowerQuery)
• Experience working with business stakeholders to understand business processes and goals and work with IT to translate these needs into requirements and desired technology solutions
• Experience managing projects including defining scope, establishing business value and ongoing communication on status and risk
• Understanding of application design and life cycles
• Strong knowledge Data structures, Data Engineering concepts, Algorithms, Collections
• Experience in large scale cloud data migrations using Snowflake, Python, Spark, SQL
• Critical thinking and problem-solving skills, including planning, organizing and adaptability
• Ability to interact with team members at all levels of the organization and with cross functional teams

Skills

* Required skills