Data Engineer II

About This Role

Develop and operationalize data pipelines to provide data for reports and advanced analytics, including ingestion, transformation, validation, optimization, and orchestration. Engage with DevSecOps engineers for continuous integration and deployment.

Responsibilities

• Develop and operationalize data pipelines for consumption (reports and advanced analytics)
• Design and implement standardized data management procedures (staging, ingestion, preparation, provisioning, destruction)
• Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics
• Design, develop, and maintain real-time processing applications and real-time data pipelines
• Ensure quality of technical solutions as data moves across environments
• Provide insight into the changing data environment, processing, storage, and utilization requirements
• Develop, construct, test, and maintain architectures using programming language and tools
• Identify ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated

Requirements

• 2-4 years of related experience in data engineering
• Experience with Big Data or Data Processing
• Experience with Data Manipulation or Data Mining
• Experience working in a production cloud infrastructure
• Experience with C#, Java, Programming Concepts, Programming Tools, Python, or SQL

Qualifications

• Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) or equivalent experience
• 2-4 years of related experience

Skills

* Required skills

Benefits