Sr. Data Engineer

About This Role

Serve as a Senior Data Engineer, responsible for designing, building, and maintaining robust data pipelines and data solutions. This role focuses on leveraging Python, PL/SQL, DBT, and Google Cloud Platform technologies to deliver high-quality data products.

Responsibilities

• Perform Python programming for ETL scripting and business logic implementation with data manipulation libraries
• Utilize PL/SQL for data transformation, view/table creation, and persistence layer interactions
• Develop and create data models and documentation using DBT (Data Build Tool)
• Implement orchestration with Airflow, Dataflow, and Cloud Composer
• Manage data ingestion using Cloud Functions, Cloud Run, SFTP mechanisms, and Falcon for database connections
• Work with Google Cloud Platform (GCP) and BigQuery for data processing
• Apply experience with cloud-native data processing
• Understand householding and data segmentation logic
• Handle streaming and batch data processing
• Integrate data from multiple sources (e.g., Reltio, external databases)
• Implement incremental data loading and partitioning strategies

Requirements

• Visa independent candidate
• Python programming, ETL scripting, business logic implementation, and data manipulation libraries (pandas, NumPy)
• PL/SQL for data transformation, view/table creation, and persistence layer interactions
• DBT (Data Build Tool) for creating models and documentation
• Airflow, Dataflow, and Cloud Composer for orchestration
• Cloud Functions, Cloud Run, SFTP mechanisms, and Falcon for data ingestion
• Google Cloud Platform (GCP) and BigQuery experience
• Experience with cloud-native data processing

Nice to Have

• Understanding of householding and data segmentation logic
• Ability to work with streaming and batch data
• Experience with data integration from multiple sources (e.g., Reltio, external databases)
• Familiarity with incremental data loading and partitioning strategies

Skills

* Required skills