This job has expired
Looking for a job like Data Engineer, Cloud in or near New York, NY? Upload your resume and we'll notify you when similar positions become available.
Upload Your ResumeAbout This Role
This role involves building and optimizing cloud-native data pipelines and IT infrastructure from the ground up, with a focus on GCP. The engineer will shape a scalable data environment and influence tooling and architectural decisions for data foundations and internal applications.
Responsibilities
- Build and optimize cloud-native data pipelines within a clean, scalable GCP environment
- Manage PostgreSQL and TimescaleDB systems to support complex geospatial and high-velocity time-series datasets
- Develop Python-based ETL/ELT workflows using GCP-native tools like Dataplex, Cloud Run, or Dataflow
- Implement monitoring, alerting, and dashboards to maintain data infrastructure health and uptime
- Drive the transition to "Infrastructure as Code" using Terraform for reproducible and version-controlled environments
- Set up automated CI/CD pipelines via Jenkins or GitHub Actions to replace manual deployment processes
- Architect the foundation for Retrieval-Augmented Generation (RAG) using BigQuery’s vector search and Vertex AI
Requirements
- 2-4+ years of data engineering experience on GCP or AWS
- Proficiency in Python and SQL for ETL automation and PostgreSQL/TimescaleDB orchestration
- Familiarity with modern engineering practices, including infrastructure-as-code with Terraform, GCP-native tools like Dataflow, or experience in hybrid DevOps/Data roles
- Skill in cloud observability using tools like Grafana, CloudWatch, or Cloud Monitoring
- Independent troubleshooter capable of managing workflows in an early-stage environment
Qualifications
- Bachelor’s degree in Computer Science, Data Science, Engineering, Information Systems/IT, or a related technical field
- 2-4+ years of data engineering experience on GCP or AWS
Skills
Python
*
SQL
*
AWS
*
Jenkins
*
Terraform
*
BigQuery
*
Grafana
*
GCP
*
Vertex AI
*
Cloud Run
*
PostgreSQL
*
GitHub Actions
*
CloudWatch
*
TimescaleDB
*
Dataplex
*
Dataflow
*
Cloud Monitoring
*
* Required skills
About Karbone
Karbone Inc. is an award-winning liquidity services provider for energy transition and environmental commodity markets. They offer integrated and innovative revenue hedging, risk management, and market advisory solutions.
Finance
View all jobs at Karbone →