Data DevOps Engineer
Posted 3 weeks ago
Interested in this position?
Upload your resume and we'll match you with this and other relevant opportunities.
Upload Your ResumeAbout This Role
Join the Machine Learning and Artificial Intelligence (ML/AI) team as a Data DevOps Engineer, responsible for designing, developing, and maintaining scalable data pipelines for ML/AI products. Collaborate with cross-functional teams to integrate and deploy data-driven solutions, enhancing stability, performance, and scalability of data processing systems. This role is critical in developing innovative products that impact organizations globally.
Responsibilities
- Design, develop, and maintain scalable data pipelines for ML/AI products
- Collaborate with DevOps teams to build and optimize data infrastructure
- Work closely with Data Scientists and Software Engineers to implement new features and functionalities
- Enhance monitoring, alerting, and debugging processes for existing data pipelines
- Ensure data security, compliance, and integrity across all systems
- Automate deployment, scaling, and management of data infrastructure using modern tools
- Participate in code reviews, documentation, and best practices for data engineering
- Identify and resolve bottlenecks and performance issues in data workflows
- Stay updated with the latest trends and advancements in data engineering and AI technologies
Requirements
- 8+ years of experience in Data Engineering, DevOps, or related fields
- Proven experience setting up and managing multitenant Spark and Kafka clusters
- Strong skills in Python, Scala, or Java programming languages
- Experience with infrastructure automation tools such as Jenkins, Ansible, Terraform, or similar
- Extensive experience in cleaning, processing, managing, analyzing, and searching large data collections
- Knowledge of Apache Spark, Apache Kafka, and related ecosystem tools
- Familiarity with database technologies, including NoSQL, SQL, and cloud-based databases
- Ability to handle multiple projects simultaneously in a team environment
- Excellent problem-solving and debugging skills
- Strong communication and collaboration abilities
- Authorized to work in the United States
Qualifications
- Over 8 years of expertise in Data Engineering, DevOps, or related fields
Skills
* Required skills
Benefits
About Versa Networks
Versa Networks is revolutionizing how businesses connect, secure, and optimize their networks, empowering organizations globally to transform their IT infrastructure for the modern cloud era with Secure SD-WAN, SSE, SASE, and Next-generation Managed Services. The company fosters a culture of innovat...