| Company |
ARRK Engineering |
| Job title |
DevOps and ETL Engineer with Azure |
| Job location |
Petaling Jaya, Malaysia |
| Type |
Full Time |
Responsibilities:
- Development and implementation of scalable ETL processes, in particular using Azure Databricks.
- Management and optimization of data pipelines and data integration solutions based on Azure and AWS.
- Build and maintain CI/CD pipelines and automate development and operations processes using Azure DevOps.
- Collaborate with cross-functional teams to analyze requirements and ensure the successful implementation of cloud-based solutions
- Monitoring and optimizing system and application performance in the cloud
- Ensuring best practices in terms of security, scalability, and reliability
- Takeover of the responsibility for on-call availability at least one week per month.
Requirements & Skills:
- Experience with Azure Cloud is a plus (e.g., Databricks and other Azure data services).
- In-depth knowledge of developing and managing ETL processes and data pipelines.
- Hands-on experience with DevOps tools and processes.
- Good knowledge of common programming languages for data processing and pipeline development.
- Experience with container technologies such as Docker and Kubernetes.
- Ability to work in an agile environment and translate complex technical requirements into practical solutions.
