Design, develop, document, and maintain robust data pipelines and infrastructure utilizing a suite of Microsoft cloud and on-premises services including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Configure, document, and maintain CI/CD pipelines.
Ensure high standards of data quality, reliability, and scalability across diverse data sources and platforms to support strategic decision-making.
Actively collaborate with data analysts, data scientists, and business stakeholders to gather data requirements, and translate these into actionable data-driven solutions that align with business objectives.
Continuously optimize data pipelines and related processes for enhanced performance, efficiency, and cost-effectiveness, ensuring the best use of resources and technology.
Requirements & Skills:
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Proficiency in SQL and Python, with a solid foundation in coding best practices and design patterns.
Excellent communication, collaboration, and problem-solving skills.
Experience in working with Microsoft D365fo and D365ce.
Experience with the Microsoft Data Engineering suite (Azure Data Factory, Azure Synapse Analytics, Azure Data Fabric, Azure Data Bricks)
Experience in creating products within BI, Machine Learning Models, or other related functions.
