Reporting to our Head of Data, you will work alongside our data and development teams to refine and optimize our current data ingestion, ETL, and cleansing models.
The responsibilities include building new data ingestion pipelines using Python, and SQL all running on AWS; data wrangling, management, and standardization; data quality analysis and cleansing; and applying best practices in software development.
We plan to utilize our data to build machine learning models and uncover hidden insights, but first, we must build a good foundation to ensure our long-term success.
You will have a chance to influence our cloud data infrastructure design, take ownership of end-to-end data projects, and liaise with other parts of the business to ensure we can leverage our data to create value for our clients.
Requirements & Skills:
You have prior experience as a Data Engineer or Software Engineer, building ETL/ELT pipelines from scratch.
You have experience with monitoring and alerting of data ingestion jobs.
You are an independent contributor but also enjoy leading projects and productionising solutions for complex problems.
You thrive in a fast-paced, scale-up environment.
You seek to continuously improve processes and find the most optimal way to solve problems.
You can work remotely and independently, taking ownership of your work.
You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce.
Extensive experience with Python for data ingestion, transformation, and loading processes.
Practical experience in AWS cloud services.
Good understanding of relational databases.
Proficient in monitoring and alerting for data ingestion pipelines using tools such as Datadog, focussing on ensuring high availability and reliability.
Proficiency in using Unix / Linux at the command line to perform software development and maintenance.
Proven experience in version control, CI/CD, unit test, integration test, functional test, and writing documentation.
Practical experience in modern software engineering techniques and best practices.
