
Company |
DRW |
Job title |
Data Engineer |
Job location |
Montréal, Canada |
Type |
Full Time |
Responsibilities:
- Manage large-scale data projects, from design to implementation
- Create and manage ETL and data pipelines
- Continuously manage, clean, and validate historical and live data for downstream ML tasks
- Combine large datasets from a variety of sources
- Design, build, and maintain dashboards to visualize historical and live data
- Build scalable and performant software using software engineering best practices
- Drive data projects and lead new initiatives
- Collaborate with stakeholders from different departments
Requirements & Skills:
- A bachelor’s or master’s degree in computer science, software engineering, or equivalent
- 3+ years of experience building software systems
- Proven track record of working with large datasets (ingesting, cleaning, preprocessing, analyzing, and validating data)
- Excellent programming and scripting skills (Python, SQL, Go or equivalent)
- Experience working with time series structured data or streaming data
- Experience with relational databases, time-series databases
- Strong understanding of software engineering principles and best practices
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Experience with any of these technologies is an asset: Redis, RabbitMQ, GraphQL, Kafka, ELK, Docker, AMQP
