Principal Software Engineer (Distributed Systems/Data)
Job location
Dublin, Ireland
Type
Full Time
Responsibilities:
Design, develop, and support scalable and efficient data applications, tools, and frameworks.
Collaborate with internal data customers to provide optimized solutions for their data needs.
Assist in developing solutions around our big data platforms using technologies such as Flink, Kafka, Kubernetes, Spark-Streaming, and others.
Build efficient data pipelines that allow faster data processing and transformations at scale.
Apply data engineering expertise in troubleshooting problems around our large-scale distributed big data systems.
Build APIs for integration with our internal systems and third-party data sources.
Collaborate closely with other engineers on the data team who are responsible for managing various aspects of our data footprint including data instrumentation, frameworks, ingestion, streaming, processing, transformation, and visualization.
Requirements & Skills:
Extensive background and strong technical expertise in designing, implementing, and running distributed systems at a massive scale.
Production experience with cloud computing (AWS, GCP, or Azure cloud).
Production experience with version control tools and a solid understanding of containerization, build, and deployment processes (Argo CI/CD, GitHub, Jenkins, Airflow, Docker, Kubernetes, etc.).
Comfortable with one or more computer programming languages (Java, Kotlin, Scala, Python, etc.)
Advanced knowledge of some of the big data technologies (Flink, Kafka, PubSub, Spark, etc.).
Advanced understanding of software development practices (preferably agile practices).
Ability to navigate ambiguity and provide optimal solutions for complex problems.
Excellent problem-solving and analytical skills.
Good communication and ability to work with data stakeholders independently.
