Design, develop, optimize, and maintain data architecture and pipelines for analyzing large data sets and identifying patterns and relationships.
Solve complex data problems to deliver insights that help the organization achieve its goals
Manage data sources, organize data, and create data assets using identified open-source or proprietary tools
Design and implement cloud security and access control mechanisms to protect the data from unauthorized use
Interact with other technology teams to define, prioritize, and ensure smooth deployments for other operational components.
Advise, consult, mentor, and coach other data and analytics professionals on data standards and practices.
Foster a culture of sharing, reuse, design for scale stability, and operational efficiency of data and analytical solutions.
Codify best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases to facilitate data capturing and management.
Code in SQL to create curated data products.
Requirements & Skills:
Bachelor’s degree in any of the following – Engineering, Computer Science or other technical field
Minimum 6 years of relevant experience in data engineering/analytics space
Experience developing solutions for cloud computing services, cloud security, and infrastructure on AWS and/or Azure
Experience developing solutions on cloud services like SageMaker, EC2, S3, EMR, Redshift, IAM, etc.
Experience developing and maintaining data warehouses in big data solutions
Expertise in SQL and data analysis and strong hands-on expertise with at least one programming language: Python and/or Scala
Strong knowledge in one or more of the following big data tools: Spark, Hive
Strong expertise in ETL, reporting tools, data governance, data warehousing, and hands-on experience
Up-to-date on industry trends within the analytics space from a data acquisition processing, engineering, and management perspective
Strong people skills, specifically in collaboration and teamwork
High level of curiosity, creativity, and problem-solving capabilities
