Develops and maintains scalable data pipelines and builds new API integrations to handle increasing data volume and complexity.
Collaborates with analytics and business teams to enhance data models for business intelligence tools, promoting data accessibility and informed decision-making.
Implements processes and systems to monitor data quality, ensuring accurate production data for stakeholders and critical business processes.
Writes unit/integration tests, contributes to engineering documentation, and maintains thorough records.
Conducts data analysis to troubleshoot issues and assist in resolving data-related problems.
Works closely with front-end and back-end engineers, product managers, and analysts.
Designs data integrations and establishes data quality frameworks.
Evaluates open source and vendor tools for data lineage.
Requirements & Skills:
3-5 years experience as a Data Engineer.
Proficient in Python, SQL, and associated libraries.
Experience building Data pipelines using AWS Redshift.
Experience within the ESG / NFP space is preferred
Databricks experience is a bonus.
Ability to process unstructured data from government websites and APIs.