Data Engineer, Ideas2IT

Data Engineer, Ideas2IT

Company Ideas2IT
Job title Data Engineer
Job location Chennai, Tamil Nadu, India
Type Full Time

Responsibilities:

  • You will work on diverse technology challenges like:
    • A robust distributed platform to manage a self-healing swarm of bots on unreliable network / compute
    • Large-scale Cloud-Native applications
    • Document Comprehension Engine leveraging RNN and other latest OCR techniques
    • Completely data-driven low-code platform
  • You will leverage cutting-edge technologies like Blockchain, IoT, and Data Science as you work on projects for leading Silicon Valley startups.
  • Your role does not start or end with just Java development; you will enjoy the freedom to share your suggestions on the choice of tech stacks across the length of the project
  • If there is a certain technology you would like to explore, you can do your Technical PoCs
  • Work in a culture that values capability over experience and continuous learning as a core tenet

Requirements & Skills:

  • Proficiency in SQL and experience with database technologies (e.g., MySQL,  PostgreSQL, SQL Server).Experience in any one of the cloud environments – AWS, Azure
  • Experience with data modeling, data warehousing, and building ETL pipelines.
  • Experience building large-scale data pipelines and data-centric applications using any distributed storage platform
  • Experience in data processing tools like Pandas, pyspark.
  • Experience in cloud services like S3, Lambda, SQS, Redshift, Azure Data Factory, ADLS, Function Apps, etc.
  • Expertise in one or more high-level languages (Python/Scala)
  • Ability to handle large-scale structured and unstructured data from internal and third-party sources
  • Ability to collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization
  • Experience with data visualization tools like PowerBI, Tableau
  • Experience in containerization technologies like Docker, Kubernetes

apply for job button