0%

Azure Data Engineer

Azure Data Engineer

About ThoughtMinds:

ThoughtMinds is one of the fastest-growing AI-driven software product engineering firms leveraging its unique ‘Half AI + Half Human’ approach to building software. With over two decades of experience in driving digital transformation & product engineering solutions for global clients, we leverage our in-house accelerators to fast-track ROI.

As part of our expansion, we are seeking a creative and strategic Content Strategist with 2–3 years of experience to plan, create, and manage high-impact content across multiple platforms.


Role Overview:

We are seeking a highly skilled and experienced Azure Data Engineer to join our growing data team. The ideal candidate will have a strong background in building and managing data solutions on Microsoft Azure, particularly with hands-on expertise in Azure Databricks, Azure Data Factory, Azure Synapse, ADLS, and PySpark.


Key Responsibilities:

· Design, develop, and maintain robust data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.

· Work on data ingestion, transformation, and integration across a variety of structured and unstructured data sources.

· Implement data models, architecture, and data design strategies to support analytics and reporting needs.

· Write efficient, reusable, and optimized code using PySpark, Spark SQL, and Python.

· Collaborate with cross-functional teams to understand business requirements and deliver scalable data solutions.

· Ensure data quality, security, and compliance throughout the data lifecycle.

· Contribute to the development of best practices for data engineering on Azure.


Required Skills & Qualifications:

· 5+ years of relevant experience in data engineering on Microsoft Azure.

· Strong hands-on experience with:

o Azure Databricks

o Azure Data Factory

o Azure Synapse Analytics

o Azure Data Lake Storage (ADLS)

o PySpark, Spark SQL, Python

· Solid understanding of data modeling and data warehouse design principles.

· Proficiency in SQL databases and exposure to NoSQL systems.

· Familiarity with object-oriented scripting languages like Python, Scala, and Spark-SQL.

· Experience with Microsoft Fabric.


Nice-to-Have Skills:

· Experience with Snowflake

· Proficiency in Power BI

· Exposure to AI/ML and GenAI technologies


Preferred Attributes:

· Strong analytical and problem-solving skills.

· Excellent verbal and written communication.

· Ability to work independently and in a team-oriented, collaborative environment.

· Passion for continuous learning and innovation in the data space.


Educational Qualification:

· Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.

  • Location
    India
  • Employment Type
    Full time
  • Experience
    5+ Years
  • Department
    Engineering
  • Compensation
    Not Disclosed