Lead Azure Data Engineer Job at Stellar IT Solutions LLC, Minneapolis, MN

U05UTHM0eC9yVTU5a3VJQlQyWkgwNEdDcEE9PQ==
  • Stellar IT Solutions LLC
  • Minneapolis, MN

Job Description

Job Title: Lead Data Engineer
Interview: One/Done
Job Duration: 6+ Months
Job Location: Minneapolis, MN

Job Description:

We are looking for a skilled Senior/Lead Data Engineer with expertise in Python, Apache Spark, and Azure Data Engineering services to design and manage scalable ETL pipelines supporting AI/ML initiatives. The ideal candidate will have strong experience with Azure Synapse, Data Factory, SQL, and Data Warehousing, along with CI/CD deployment and cross-functional collaboration.


Key Responsibilities:

  • Build and optimize ETL pipelines using Python, Spark, and Azure Synapse.
  • Manage Azure Data Factory workflows, SQL Pools, and Spark Pools.
  • Develop Data Warehousing solutions to support AI/ML requirements.
  • Implement CI/CD pipelines and automate infrastructure provisioning.
  • Collaborate with cross-functional teams to deliver data solutions.
  • Develop and deploy APIs, leveraging Kubernetes for containerized applications.
  • Support Agile development processes and mentor junior team members.

Required Skills:

  • Advanced knowledge of Python, Spark, Azure Synapse, and Data Factory.
  • Proficiency in SQL, CI/CD tools, and Azure Cloud services.
  • Experience with APIs, Kubernetes, and ADLS Gen2.
  • Strong problem-solving and communication skills.
  • Agile experience with the ability to lead and mentor teams.


Preferred Qualifications:

  • Azure certifications in data engineering or cloud architecture.
  • Experience deploying AI/ML models and ensuring data governance compliance.

 

Job Tags

Similar Jobs

Vail Resorts

Driver CDL - Housing May Be Available Job at Vail Resorts

 ...Create Your Experience of a Lifetime! Come work and play in the mountains! Whether it...  ...grow through Epic Service - our leading training and development experience, and wellness...  ...commercial driving experience is required, and paid CDL training and testing are provided.... 

Cox Media Group

Photographer/Videographer - WSOC TV Job at Cox Media Group

 ...Location:NC-Charlotte Job Title: Photographer/Videographer - WSOC TV Position Overview WSOC TV Charlotte is looking for a visual storyteller who has a passion for news and someone who wants to make an impact in their community. Photographers work with reporters... 

Get It - Executive

Virtual Executive Assistant - Remote Job at Get It - Executive

Are you passionate about working from home as a Virtual Executive Assistant? We are looking for an experienced Virtual Executive Assistant/Project Manager to join our team! This position allows you to enjoy the flexibility of working from anywhere with reliable Wi-Fi, while... 

Bridgeway Professionals

Mechanic Job at Bridgeway Professionals

 ...Hey there! Are you a mechanically-minded individual with a knack for fixing things and making sure everything runs smoothly? If so, we...  ...knowledge and experience. Experience with welding (MIG) and forklifts. The ability to read and interpret prints without... 

One Solution Provider

Digital Marketing Job at One Solution Provider

 ...ready to level up? Do you want to get fast-tracked to become a marketing leader? If you have a background in marketing and want to gain...  ...probationary period" to determine if the role is a good fit. This is a remote (work from home) position, and working hours align with US...