Azure Cloud Data Engineer / Michigan Job at AB2 Consulting, Inc., Dearborn, MI

UWh5SGRIQm9yMWEvY3E2ODVldUpIT0ZwdlE9PQ==
  • AB2 Consulting, Inc.
  • Dearborn, MI

Job Description

Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.

Essential Job Functions:

  • Understand requirements and engage with team to design and deliver projects.
  • Design and implement data lake house projects within azure.
  • Design and develop application lifecycle utilizing Microsoft Azure technologies
  • Participate in design and planning and necessary documentation
  • Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
  • Hands on with Python development and Azure data pipelines
  • Engage with team to develop and deliver cross functional products
  • Postgres SQL knowledge is a plus

Minimum Qualifications and Job Requirements:

  • Bachelor's degree in CS.
  • 7 years of hands-on experience in designing and developing distributed data pipelines.
  • 5 years of hands-on experience in Azure data service technologies.
  • 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
  • Experience with data integration with APIs, Web services, Queues
  • Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
  • Working experience with writing SQL queries from scratch

Key Skills

a. Data Engineering and SQL

b. Python

c. PySpark

d. Azure Data lake and ADF

Other Responsibilities:

  • Document and maintain project artifacts.
  • Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
  • Complete training as required for Privacy, Code of Conduct etc.
  • Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
  • Adhere to the company's compliance program.
  • Safeguard the company's intellectual property, information, and assets.

Job Tags

Work experience placement,

Similar Jobs

The Dolphin Group

Call Center Specialist Weekends Job at The Dolphin Group

 ...customer service or administrative support Excellent communication, data entry, and problem-solving skills Familiarity with safety procedures, proper recordkeeping, and communication protocols Weekend Shift (Perfect hours if you are looking for a secondary job!)... 

Dr. Howard Fuller Collegiate Academy

High School Social Studies Teacher Job at Dr. Howard Fuller Collegiate Academy

 ...relationships with students and families, and have a passion for social studies and education. Dr. Howard Fuller Collegiate Academys (HFCA...  ...as scholars capable of a lifetime of success. We seek teachers who are content experts and want the freedom to design lessons... 

Hundred Acre Wine Group Hundred Acre Wine Group

2025 Harvest Cellar Technician Job at Hundred Acre Wine Group Hundred Acre Wine Group

 ...Job Description: The Hundred Acre Wine Group is looking for candidates to join the winery team for the upcoming 2025 harvest. A sincere appreciation for wine and a willingness to work long hours as part of a growing winery team, are required attributes for any candidate... 

JPMorgan Chase

Portfolio Banker - Emerging Middle Market Banking - Executive Director Job at JPMorgan Chase

 ...providing financial advice to your clients. A role as a Portfolio Banker is for you.As a Portfolio Banker in Emerging Middle Market Banking, your role is to be the focal point of maintaining existing client relationships. Bankers work both independently and as part of a... 

SCI Shared Resources, LLC

Courier Job at SCI Shared Resources, LLC

 ...the possibilities of joining a Great Place to Work!Drives Company owned vehicles safely for deliveries or errands. Maintains company vehicles.**JOB RESPONSIBILITIES****Courier**+ Transports and delivers documents, family mementos, flowers, and similar articles safely...