Azure Data Engineer Job at My3Tech, Philadelphia, PA

enJLYVprVWVEV0w2dEU5M2d2dkJVcGdrY3c9PQ==
  • My3Tech
  • Philadelphia, PA

Job Description

Title: Azure Data Engineer

Location: Remote w/ 1 Monthly on-site meeting to Philadelphia, PA required (University City Section)

  • Must reside in Pennsylvania, New Jersey, Maryland or Delaware only (for benefits purposes once converted)

Type of Employment: Contact to Hire (6 Months to Hire)

We are Seeking an experience Azure Cloud Data Engineer. The Senior Azure Cloud Engineer will be responsible for designing, deploying, and maintaining our Azure Data pipelines. You will develop, optimize, and maintain data pipelines as well as support data platform team's efforts to generate data-driven insights. The Senior Azure Data Engineer is a member of a team, and should have strong experience with Azure Cloud, Azure Data Lake, Databricks, ADF (Azure Data Factory) and Python. Prior experience supporting SQL/SQL Server on prem would be highly desired since they still do have some data warehouses in SQL Server and on-prem.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines and architectures on Azure Cloud.
  • Implement and manage Azure Data Lake solutions to store and process large volumes of data.
  • Utilize Databricks for data processing, transformation, and analytics.
  • Develop and maintain ETL processes using Azure Data Factory.
  • Write efficient and optimized SQL queries to extract, transform, and load data.
  • Work with relational databases to ensure data integrity and performance.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Monitor and troubleshoot data pipelines to ensure reliability and performance.
  • Implement data security and compliance measures in accordance with industry standards.

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field is required.
  • 8-10+ years of Data Engineering experience with a focus on Azure Cloud services for 2-3+ years.
  • 3-5+ years of experience working with Azure Data Lake.
  • 3-5+ years of Python for data processing and automation.
  • 2+ years of Databricks experience.
  • 1-2+ years of Azure Data Factory (ADF) for extra, transfer, load process.
  • 5+ years of SQL and prior experience with other ETL processes such as SSIS.
  • Familiarity with data governance and security best practices.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Master's degree in a related field.
  • Certification in Azure Data Engineering or related Azure certifications.
  • Experience with other Azure services such as Azure Synapse Analytics, Azure Machine Learning, etc.
  • Knowledge of big data technologies like Hadoop, Spark, etc.

Job Tags

Remote job,

Similar Jobs

First Financial Federal Credit Union of Maryland

Universal Services Representative II Job at First Financial Federal Credit Union of Maryland

 ...Universal Services Representative Department: Member Experience Reports To: Branch Manager Salary Grade(s): 7...  ...time ? Part-time Location: Pocomoke City ? Telework Work Possible (if checked) Important: See Telework Policy for Additional... 

Omm IT Solutions

Sr Full Stack (React/Node) Developer Job at Omm IT Solutions

 ...or directed. Key Required Skills: React, Node Redux Mobx Flux Typescript...  ...development experience with Node.js and React.js with detailed understanding...  ...js. Strong development experience with developing RESTful Web Services using Node.js. Comprehensive... 

Jewish Long Beach

Toddler Associate Teacher Job at Jewish Long Beach

Employment Status: Full Time (40 Hours) or Part-Time (30 Hours) Schedule: Day shift, Monday-Friday Salary: $18-$23/Hour Benefits: ~ Dental Insurance ~ Employee Assistance Program ~ Employee Discount Program ~ Free Family Membership ~ Health Insurance...

Hyundai America Technical Center, Inc. (HATCI)

KDCA CAS Modeler Job at Hyundai America Technical Center, Inc. (HATCI)

 ...America located in California is currently looking for a [ Senior CAS Modeler ] that will: Create innovative and compelling interior and...  ...Independently be able to quickly generate high-quality 3D models primarily using Alias, and (to a lesser degree) SubD or Blender... 

Intermountain Express Transport, Inc.

Box Truck Delivery Driver Job at Intermountain Express Transport, Inc.

 ...As a driver for Intermountain Express our drivers will spend their time driving a route solo to pick up loose freight ( median freight is about 20lbs / piece). This is a Monday through Friday Job. The equipment being used is a 24'-26' box truck. Although these trucks...