Azure Data Engineer Job at My3Tech, Philadelphia, PA

enJLYVprVWVEV0w2dEU5M2d2dkJVcGdrY3c9PQ==
  • My3Tech
  • Philadelphia, PA

Job Description

Title: Azure Data Engineer

Location: Remote w/ 1 Monthly on-site meeting to Philadelphia, PA required (University City Section)

  • Must reside in Pennsylvania, New Jersey, Maryland or Delaware only (for benefits purposes once converted)

Type of Employment: Contact to Hire (6 Months to Hire)

We are Seeking an experience Azure Cloud Data Engineer. The Senior Azure Cloud Engineer will be responsible for designing, deploying, and maintaining our Azure Data pipelines. You will develop, optimize, and maintain data pipelines as well as support data platform team's efforts to generate data-driven insights. The Senior Azure Data Engineer is a member of a team, and should have strong experience with Azure Cloud, Azure Data Lake, Databricks, ADF (Azure Data Factory) and Python. Prior experience supporting SQL/SQL Server on prem would be highly desired since they still do have some data warehouses in SQL Server and on-prem.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines and architectures on Azure Cloud.
  • Implement and manage Azure Data Lake solutions to store and process large volumes of data.
  • Utilize Databricks for data processing, transformation, and analytics.
  • Develop and maintain ETL processes using Azure Data Factory.
  • Write efficient and optimized SQL queries to extract, transform, and load data.
  • Work with relational databases to ensure data integrity and performance.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Monitor and troubleshoot data pipelines to ensure reliability and performance.
  • Implement data security and compliance measures in accordance with industry standards.

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field is required.
  • 8-10+ years of Data Engineering experience with a focus on Azure Cloud services for 2-3+ years.
  • 3-5+ years of experience working with Azure Data Lake.
  • 3-5+ years of Python for data processing and automation.
  • 2+ years of Databricks experience.
  • 1-2+ years of Azure Data Factory (ADF) for extra, transfer, load process.
  • 5+ years of SQL and prior experience with other ETL processes such as SSIS.
  • Familiarity with data governance and security best practices.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Master's degree in a related field.
  • Certification in Azure Data Engineering or related Azure certifications.
  • Experience with other Azure services such as Azure Synapse Analytics, Azure Machine Learning, etc.
  • Knowledge of big data technologies like Hadoop, Spark, etc.

Job Tags

Remote job,

Similar Jobs

Lutheran Life Communities

On-Call Receptionist Job at Lutheran Life Communities

 ...Start a new career as an On-Call Receptionist at Luther Oaks Skilled Nursing Community! At Luther Oaks you will start a satisfying career in a faith-based, mission-driven organization where our team members are supported and called to serve. Pleasant View has a culture... 

Rooftop Chimney Sweeps LLC

Chimney Sweep / Repair Technician Job at Rooftop Chimney Sweeps LLC

: As a Chimney Repair Technician Apprentice , youll work alongside industry experts to learn the ins and outs of chimney repairs...  .... From relining chimneys to installing wood-burning appliances, gas fireplaces, and performing masonry repairs, youll gain skills... 

SKLD Ionia

Licensed Practical Nurse (LPN) Job at SKLD Ionia

 ...pay Sign on Bonuses **No Mandating Sign on Bonus available for Full and Part Time positions: ~ Licensed Practical Nurse (LPN) - $6,000 Full Time and $3,000 Part Time WORK SOMEPLACE AWESOME! Being a nurse is a tough job; money is important but so is being... 

ARC Document Solutions

Outside Sales Rep - Graphics Solutions Consultant Job at ARC Document Solutions

 ...local, regional and national businesses. Engage from C level executives to owners and other decision makers to gain understanding of...  ...Medical, Dental, Vision, and Life Insurance; a 401(k) plan with a company match, Employee Stock Purchase Plan at 15% below street price... 

Diversified Transfer and Storage, Inc.

Class C Class A CDL Team Drivers Job Job at Diversified Transfer and Storage, Inc.

Class C Class A CDL Team Drivers JobAttention experienced team drivers! Join the exceptional team at Diversified Transfer & Storage (DTS) for a rewarding journey! Ready to hit the open road in a 2024 Volvo or Kenworth with your driving partner or partners? (And yes,...