Data Engineer - Databricks

Pittsburgh, Pennsylvania

Apply Apply with LinkedIn
Save

Type: Contract-to-Hire

Experience: 0

Category: Information Technology

Contractor Work Model: Onsite

Brand: System One

Compensation Range: 120000.00 Per Hour

Job ID: 377507

Date Posted: 07/26/2026

Shortcut: http://jobs.systemone.com/8j8YwI


Data Engineer – Azure Databricks
Contract-to-Hire
Pittsburgh, PA – Onsite


Job ID J0726-0569

Visa : USC, GC, EAD (No Sponsorship)
Position Overview

  • Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for building modern, cloud-native data platforms on Microsoft Azure.
  • This role will focus on designing and implementing scalable, secure, and high-performance data solutions using Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog. The position requires strong expertise in enterprise data governance, metadata management, security, and access control within the Investment Banking, Securities, or Capital Markets domain.
  • The ideal candidate is passionate about cloud data engineering, enjoys solving complex data challenges, and thrives in a collaborative Agile environment.

Required Competencies
Competency Importance Proficiency Level
  • Apache Spark
  • Required
  • Expert
  • Microsoft Azure
  • Required
  • Advanced
  • Investment Banking and Securities
  • Required
  • Advanced
  • Structured Query Language – SQL
  • Required
  • Expert
  • Unity Catalog
  • Required
  • Advanced
  • Databricks
  • Required
  • Expert
Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Azure Databricks.
  • Build and optimize ETL and ELT workflows using PySpark, SQL, Apache Spark, and Delta Lake.
  • Implement and manage Unity Catalog for enterprise data governance, metadata management, security, and fine-grained access control.
  • Develop cloud-native data engineering solutions on the Microsoft Azure platform.
  • Collaborate with architects, business analysts, and cross-functional teams to translate business requirements into technical solutions.
  • Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency.
  • Ensure data quality, reliability, governance, and regulatory compliance through validation, monitoring, and engineering best practices.
  • Support production deployments, troubleshooting, root-cause analysis, and performance tuning.
  • Participate in code reviews, technical documentation, and continuous improvement initiatives.
  • Apply cloud data engineering, security, CI/CD, and DevOps best practices within Azure environments.
Required Qualifications
  • 8+ years of overall data engineering or related technology experience preferred.
  • Minimum 5 years of hands-on Azure Databricks experience.
  • Mandatory hands-on experience implementing and managing Unity Catalog.
  • Expert-level experience with Apache Spark, PySpark, and SQL.
  • Strong experience developing enterprise-scale data engineering solutions on Microsoft Azure.
  • Strong experience with Delta Lake, ETL/ELT development, and data pipeline implementation.
  • Experience with Azure Data Factory and Azure Data Lake Storage Gen2.
  • Strong knowledge of the Microsoft Azure data ecosystem.
  • Strong understanding of data governance, metadata management, data security, and access control.
  • Mandatory experience within Investment Banking, Securities, or Capital Markets.
  • Experience using Git and implementing CI/CD practices.
  • Experience working in Agile/Scrum delivery environments.
  • Excellent analytical, communication, and problem-solving skills.
  • Must be willing to work onsite in Pittsburgh, PA.
  • Must be willing and eligible to convert to full-time employment after six months.
Preferred Qualifications
  • Databricks Certified Data Engineer Associate or Professional certification.
  • Microsoft Certified Azure Data Engineer Associate, DP-203.
  • Experience with Infrastructure as Code using Terraform or Bicep.
  • Experience implementing DevOps practices for Azure Databricks environments.
  • Familiarity with Microsoft Purview or Azure Purview.


#M1
#DI-CB2


#L1 - KB1

Ref: #404-IT Pittsburgh

  • Data Engineer - Databricks

    Pittsburgh, Pennsylvania

    Job Title: Data Engineer – Databricks Duration : Contract to Hire Location : Pittsburgh, PA Work Mode : 5 Days Onsite Job Description: Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsof...

    Date Posted: 07/22/2026 Recommended

  • Databricks Subject Matter Expert

    Atlanta , Georgia

    Databricks Subject Matter Expert Permanent Full Time Location: Atlanta, Georgia, United States Description: Databricks Subject Matter Expert Position Description We are seeking a highly experienced Databricks Subject Matter Expert to join at the Lead /...

    Date Posted: 05/08/2026 Recommended

  • Databricks Subject Matter Expert

    Atlanta , Georgia

    Position Title: Databricks Subject Matter Expert Position Location: Altalnta, GA Duration – Direct Hire Employment Type - This is for W2 Employment Required qualifications to be successful in this role . 10+ years of professional experience in data eng...

    Date Posted: 05/12/2026 Recommended

  • Senior AI Software Engineer

    Plano, Texas

    AI Software Engineer Location: Plano, TX (Hybrid – onsite required) Duration: 6+ Months Contract to Hire Start Date: ASAP Position Overview We are seeking an experienced AI Software Engineer to join a growing engineering team focused on building scalab...

    Date Posted: 05/08/2026 Recommended

  • IT Systems Engineer

    Bellevue, Washington

    IT Systems Engineer (Contract) System One Location: Bellevue, WA (Onsite) Schedule: Full-Time, 40 hours/week Contract Position Position Summary System One is seeking an experienced IT Systems Engineer to support enterprise infrastructure operations for...

    Date Posted: 07/07/2026 Recommended

  • OSP Engineer

    Beaverton, OR

    Mountain Ltd. has an opening for a OSP Engineer to work remotely, supporting PST time! Job Summary: The OSP Engineer performs detailed outside plant facility engineering tasks that includes estimating, analyzing, designing, planning, budget tracking es...

    Date Posted: 07/22/2026 Recommended

  • Senior IT Data Engineer

    Washington, District of Columbia

    Senior IT Data Engineer Washington, DC – onsite US citizenship required per government contact Must be able to obtain Public Trust clearance Type: Multi-year Contract Open to W2 and C2C Must apply by June, 6th The Data Architecture, Technology, and Ana...

    Date Posted: 05/29/2026 Recommended

  • Technical Data Steward

    Virginia, VA

    Job Title: Technical Data Steward Location: Remote Pay Rate: Open to Both C2C and W2 options Position Type: Multiyear Contract The Technical Data Steward is responsible for the technical data management, governance, integrity and quality of Human Resou...

    Date Posted: 07/27/2026 Recommended

  • Sr. Test Automation Engineer

    Midvale , Utah

    Job Title: Senior Test Automation Engineer Duration : Contract to Hire Location : Salt Lake City/Midvale, UT Work Mode : 5 Days Onsite Years Of Exp : 7+ Yrs Job Description: We are seeking a Senior Test Automation Engineer to join our team! You will be...

    Date Posted: 06/22/2026 Recommended

  • Sr. Test Automation Engineer

    Midvale , Utah

    Job Title: Senior Test Automation Engineer Duration : Contract to Hire Location : Salt Lake City/Midvale, UT Work Mode : 5 Days Onsite Years Of Exp : 7+ Yrs Job Description: We are seeking a Senior Test Automation Engineer to join our team! You will be...

    Date Posted: 06/22/2026 Recommended

  • Senior IT Data Engineer (onsite)

    Washington , DC

    Senior IT Data Engineer Washington, DC – onsite US citizenship required per government contact Must be able to obtain Public Trust clearance Type: Multi-Year Contract supporting Federal Reserve Board Open to W2 and C2C Must apply by 12pm on July 2nd Th...

    Date Posted: 06/30/2026 Recommended

  • OSP Engineer

    Billings, MT

    Mountain Ltd. has an opening for an OSP Engineer working in the Billings, MT area. Overview: The OSP Engineer performs detailed outside plant facility engineering tasks that includes estimating, analyzing, designing, planning, budget tracking estimates...

    Date Posted: 07/22/2026 Recommended

  • OSP Engineer

    Helena , MT

    Mountain Ltd. has an opening for an OSP Engineer working in the Helena, MT area. Job Description: The OSP Engineer performs detailed outside plant facility engineering tasks that includes estimating, analyzing, designing, planning, budget tracking esti...

    Date Posted: 07/22/2026 Recommended

  • Commissioning Engineer

    Lake Mary, FL

    Job Title: Commissioning Engineer Location: Lake Mary, FL, United States Type: Direct Hire Compensation: $110,000.00 - $110,000.00 Contractor Work Model: Onsite – onsite Hours: 40.0 Security Clearance: System One is e are seeking a high-caliber Commiss...

    Date Posted: 05/21/2026 Recommended

  • OSP Engineer III

    Great Falls, MT

    Mountain Ltd. has an opening for an OSP Engineer working in the Great Falls, MT area. Overview: The OSP Engineer performs detailed outside plant facility engineering tasks that includes estimating, analyzing, designing, planning, budget tracking estima...

    Date Posted: 07/22/2026 Recommended

  • OSP Engineer

    Hot Springs National Park, AR

    Mountain Ltd. is seeking an OSP Engineer to work Remotely in the pacific standard time zone. Job Summary: The OSP Engineer performs detaile\d outside plant facility engineering tasks that includes estimating, analyzing, designing, planning, budget trac...

    Date Posted: 07/21/2026 Recommended

  • OSP Engineer

    Mount Vernon, WA

    Mountain Ltd. has an opening for an OSP Engineer in the Mount Vernon, WA area. Job Description The Outside Plant Engineer will be responsible for the application engineering of telecommunications outside plant in a local serving exchange environment. T...

    Date Posted: 07/22/2026 Recommended

  • OSP Engineer

    Edmonds, WA

    Mountain Ltd. has an opening for an OSP Engineer, working in the Edmonds, WA area. Job Summary The Outside Plant Engineer will be responsible for the application engineering of telecommunications outside plant in a local serving exchange environment. T...

    Date Posted: 07/22/2026 Recommended

  • OSP Engineer

    Everett, WA

    Mountain Ltd. has an opening for an OSP Engineer, working in the Everett, WA area. Job Summary The Outside Plant Engineer will be responsible for the application engineering of telecommunications outside plant in a local serving exchange environment. T...

    Date Posted: 07/22/2026 Recommended

  • OSP Engineer

    Tacoma, WA

    Mountain Ltd. has an opening for an OSP Engineer, working in the Pierce/Thurston Counties area. Job Summary The Outside Plant Engineer will be responsible for the application engineering of telecommunications outside plant in a local serving exchange e...

    Date Posted: 07/22/2026 Recommended

  • Data Engineer

    Pittsburgh, PA

    Position Title: Data Engineer Location: PA – Pittsburgh (Locals Preferred) Work Status : Onsite 5 days a week Duration : Contract to Hire Years Of Experience Required : 6+ Years Industry Background: Finance / Banking Function of the Group: Support Cost...

    Date Posted: 07/21/2026 Recommended

  • Floodplain and Dam Engineer - Technical Lead

    Chantilly, VA

    Job Title: Floodplain and Dam Engineer - Technical Lead Location: Chantilly, VA Overview The Floodplain and Dam Engineer - Technical Lead involves work on floodplain modeling, floodplain permitting, floodplain crossing design, dam modeling, and dam per...

    Date Posted: 07/21/2026 Recommended

  • OSP Engineer

    Coeur d'Alene, ID

    Mountain Ltd. has an opening for an OSP Engineer working in the Coeur d'Alene ID area. Overview: The OSP Engineer performs detailed outside plant facility engineering tasks that includes estimating, analyzing, designing, planning, budget tracking estim...

    Date Posted: 07/22/2026 Recommended

  • Electrical Engineer

    Lenexa, KS

    Job Title: Electrical Engineer Location: Lenexa, KS Job Type: Contract-to-Hire Work Model: Onsite Conversion Salary Range: $70,000 – $130,000 (flexible based on experience) Position Overview We are seeking a high-level Electrical Engineer to join our t...

    Date Posted: 07/08/2026 Recommended

  • Data Architect

    Plano, Texas

    Description: Direct Hire Hybrid schedule in Plano, TX Comp range: $150-180K 15% travel (including int'l) MUST BE US CITIZEN or GREEN CARD HOLDER (No C2C) JOB DESCRIPTION Architect the Future of Enterprise Intelligence The Senior Data Architect provides...

    Date Posted: 07/02/2026 Recommended

  • OSP Field Engineer

    Portland, OR

    Mountain Ltd. has an opening for an OSP Field Engineer in the Portland, OR area! Job Description: This role requires assisting an engineer with pole inventories, retagging, inspections, and data collection, largely independently. The position requires ...

    Date Posted: 07/22/2026 Recommended

  • Nuclear Engineering Program Specialist and Procedure Writer Engineer

    Bellevue, Washington

    Nuclear Engineering Plant Program Specialist / Nuclear Procedure Writer Job Type: Contract - Remote Schedule: 40 hours/week System One is seeking an experienced Nuclear Engineering Plant Program Specialist / Nuclear Procedure Writer to support the deve...

    Date Posted: 06/30/2026 Recommended

  • Data Architect- Wealth Management

    Naperville , Illinois

    Job Title: Data Architect Wealth Management Duration : 6+ Months Contract Location : Naperville IL Work Mode : Hybrid Position Description Join a collaborative Data & Analytics team building a modern, cloud-native data platform on AWS. In this hands-on...

    Date Posted: 07/15/2026 Recommended

  • DCN Electrical Engineer

    Houston, Texas

    Job Title: DCN Electrical Engineer Location: Houston, Texas Type: Direct Hire Compensation: $100,000.00 - $150,000.00 Contractor Work Model: Hybrid – onsite and remote About the Company Our client is an innovative engineering and technology organizatio...

    Date Posted: 05/20/2026 Recommended

  • Principal Electrical Engineer

    Colonial Heights, VA

    Job Title: Principal Electrical Engineer Location: Colonial Heights, VA, United States Overview The Principal Electrical Engineer is responsible for troubleshooting and improving electrical and instrumentation systems using reliability-centered mainten...

    Date Posted: 04/29/2026 Recommended