Data Engineer with DevOps
Dallas , Texas
Experience: 0
Category: Information Technology
Contractor Work Model: Onsite
Brand: System One
Compensation Range: 120000.00 Per Hour
Job ID: 376113
Date Posted: 06/29/2026
Shortcut: http://jobs.systemone.com/z7MkKH
Job Title: Senior Data Engineer with DevOps
Duration : Full Time
Location : Pittsburgh, PA, Cleveland, OH, or Dallas, TX
Work Mode : 5 Days Onsite
Years Of Exp : 8+ Yrs
Job Description:
We are seeking a Data Engineer with 5 years of experience to design and maintain scalable data pipeline supporting analytics, reporting, and operational needs. The role involves collaborating with cross functional teams to ensure data alignment with business requirements and enterprise standards.
Duties and Responsibilities:
- Design and build scalable data pipelines aligned with business needs
- Process large dataset (batch + sometimes near Realtime)
- Ensure data quality, consistency, and governance standards across systems
- Support data integration and transformation efforts for analytics and reporting platforms
- Maintain data dictionaries, metadata, and documentation
- Participate in data architecture reviews and model validation processes
- Support analytics reporting and risk platforms.
Required Qualifications
- 5+ years of experience in data engineering and big data processing
- Strong expertise in Apache Spark (Spark Core, Spark SQL) and PySpark for large scale batch processing
- Experience working with structured and semi structured data, including complex transformations and performance tuning
- Proficiency in data ingestion and integration from sources like Oracle, SQL Server, Hive, HDFS, and S3; transform data into ‘curated data models'
- Experience writing data to Hive tables, Data Lakes (Iceberg), and downstream reporting systems
- Strong knowledge of SQL and data modeling concepts
- Hands on experience with Apache Airflow for workflow orchestration (DAG design, scheduling expectations, monitoring)
- Proficiency in shell scripting for job automation, file validation, dependency handling, and logging. Trigger Spark Jobs, perform file checks and validation; Archive & purge data; mange job dependency, logging & error handling
- Strong understanding of batch processing and batch job scheduling frameworks
- Experience migrating from CA7/Control M Airflow (daily, hourly, weekly schedules) CI/CD for data pipelines
- Fundamentals in Linux and Networking
- Docker, OCP containerization / Kubernetes
- Knowledge of CI/CD pipeline tools: Tools commonly include Jenkins, GitHub Actions, Azure DevOps, GitLab Cl, Maven, and Gradle
- Automate operational tasks using Python, Bash/Shell, and PowerShell
- Implement monitoring and alerting, Application Insights. Enable centralized logging with tools such as ELK.
- Experience ensuring data quality, reliability, and compliance in regulated environments
- Good communication and documentation skillsGood communication and collaboration skills in cross-functional teams
- Agile/Safe methodologies
- Airflow
- Containerization
- DevOps
- Elastic Stack & Elasticsearch
- GitHub
- Hadoop Hive
- Jenkins
- JSON Web Token (JWT)
- Kubernetes
- OpenShift
- Oracle
- Python
- Shell Script
- SQLite
Ref: #404-IT Pittsburgh
-
GenAI Data Automation Engineer
Washington, DC
Job Title: GenAI Data Automation Engineer Location: Washington, DC (Remote) Type: Contract To Hire Compensation: $48.95 /hr Security Clearance: Public Trust Responsibilities Design and maintain data pipelines in AWS using S3, RDS/SQL Server, Glue, Lamb...
Date Posted: 06/11/2026 Recommended
-
AWS Cloud Data Engineer
McLean, VA
Job Title: AWS Cloud Data Engineer Location: McLean, VA Type: Long-term contract Work Model: Remote Hours: 40.0 Security Clearance: Ability to obtain a Federal Public Trust clearance Contact: Crystal.dinnocenti@systemone.com RESPONSIBILITIES Design, bu...
Date Posted: 06/22/2026 Recommended
-
Palantir Foundry Data Engineer & Architect
NA, VA
Job Title: Senior Palantir Foundry Data Engineer & Architect Locations: Arlington, VA | McLean, VA | New York, NY | Chicago, IL | San Antonio, TX | Atlanta, GA | Type: Remote – Must be willing to travel up to 25% Time Type: Full-time Clearance: Ability...
Date Posted: 04/22/2026 Recommended
-
Senior IT Data Engineer
Washington, District of Columbia
Senior IT Data Engineer Washington, DC – onsite US citizenship required per government contact Must be able to obtain Public Trust clearance Type: Multi-year Contract Open to W2 and C2C Must apply by June, 6th The Data Architecture, Technology, and Ana...
Date Posted: 05/29/2026 Recommended
-
Senior IT Data Engineer (onsite)
Washington , DC
Senior IT Data Engineer Washington, DC – onsite US citizenship required per government contact Must be able to obtain Public Trust clearance Type: Multi-Year Contract supporting Federal Reserve Board Open to W2 and C2C Must apply by 12pm on July 2nd Th...
Date Posted: 06/30/2026 Recommended
-
Senior AI Software Engineer
Plano, Texas
AI Software Engineer Location: Plano, TX (Hybrid – onsite required) Duration: 6+ Months Contract to Hire Start Date: ASAP Position Overview We are seeking an experienced AI Software Engineer to join a growing engineering team focused on building scalab...
Date Posted: 05/08/2026 Recommended
-
Payment Engineer
Tulsa, Oklahoma
Job Title: Application Developer Location: Tulsa, Oklahoma Work Model: Onsite Responsibilities Provide application support and maintenance for mobile payment platforms, ensuring system uptime and performance. Troubleshoot and resolve production inciden...
Date Posted: 06/11/2026 Recommended
-
Principal DevOps Engineer
Pittsburgh, PA
Principal DevOps Engineer Pittsburgh, PA (Onsite – 5 Days/Week), Strongsville/Cleveland, OH, Birmingham, AL, Pittsburgh, PA, Dallas/Farmers Branch, TX, Phoenix, AZ Contract Industry Banking / Financial Services Preferred Job Summary Seeking a highly ex...
Date Posted: 06/12/2026 Recommended
-
Software Engineer - Python
Pittsburgh , Pennsylvania
Job Title: Software Engineer (Python) Duration : Contract to Hire Location : Pittsburgh, Dallas, or Cleveland (Locals Only) Work Mode : 5 Days Onsite Years Of Exp : 6+ Yrs Seeking a Software Engineer with 3–5 years of hands-on experience building, depl...
Date Posted: 06/29/2026 Recommended
-
Software Engineer Lead - Axiom
Pittsburgh, PA
Position Title: Software Engineer Lead - Axiom Location: Pittsburgh, PA/ Strongsville, OH Roles/Responsibilities: • Proficiency in Business Intelligence Tools: Hands-on experience with Tableau Desktop, Tableau Prep, and other BI platforms such as Micro...
Date Posted: 06/15/2026 Recommended
-
AI/ Data Scientist
NA, VA
Job Title: AI/ Data Scientist Location: Remote Security Clearance: due to government requirement: U.S. Citizenship required and ability to obtain and maintain a Public Trust clearance If interested reach out directly to kimberly.spicer@systemone.com Re...
Date Posted: 04/17/2026 Recommended
-
Data Scientist
McLean, VA
Job Title: Data Scientist Location: McLean, VA Type: Contract To Hire Compensation: Not specified Work Model: Remote Hours: 40.0 Clearance: Must be eligible to obtain a US Public Trust Contact: Crystal.dinnocenti@systemone.com RESPONSIBILITIES Partner ...
Date Posted: 07/01/2026 Recommended
-
Data Engineer Sr - Contractor
Farmers Branch, TX
Data Engineer Sr. Provide locations: Dallas, TX Length of Assignment: 1 year ROLE/RESPONSIBILITIES: Coordinate the collection, normalization and analysis of datasets across multiple data platforms. • Assist in designing and building data service infras...
Date Posted: 04/14/2026 Recommended
-
Cloud Engineer
Indianapolis, IN
Cloud Engineer Location: Indianapolis, IN Hybrid Onsite 3 days, fully remote if not local Employment Type: Contract, 6 months to start ( NO C2C W2 Only) Schedule: 40 hours/week Duration: Through January 22, 2027 Pay: $92.00 - $105.00/HR Position Summar...
Date Posted: 06/25/2026 Recommended
-
Senior Platform Engineer
Washington, DC
Senior Platform Engineer Washington, DC – onsite US citizenship required per government contact Must be able to obtain Public Trust clearance Type: Multi-Year Contract supporting Federal Reserve Board Open to W2 and C2C Deadline to apply: June 29th Joi...
Date Posted: 06/15/2026 Recommended
-
Lead DevSecOps Engineer
Pittsburgh, Pennsylvania
Job Title: Lead DevSecOps Engineer Location: Pittsburgh, PA Responsibilities Lead the integration of security into CI/CD pipelines, architect secure cloud environments, and guide teams in adopting modern DevSecOps practices to ensure a secure-by-design...
Date Posted: 06/29/2026 Recommended
-
Lead DevSecOps Engineer
Strongsville, Ohio
Job Title: Lead DevSecOps Engineer Location: Strongsville, OH Type: Fulltime Responsibilities Lead the integration of security into CI/CD pipelines, architect secure cloud environments, and guide teams in adopting modern DevSecOps practices to ensure a...
Date Posted: 06/29/2026 Recommended
-
Lead DevSecOps Engineer
Dallas , Texas
Job Title: Lead DevSecOps Engineer Location: Dallas, Texas Responsibilities Lead the integration of security into CI/CD pipelines, architect secure cloud environments, and guide teams in adopting modern DevSecOps practices to ensure a secure-by-design ...
Date Posted: 06/29/2026 Recommended
-
AWS Cloud Infrastructure Engineer
McLean, VA
Cloud Infrastructure & Automation Engineer — AWS / Terraform Remote Public Trust eligibility required Candidates must be able to work without sponsorship ALTA IT Services is seeking a Cloud Infrastructure & Automation Engineer to support a federal heal...
Date Posted: 06/26/2026 Recommended
-
Data Engineer - Contractor
Miamisburg, OH
Data Engineer Contractor 5 Days Onsite – Pittsburgh, PA / Farmers Branch, TX / Miamisburg, OH / Houston, TX Key Responsibilities Gather business and technical requirements from multiple lines of business and source systems Design, develop, and support ...
Date Posted: 05/15/2026 Recommended
-
Senior Infrastructure Engineer
Pittsburgh , Pennsylvania
Senior Infrastructure Engineer Job Type: Permanent Full Time Cleveland, OH, Pittsburgh, PA, or Dallas, TX and is 5 days onsite. Description: Senior Infrastructure Engineer Position Description We are seeking a highly motivated Sr. Infrastructure Engine...
Date Posted: 06/29/2026 Recommended
-
Sr. Site Reliability Engineer
Cincinnati, OH
Job Title: Senior Site Reliability Engineer (SRE) Location: Cincinnati, OH (Hybrid – 3 days onsite/week) Type: Direct Hire Compensation: $150,000 Range (based on experience) We’re seeking an experienced Senior Site Reliability Engineer to join a small,...
Date Posted: 06/22/2026 Recommended
-
Cloud Engineer
Reston, VA
Cloud Engineer 100% remote US Citizenship is required per government contract $50/hr W2 The Cloud Engineer is responsible for designing, implementing, and maintaining cloud-based infrastructure and services to support enterprise applications and operat...
Date Posted: 06/29/2026 Recommended
-
Graffana ELK Software Development Lead
Pittsburgh , Pennsylvania
Job Title: Graffana ELK Software Development Lead Duration : Full Time Location : Pittsburgh, PA Work Mode : 5 Days Onsite Years Of Exp : 8+ Yrs Job Description: Looking for Graffana ELK Software Development Lead to join our Applications Development an...
Date Posted: 06/29/2026 Recommended
-
Sr Software Engineer
Strongsville, OH
Tittle: Sr. Software Engineer Location: Strongsville, OH or Pittsburgh, PA Work Mode : Hybrid (3days Office / 2days Remote) Duration: Contract to Hire Years Of Exp Required: 10+ Years Function of the Group: Payment Center team creates "one stop shop" f...
Date Posted: 05/19/2026 Recommended
-
Sr. Process Engineer
Morgantown, West Virginia
Job Title: Sr. Process Engineer Location: Morgantown, WV Type: Direct Hire Compensation: Work Model: Onsite – onsite Responsibilities Lead, design, install, commission, maintain, and improve low-acid aseptic process and equipment. Implement and maintai...
Date Posted: 07/02/2026 Recommended
-
WAMS Technical Resource
Seattle, WA
Job Title: WAMS Technical Resource Location: Seattle, WA – Remote Role Type: 6 + months contract – good chance of extensions Seeking a WAMS Technical Resource who is motivated by variety, is seeking a challenging environment for professional growth, an...
Date Posted: 06/23/2026 Recommended
-
Software Engineer Lead
Pittsburgh, PA
Tittle: Software Engineer Lead (69652) Location : Pittsburgh, PA or Strongsville, OH Mode : Onsite Duration : Contract to Hire Years Of Exp Required : 12+ Years Function of the Group: Liquidity Risk Management Industry background: Banking-Regulatory Su...
Date Posted: 04/21/2026 Recommended
-
Sr. Test Automation Engineer
Midvale , Utah
Job Title: Senior Test Automation Engineer Duration : Contract to Hire Location : Salt Lake City/Midvale, UT Work Mode : 5 Days Onsite Years Of Exp : 7+ Yrs Job Description: We are seeking a Senior Test Automation Engineer to join our team! You will be...
Date Posted: 06/22/2026 Recommended
-
Sr. Test Automation Engineer
Midvale , Utah
Job Title: Senior Test Automation Engineer Duration : Contract to Hire Location : Salt Lake City/Midvale, UT Work Mode : 5 Days Onsite Years Of Exp : 7+ Yrs Job Description: We are seeking a Senior Test Automation Engineer to join our team! You will be...
Date Posted: 06/22/2026 Recommended