Kafka/Spark Developer
Pittsburgh, Pennsylvania
Experience: 5
Category: Information Technology
Contractor Work Model: Hybrid
Brand: System One
Job ID: 381275
Date Posted: 09/30/2026
Shortcut: http://jobs.systemone.com/WndwJd
Job Title: Kafka/Spark Developer
Location: Pittsburgh, Pennsylvania
Type: Permanent Full Time
Work Model: Hybrid – onsite and remote
Responsibilities
- Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.
- Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.
- Develop Spark applications using PySpark, Scala, or Java for data transformation, aggregation, cleansing, and analytical processing.
- Build and maintain Kafka producers, consumers, topics, and streaming workflows to enable reliable real-time data ingestion and event-driven architectures.
- Design and implement logical and physical data models to support data warehousing, reporting, analytics, and business intelligence requirements.
- Monitor, troubleshoot, and tune Kafka and Spark streaming jobs to improve performance, scalability, and operational reliability.
- Optimize Hadoop ecosystem components, Spark jobs, Kafka configurations, and Impala queries to improve system performance and resource utilization.
- Collaborate with architects, data engineers, DevOps teams, and business stakeholders to design and implement modern streaming and event-driven data platforms.
- Analyze user requirements, and define technical project scope and assumptions for assigned tasks.
- Create technical designs for new systems, and/or modifications to existing systems.
- Translate detailed requirements into functional system designs.
- Prioritize work, meet deadlines, and establish and maintain effective working relationships with clients, project team members, supervisors, and employees from other departments.
- Partner with business leaders, enterprise architects, and product owners to identify new graph-based use cases, evaluate emerging technologies, and align Neo4j initiatives with digital transformation goals.
Requirements
- At least 5+ years of experience in Big Data development, data engineering, or distributed data processing environments.
- Strong hands-on experience with Apache Kafka, topic configuration, producer/consumer development, Kafka Connect, and Schema Registry.
- Extensive experience developing real-time data processing applications using Apache Spark Streaming and/or Spark Structured Streaming.
- Proficiency in Java, Scala, or Python (PySpark) with strong object-oriented programming and software development skills.
- Proficiency in writing and optimizing complex SQL queries using Impala, Hive, or similar distributed query engines.
- Hands-on experience with Hadoop ecosystem components including HDFS, Hive.
- Experience integrating Kafka and Spark with relational databases, NoSQL databases, cloud storage platforms, and enterprise applications.
- Strong analytical, troubleshooting, and performance tuning skills in distributed streaming environments.
- Excellent communication, collaboration, and stakeholder management skills, with the ability to work effectively in Agile/Scrum teams.
- Experience working in Agile development environments with strong collaboration, technical leadership, problem-solving, and stakeholder communication skills.
#M-
#LI-
Ref: #404-IT Pittsburgh
-
Kafka/Spark Developer
Pittsburgh, Pennsylvania
Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite – onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintena...
Date Posted: 09/25/2026 Recommended
-
Kafka/Spark Developer
Pittsburgh, Pennsylvania
Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite – onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintena...
Date Posted: 09/24/2026 Recommended
-
Kafka/Spark Developer
Pittsburgh, Pennsylvania
Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite – onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintena...
Date Posted: 09/24/2026 Recommended
-
Machine Learning Operations Engineer
Dallas , Texas
Job Title: Machine Learning Operations Engineer Location: Dallas, Texas Type: Contract To Hire Visa : USC, GC, EAD (Only W2, No Sponsorship) Responsibilities Optimize and maintain large-scale feature engineering pipelines using PySpark, Pandas, and PyA...
Date Posted: 07/10/2026 Recommended
-
Senior Data Engineer (Databricks & Cloud Analytics)
Salt Lake City, Utah
Job Title: Senior Data Engineer (Databricks & Cloud Analytics) Location: Salt Lake City, Utah Work Model: Hybrid – onsite and remote Responsibilities • Design, develop, and support enterprise data platforms, cloud analytics solutions, or large-scale da...
Date Posted: 09/30/2026 Recommended
-
Senior Data Engineer (Databricks & Cloud Analytics)
Salt Lake City, Utah
Job Title: Senior Data Engineer (Databricks & Cloud Analytics) Location: Salt Lake City, Utah Work Model: Hybrid – onsite and remote Responsibilities • Design, develop, and support enterprise data platforms, cloud analytics solutions, or large-scale da...
Date Posted: 10/01/2026 Recommended
-
Lead Kafka Developer
Pittsburgh, PA
Job Title: Lead Kafka Developer – Software Engineer Lead Location: Pittsburgh, PA Type: Contract Compensation: Contractor Work Model: Onsite – onsite Hours: 40.0 Responsibilities Design and develop Kafka-based streaming architectures and data pipelines...
Date Posted: 08/12/2026 Recommended
-
Data Engineer - Databricks
Pittsburgh, Pennsylvania
Data Engineer – Azure Databricks Contract-to-Hire Pittsburgh, PA – Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for buil...
Date Posted: 07/26/2026 Recommended
-
Senior AWS Java/Python Developer with Microservices & API experience
Knoxville, Tennessee
Job Title: Senior AWS Java/Python Developer with Microservices & API experience Location: Knoxville, TN Type: Direct Hire Compensation: $98,000.00 Work Model: Onsite – onsite Hours: 40.0 Security Clearance: (not specified) Overview Leave placeholder te...
Date Posted: 09/09/2026 Recommended
-
Senior Solution Architect
Salt Lake City, Utah
Job Title: Senior Solution Architect Client Location: Salt Lake City, Utah Type: Contract To Hire Work Model: Onsite Experience * 8+ years of progressive experience in software engineering, solution architecture, or enterprise application development *...
Date Posted: 08/06/2026 Recommended
-
Senior Solution Architect
Salt Lake City, Utah
Job Title: Senior Solution Architect Client Location: Salt Lake City, Utah Type: Contract To Hire Work Model: Onsite Experience * 8+ years of progressive experience in software engineering, solution architecture, or enterprise application development *...
Date Posted: 08/06/2026 Recommended
-
Full Stack Developer
Pittsburgh , Pennsylvania
Job Title: Full Stack Developer Location: Dallas or Plano, Texas. No.Openings: 3 Description: Full Stack Developer Position Description We're growing rapidly and are looking for Full Stack Developers to join our Telecommunications Sector. We're a close...
Date Posted: 08/04/2026 Recommended
-
Senior GenAI & data Engineer
Birmingham, Alabama
Job Title: Senior GenAI & Data Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: Hybrid Systemone is seeking a Senior Gen AI Software Engineer with strong hands-on exper...
Date Posted: 10/01/2026 Recommended
-
Software Engineer Sr
Farmers Branch, TX
Title - Software Engineer Sr Location- Pittsburgh, PA/Cleveland, OH/Dallas, TX Must Have Experience with containerization and deployment (Docker, Kubernetes/OpenShift) Experience working with distributed systems, including resiliency, scaling, and faul...
Date Posted: 08/28/2026 Recommended
-
Senior AWS Data Engineer
Pittsburgh , Pennsylvania
Senior AWS Data Engineer Full-time Hybrid – Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Position Overview Seeking a Senior AWS Data Engineer to develop, enhance, and maintain enterprise risk analytics applications in a financial servi...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Columbia, South Carolina
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Knoxville, Tennessee
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Birmingham, Alabama
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Lafayette, Louisiana
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
AI/ML Data Scientist
McLean, VA
Job Title: AI/ML Data Scientist Location: 100% REMOTE Clearance: Ability to obtain and maintain a Public Trust clearance. Type: Contract-to-hire Contact: Crystal.dinnocenti@systemone.com WHAT YOU WILL DO: Partner with stakeholders to define and deliver...
Date Posted: 09/28/2026 Recommended
-
AWS Data Engineer
Birmingham, Alabama
Job Title: AWS Data Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: 5 Days Onsite Systemone is seeking a Senior AWS Data Engineer to support the development, enhanceme...
Date Posted: 10/01/2026 Recommended
-
AWS Data Engineer
McLean, VA
Job Title: AWS Data Engineer Location: McLean, VA Type: Contract-to-Hire Compensation: $150,000.00 - $170,000.00 Work Model: Remote – offsite Security Clearance: US Citizen with the ability to obtain a public trust System One is looking for a strong AW...
Date Posted: 09/01/2026 Recommended
-
AWS Lakehouse Data Engineer
McLean, VA
Job Title: AWS Lakehouse Data Engineer Work Model: Remote – offsite Responsibilities Build and operate data pipelines (batch and streaming) from APIs, relational databases, file drops, event streams, and external partners. Design, implement, test, and ...
Date Posted: 09/29/2026 Recommended
-
Senior GenAI & Data Engineer
Reston, Virginia
Job Title: Senior GenAI & Data Engineer Location: Reston, Virginia Type: Direct Hire Work Model: Hybrid – onsite and remote Overview System One is seeking a Senior GenAI & Data Engineer to develop and integrate AI-enabled solutions within a large-scale...
Date Posted: 09/19/2026 Recommended
-
Senior GenAI & Data Engineer
Reston, Virginia
Job Title: Senior GenAI & Data Engineer Location: Reston, Virginia Type: Direct Hire Work Model: Hybrid – onsite and remote Overview System One is seeking a Senior GenAI & Data Engineer to develop and integrate AI-enabled solutions within a large-scale...
Date Posted: 09/25/2026 Recommended
-
Data Architect- Wealth Management
Naperville, Illinois
Job Title: Data Architect- Wealth Management Location: Naperville, IL Type: Direct Hire Compensation: Open Work Model: Onsite Hours: 40.0 Security Clearance: N/A Responsibilities Design and maintain the end to end data architecture for the Wealth Manag...
Date Posted: 07/15/2026 Recommended
-
AWS Data Engineer
Knoxville , Tennessee
Job Title: AWS Data Engineer Location: Knoxville, TN, Columbia SC or Lafayette, LA or Birmingham, AL Type: Direct Hire Responsibilities • Support the development, enhancement, and maintenance of Enterprise Risk Analytics applications within a financial...
Date Posted: 09/23/2026 Recommended
-
Kafka - Confluence Engineer - remote but ONSITE interview required
Vienna, VA
Job Title: Kafka - Confluence Engineer Location: 100% remote - BUT MUST BE AVAILABE FOR ONSITE INTERVIEW, AT YOUR OWN EXPENSE IN VIENNA, VA OR PENSACOLA, FL OR SAN DIEGO, CA Type: Contract, long term expected Compensation: $60 - $75/HR Work Model: Remo...
Date Posted: 09/28/2026 Recommended
-
Software Developer
McLean, VA
Software Developer Practice: Software Development & Support / Digital Company: Guidehouse Location: Remote Security and Work Authorization Requirements • Must be able to obtain and maintain a Federal or Department of Defense Public Trust. • Candidates ...
Date Posted: 08/25/2026 Recommended
-
Mainframe Developer (COBOL, CICS, DB2)
Salt Lake City, UT
Mainframe Developer – COBOL, CICS, DB2 6 Months Contract-to-Hire Midvale, UT and Salt Lake City, Utah Position Overview Seeking an experienced Mainframe Developer to develop, maintain, enhance, and support mission-critical enterprise applications. The ...
Date Posted: 07/30/2026 Recommended