Kafka/Spark Developer
Pittsburgh, Pennsylvania
Experience: 5
Category: Information Technology
Contractor Work Model: Hybrid
Brand: System One
Job ID: 381275
Date Posted: 09/30/2026
Shortcut: http://jobs.systemone.com/lm3gTz
Job Title: Kafka/Spark Developer
Location: Pittsburgh, Pennsylvania
Type: Permanent Full Time
Work Model: Hybrid – onsite and remote
Responsibilities
- Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.
- Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.
- Develop Spark applications using PySpark, Scala, or Java for data transformation, aggregation, cleansing, and analytical processing.
- Build and maintain Kafka producers, consumers, topics, and streaming workflows to enable reliable real-time data ingestion and event-driven architectures.
- Design and implement logical and physical data models to support data warehousing, reporting, analytics, and business intelligence requirements.
- Monitor, troubleshoot, and tune Kafka and Spark streaming jobs to improve performance, scalability, and operational reliability.
- Optimize Hadoop ecosystem components, Spark jobs, Kafka configurations, and Impala queries to improve system performance and resource utilization.
- Collaborate with architects, data engineers, DevOps teams, and business stakeholders to design and implement modern streaming and event-driven data platforms.
- Analyze user requirements, and define technical project scope and assumptions for assigned tasks.
- Create technical designs for new systems, and/or modifications to existing systems.
- Translate detailed requirements into functional system designs.
- Prioritize work, meet deadlines, and establish and maintain effective working relationships with clients, project team members, supervisors, and employees from other departments.
- Partner with business leaders, enterprise architects, and product owners to identify new graph-based use cases, evaluate emerging technologies, and align Neo4j initiatives with digital transformation goals.
Requirements
- At least 5+ years of experience in Big Data development, data engineering, or distributed data processing environments.
- Strong hands-on experience with Apache Kafka, topic configuration, producer/consumer development, Kafka Connect, and Schema Registry.
- Extensive experience developing real-time data processing applications using Apache Spark Streaming and/or Spark Structured Streaming.
- Proficiency in Java, Scala, or Python (PySpark) with strong object-oriented programming and software development skills.
- Proficiency in writing and optimizing complex SQL queries using Impala, Hive, or similar distributed query engines.
- Hands-on experience with Hadoop ecosystem components including HDFS, Hive.
- Experience integrating Kafka and Spark with relational databases, NoSQL databases, cloud storage platforms, and enterprise applications.
- Strong analytical, troubleshooting, and performance tuning skills in distributed streaming environments.
- Excellent communication, collaboration, and stakeholder management skills, with the ability to work effectively in Agile/Scrum teams.
- Experience working in Agile development environments with strong collaboration, technical leadership, problem-solving, and stakeholder communication skills.
#M-
#LI-
Ref: #404-IT Pittsburgh
-
Kafka/Spark Developer
Pittsburgh, Pennsylvania
Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite – onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintena...
Date Posted: 09/25/2026 Recommended
-
Kafka/Spark Developer
Pittsburgh, Pennsylvania
Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite – onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintena...
Date Posted: 09/24/2026 Recommended
-
Kafka/Spark Developer
Pittsburgh, Pennsylvania
Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite – onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintena...
Date Posted: 09/24/2026 Recommended
-
Machine Learning Operations Engineer
Dallas , Texas
Job Title: Machine Learning Operations Engineer Location: Dallas, Texas Type: Contract To Hire Visa : USC, GC, EAD (Only W2, No Sponsorship) Responsibilities Optimize and maintain large-scale feature engineering pipelines using PySpark, Pandas, and PyA...
Date Posted: 07/10/2026 Recommended
-
Senior Data Engineer (Databricks & Cloud Analytics)
Salt Lake City, Utah
Job Title: Senior Data Engineer (Databricks & Cloud Analytics) Location: Salt Lake City, Utah Work Model: Hybrid – onsite and remote Responsibilities • Design, develop, and support enterprise data platforms, cloud analytics solutions, or large-scale da...
Date Posted: 10/05/2026 Recommended
-
Senior Data Engineer (Databricks & Cloud Analytics)
Salt Lake City, Utah
Job Title: Senior Data Engineer (Databricks & Cloud Analytics) Location: Salt Lake City, Utah Work Model: Hybrid – onsite and remote Responsibilities • Design, develop, and support enterprise data platforms, cloud analytics solutions, or large-scale da...
Date Posted: 09/30/2026 Recommended
-
Lead Kafka Developer
Pittsburgh, PA
Job Title: Lead Kafka Developer – Software Engineer Lead Location: Pittsburgh, PA Type: Contract Compensation: Contractor Work Model: Onsite – onsite Hours: 40.0 Responsibilities Design and develop Kafka-based streaming architectures and data pipelines...
Date Posted: 08/12/2026 Recommended
-
Data Engineer - Databricks
Pittsburgh, Pennsylvania
Data Engineer – Azure Databricks Contract-to-Hire Pittsburgh, PA – Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for buil...
Date Posted: 07/26/2026 Recommended
-
Senior AWS Java/Python Developer with Microservices & API experience
Knoxville, Tennessee
Job Title: Senior AWS Java/Python Developer with Microservices & API experience Location: Knoxville, TN Type: Direct Hire Compensation: $98,000.00 Work Model: Onsite – onsite Hours: 40.0 Security Clearance: (not specified) Overview Leave placeholder te...
Date Posted: 09/09/2026 Recommended
-
Senior Solution Architect
Salt Lake City, Utah
Job Title: Senior Solution Architect Client Location: Salt Lake City, Utah Type: Contract To Hire Work Model: Onsite Experience * 8+ years of progressive experience in software engineering, solution architecture, or enterprise application development *...
Date Posted: 08/06/2026 Recommended
-
Senior Solution Architect
Salt Lake City, Utah
Job Title: Senior Solution Architect Client Location: Salt Lake City, Utah Type: Contract To Hire Work Model: Onsite Experience * 8+ years of progressive experience in software engineering, solution architecture, or enterprise application development *...
Date Posted: 08/06/2026 Recommended
-
Full Stack Developer
Pittsburgh , Pennsylvania
Job Title: Full Stack Developer Location: Dallas or Plano, Texas. No.Openings: 3 Description: Full Stack Developer Position Description We're growing rapidly and are looking for Full Stack Developers to join our Telecommunications Sector. We're a close...
Date Posted: 08/04/2026 Recommended
-
Senior GenAI & data Engineer
Birmingham, Alabama
Job Title: Senior GenAI & Data Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: Hybrid Systemone is seeking a Senior Gen AI Software Engineer with strong hands-on exper...
Date Posted: 10/01/2026 Recommended
-
Software Engineer Sr
Farmers Branch, TX
Title - Software Engineer Sr Location- Pittsburgh, PA/Cleveland, OH/Dallas, TX Must Have Experience with containerization and deployment (Docker, Kubernetes/OpenShift) Experience working with distributed systems, including resiliency, scaling, and faul...
Date Posted: 08/28/2026 Recommended
-
Senior AWS Data Engineer
Pittsburgh , Pennsylvania
Senior AWS Data Engineer Full-time Hybrid – Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Position Overview Seeking a Senior AWS Data Engineer to develop, enhance, and maintain enterprise risk analytics applications in a financial servi...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Lafayette, Louisiana
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Knoxville, Tennessee
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Columbia, South Carolina
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
Senior API Platform Software Engineer
Birmingham, Alabama
Job Title - Senior API Platform Software Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Work Arrangement: Hybrid Employment Type: Full time Experience Required: 5+ years Position Overview We are seeking a Senior API P...
Date Posted: 08/28/2026 Recommended
-
AI/ML Data Scientist
McLean, VA
Job Title: AI/ML Data Scientist Location: 100% REMOTE Clearance: Ability to obtain and maintain a Public Trust clearance. Type: Contract-to-hire Contact: Crystal.dinnocenti@systemone.com WHAT YOU WILL DO: Partner with stakeholders to define and deliver...
Date Posted: 09/28/2026 Recommended
-
AWS Data Engineer
Lafayette, Louisiana
Job Title: AWS Data Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: 5 Days Onsite Systemone is seeking a Senior AWS Data Engineer to support the development, enhanceme...
Date Posted: 10/02/2026 Recommended
-
AWS Data Engineer
Birmingham, Alabama
Job Title: AWS Data Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: 5 Days Onsite Systemone is seeking a Senior AWS Data Engineer to support the development, enhanceme...
Date Posted: 10/01/2026 Recommended
-
AWS Data Engineer
Knoxville, Tennessee
Job Title: AWS Data Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: 5 Days Onsite Systemone is seeking a Senior AWS Data Engineer to support the development, enhanceme...
Date Posted: 10/02/2026 Recommended
-
AWS Data Engineer
McLean, VA
Job Title: AWS Data Engineer Location: McLean, VA Type: Contract-to-Hire Compensation: $150,000.00 - $170,000.00 Work Model: Remote – offsite Security Clearance: US Citizen with the ability to obtain a public trust System One is looking for a strong AW...
Date Posted: 09/01/2026 Recommended
-
AWS Python- GenAI Developer
Birmingham , Alabama
Job Title: AWS Python- GenAI Developer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: 5 Days Onsite Systemone is seeking a AWS Python- GenAI Developer to develop and support c...
Date Posted: 10/02/2026 Recommended
-
AWS Lakehouse Data Engineer
McLean, VA
Job Title: AWS Lakehouse Data Engineer Work Model: Remote – offsite Responsibilities Build and operate data pipelines (batch and streaming) from APIs, relational databases, file drops, event streams, and external partners. Design, implement, test, and ...
Date Posted: 09/29/2026 Recommended
-
Senior GenAI & Data Engineer
Reston, Virginia
Job Title: Senior GenAI & Data Engineer Location: Reston, Virginia Type: Direct Hire Work Model: Hybrid – onsite and remote Overview System One is seeking a Senior GenAI & Data Engineer to develop and integrate AI-enabled solutions within a large-scale...
Date Posted: 09/19/2026 Recommended
-
Senior GenAI & Data Engineer
Reston, Virginia
Job Title: Senior GenAI & Data Engineer Location: Reston, Virginia Type: Direct Hire Work Model: Hybrid – onsite and remote Overview System One is seeking a Senior GenAI & Data Engineer to develop and integrate AI-enabled solutions within a large-scale...
Date Posted: 09/25/2026 Recommended
-
Data Architect- Wealth Management
Naperville, Illinois
Job Title: Data Architect- Wealth Management Location: Naperville, IL Type: Direct Hire Compensation: Open Work Model: Onsite Hours: 40.0 Security Clearance: N/A Responsibilities Design and maintain the end to end data architecture for the Wealth Manag...
Date Posted: 07/15/2026 Recommended
-
AWS Data Engineer
Knoxville , Tennessee
Job Title: AWS Data Engineer Location: Knoxville, TN, Columbia SC or Lafayette, LA or Birmingham, AL Type: Direct Hire Responsibilities • Support the development, enhancement, and maintenance of Enterprise Risk Analytics applications within a financial...
Date Posted: 09/23/2026 Recommended
⚠️ Protecting Job Seekers from Identity Scams
At System One, your privacy and security are important to us. As job-related scams continue to target job seekers, we want to help you recognize and avoid common recruitment fraud. Identity theft scams often involve individuals, also known as "scammers," posing as recruiters or employers to obtain sensitive personal information, such as Social Security numbers, bank account details, or copies of driver’s licenses, with the goal of stealing identities, accessing financial accounts, or creating fraudulent accounts in a victim’s name.