Senior Big Data Software Engineer (AWS + Databricks)

Requirements

• Strong experience in Big Data, Data Engineering, or related fields, with 5+ years of professional experience
• Strong proficiency in Python and SQL, with Java experience considered a plus
• Strong hands-on experience with Apache Spark, distributed data processing, and Databricks
• Solid experience developing data solutions on AWS using services such as AWS Glue, Amazon Athena, and Amazon Aurora
• Practical experience working with relational databases such as PostgreSQL and MySQL
• Familiarity with workflow orchestration technologies such as Apache Airflow and streaming technologies such as Apache Kafka
• Solid experience with CI/CD, version control, and Infrastructure as Code using Terraform or similar technologies
• Familiarity with GenAI, MLOps, machine learning workflows, or AI platform integrations is considered a plus
• Upper-intermediate or higher English proficiency for collaboration across teams

Responsibilities

• Design, develop, and maintain scalable batch and distributed data processing pipelines to support reliable data processing and integration
• Build and optimize data processing solutions, taking ownership of performance, reliability, scalability, and cost efficiency across data pipelines
• Collaborate with engineering, AI, and product teams to understand requirements and support analytics, automation, and AI-enabled use cases
• Develop data solutions using Python, SQL, Apache Spark, Databricks, and AWS services such as AWS Glue, Amazon Athena, and Amazon Aurora
• Work with relational databases such as PostgreSQL and MySQL to support data processing and integration workflows
• Develop and maintain workflow orchestration using technologies such as Apache Airflow and contribute to reliable data processing workflows
• Contribute to CI/CD, Infrastructure as Code, testing, troubleshooting, and production support activities using Terraform or similar technologies
• Participate in architecture discussions and contribute to the continuous improvement of data platforms and engineering practices

Some of our benefits

• SoftServe University: Access continuous learning opportunities, certification support, and leadership development programs to grow your skills and advance your career
• Medical insurance: Health coverage for you and your family
• Food vouchers: Additional support for your everyday expenses
• Extra days off: Enjoy additional time off to rest, recharge, and maintain a healthy work-life balance
• Dare to Care: Our holistic well-being program, designed to support your overall wellness
• Anniversary Program: Celebrating your milestones and recognizing your journey with SoftServe

SoftServe is a global digital services and consulting company with over 30 years of experience and more than 11,000 professionals across 16 countries, helping businesses worldwide solve complex challenges through technology.

Our Data & Analytics Center of Excellence (CoE) brings together data specialists to drive excellence in data, analytics, and business intelligence. We deliver solutions across Data Strategy & Governance, Data Platform Engineering, Data Migration, and Reporting & BI.

In this role, you’ll design and develop scalable data processing solutions in AWS environments, working with large-scale, distributed data. You’ll take ownership of reliable data pipelines and contribute to data platform development, collaborating with engineering, AI, and product teams to support analytics, automation, and AI-enabled solutions.