Senior Big Data Engineer (Spark, AWS)

About the role

We are seeking a Senior Big Data Engineer to join INDI’s Development team. You will work on multinational projects, building and optimizing large‑scale data pipelines that power machine‑learning and analytics solutions for global customers.

Key responsibilities

• Design and implement batch and real‑time Spark jobs processing terabytes of data.
• Optimize Spark workloads on Hadoop clusters and collect performance heuristics.
• Perform DevOps tasks on AWS to ensure resiliency, high availability and disaster recovery.
• Collaborate with architects, data scientists, data engineers, analysts and product managers.
• Write clean, maintainable code and deployment artifacts in Java, Python or Chef.
• Mentor and coach junior engineers on best practices.

Required profile

• 6+ years of professional software development experience.
• 5+ years focused on Big Data technologies.
• Strong analytical and problem‑solving abilities.
• Advanced English communication skills.

Required skills

• Apache Spark
• Hadoop ecosystem
• AWS (EC2, S3, IAM, etc.)
• Java
• Python
• Chef
• DevOps practices
• Machine‑learning pipeline concepts

What we offer

• Flexible work arrangements (remote or hybrid).
• Tailored compensation package.
• Access to cutting‑edge technologies and tools.
• Generous leave and well‑being policies.
• Diverse and inclusive culture.
• Mentorship and continuous development opportunities.