Job Description

Senior Data Engineer – Large Distributed Systems & Data Platform Engineering

Exclusive Senior Data Engineering Opportunity with a Pre-IPO SaaS Cloud Security Company Offering Long-Term Growth Potential

Are you passionate about building large-scale distributed data platforms ? Do you thrive in an environment where applications run on Kubernetes, processing data in parallel across a highly available infrastructure? If so, we want to talk to you!

As a Senior Data Engineer , you will be a key player in designing, optimizing, and scaling our Application Data Platform (ADP)—a foundational system that powers both analytical and operational workloads . You’ll work with event-driven architectures, log-based processing, and time-series data , enabling our threat detection and security intelligence products.

Tech Stack:

• Languages : Python, Rust
• Infrastructure : Kubernetes, Docker, AWS
• Data Processing & Storage : Iceberg, Delta Lake, S3, Trino
• Orchestration & CI/CD : Git, Terraform, Jenkins
• Environment : Linux/Unix

Job Responsibilities:

• Architect, build, and optimize large-scale distributed data systems that process high-velocity event, log, and time-series data .
• Design and deploy production-grade data pipelines with parallel processing architectures .
• Develop and maintain scalable data platforms running on Kubernetes and AWS .
• Write and deliver production-grade code daily, ensuring high performance and reliability.
• Work upstream to ensure data is clean, structured, and ready for downstream analytics and operational use cases.
• Collaborate cross-functionally with engineering teams, product managers, and stakeholders to refine platform capabilities.
• Mentor and lead junior engineers , breaking down complex problems into executable tasks.
• Drive adoption of best practices in data engineering, scalability, and infrastructure automation.
• Participate in an on-call rotation for production deployments and system monitoring.

Your Profile:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent work experience.
• 2+ years of experience as a Senior Data Engineer owning large-scale data platforms.
• Strong software development background —you’ve built, shipped, monitored, and scaled distributed applications.
• Experience with real-time or near real-time data processing , including log/event-driven architectures.
• Proficiency in Python or Rust for data-intensive applications.
• Deep understanding of data modeling, partitioning, and storage optimizations for large-scale data platforms.
• Hands-on experience with Iceberg and/or Delta Lake.
• Experience with Kubernetes and cloud infrastructure (AWS preferred).
• Strong Unix/Linux proficiency and familiarity with version control (Git preferred).
• Expertise in debugging distributed systems and optimizing performance at scale.

Nice to Have:

• Knowledge of observability tools (Grafana, Prometheus, OpenTelemetry).
• Experience with high-scale messaging systems (Kafka, Pulsar, NATS).
• Technical leadership experience in data pipeline architecture.
• Experience mentoring engineers and leading large-scale projects.

Why Join?

This is your chance to own and shape the next-generation security data platform at a high-growth, Pre-IPO SaaS company. You’ll work on mission-critical systems, process massive-scale cybersecurity data , and contribute to making the Internet a safer place .

Are you ready to lead, innovate, and build at scale? Apply now and be part of something big.

Job Tags

Similar Jobs