Job Description
Senior Data Engineer – Large Distributed Systems & Data Platform Engineering
Exclusive Senior Data Engineering Opportunity with a Pre-IPO SaaS Cloud Security Company Offering Long-Term Growth Potential
Are you passionate about building large-scale distributed data platforms ? Do you thrive in an environment where applications run on Kubernetes, processing data in parallel across a highly available infrastructure? If so, we want to talk to you!
As a Senior Data Engineer , you will be a key player in designing, optimizing, and scaling our Application Data Platform (ADP)—a foundational system that powers both analytical and operational workloads . You’ll work with event-driven architectures, log-based processing, and time-series data , enabling our threat detection and security intelligence products.
Tech Stack:
- Languages : Python, Rust
- Infrastructure : Kubernetes, Docker, AWS
- Data Processing & Storage : Iceberg, Delta Lake, S3, Trino
- Orchestration & CI/CD : Git, Terraform, Jenkins
- Environment : Linux/Unix
Job Responsibilities:
- Architect, build, and optimize large-scale distributed data systems that process high-velocity event, log, and time-series data .
- Design and deploy production-grade data pipelines with parallel processing architectures .
- Develop and maintain scalable data platforms running on Kubernetes and AWS .
- Write and deliver production-grade code daily, ensuring high performance and reliability.
- Work upstream to ensure data is clean, structured, and ready for downstream analytics and operational use cases.
- Collaborate cross-functionally with engineering teams, product managers, and stakeholders to refine platform capabilities.
- Mentor and lead junior engineers , breaking down complex problems into executable tasks.
- Drive adoption of best practices in data engineering, scalability, and infrastructure automation.
- Participate in an on-call rotation for production deployments and system monitoring.
Your Profile:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent work experience.
- 2+ years of experience as a Senior Data Engineer owning large-scale data platforms.
- Strong software development background —you’ve built, shipped, monitored, and scaled distributed applications.
- Experience with real-time or near real-time data processing , including log/event-driven architectures.
- Proficiency in Python or Rust for data-intensive applications.
- Deep understanding of data modeling, partitioning, and storage optimizations for large-scale data platforms.
- Hands-on experience with Iceberg and/or Delta Lake.
- Experience with Kubernetes and cloud infrastructure (AWS preferred).
- Strong Unix/Linux proficiency and familiarity with version control (Git preferred).
- Expertise in debugging distributed systems and optimizing performance at scale.
Nice to Have:
- Knowledge of observability tools (Grafana, Prometheus, OpenTelemetry).
- Experience with high-scale messaging systems (Kafka, Pulsar, NATS).
- Technical leadership experience in data pipeline architecture.
- Experience mentoring engineers and leading large-scale projects.
Why Join?
This is your chance to own and shape the next-generation security data platform at a high-growth, Pre-IPO SaaS company. You’ll work on mission-critical systems, process massive-scale cybersecurity data , and contribute to making the Internet a safer place .
Are you ready to lead, innovate, and build at scale? Apply now and be part of something big.
Job Tags
Work experience placement,