As a Data Platform Engineer, you will design and implement a solution that: Periodically indexes Atlan metadata assets into Glean, runs on a configurable schedule (hourly/daily), is production-ready, observable, and maintainable by our DevOps team after handover.
Moreover, ensure compliance and data governance at the appropriate level in line with the company's standards.
Requirements
Platform Engineer (Senior)
•
Python - advanced
•
System & Data Integration - advanced
•
System design - advanced
•
Kubernetes - regular
•
Infrastructure mindset - regular
•
English - advanced
We’re looking for a Data Platform Engineer with experience in data platforms and system design at scale. We expect a track record in designing integration architectures for external systems and streamlining data migration/ingestion.
• Strong experience with Python (preferred) or Go (acceptable).
• Experience with Kubernetes – running, deploying, and operating services in k8s.
• Experience building APIs / connectors/integrations between services.
• Infrastructure mindset – experience working with and setting up observability.
• Background in process automation and scheduled jobs (e.g. Airflow).
• Technical writing skills (no AI-generated slop).
• Excellent communication skills and a pragmatic approach to problem-solving
Don’t worry if you don’t meet all the requirements. We are looking for mature engineers who are transitioning/navigating between Software Engineering and Data domains. This is a customer-facing role that often requires interactions with stakeholders and multiple teams (presentations, design docs, and coordination).
Originally posted on Himalayas