Senior Data Platform Engineer
منذ يوم
مصر
Aspire, Jordan
دوام كامل
مجانًا عبر البريد الإلكتروني أو Google
احفظ هذه الوظيفة وحافظ على تنظيم بحثك
قم بإنشاء حساب مجاني لحفظ الوظائف وإنشاء التنبيهات والعودة إلى هذه القائمة من لوحة التحكم الخاصة بك.
مجانًا عبر البريد الإلكتروني أو Google
بالمتابعة، فإنك توافق على الشروط & سياسة الخصوصية.
Overview:
This role provides hands-on engineering support for Glassdoor's data platform modernization, migration, and reliability efforts. The goal is to reduce operational support load, modernize legacy Hadoop/Hive/Airflow workloads, and move data-platform capabilities toward Snowflake, Confluent, AWS, and Indeed-aligned infrastructure.
Key Responsibilities
- Help migrate Glassdoor infrastructure and data-platform workloads from GD infrastructure to Indeed infrastructure.
- Help move the data-platform infrastructure and workloads to AWS us-east-2 (USE2), including required connectivity, deployment, and operational prerequisites.
- Enable secure, governed accessibility of Glassdoor data to Indeed data-platform consumers and downstream systems.
- Modernize the data-platform architecture, tooling, orchestration, storage, and operational practices to align with Indeed standards.
- Support Snowflake, Confluent/Kafka, AWS, and data-platform infrastructure migration and operations across stage and production.
- Participate in production troubleshooting, incident response, documentation, runbook creation, and cross-team migration coordination.
- Use Terraform/IaC, GitLab, monitoring and documented processes to deliver repeatable and auditable changes. Required
Qualifications:
- 3+ years of senior-level, hands-on experience in production data-platform engineering, with a platform/DevOps-leaning background and strong data experience.
- Strong Python, Bash and SQL skills.
- Production experience with both Snowflake and Confluent/Kafka, with a focus on DevOps and operations. Deep experience in one and working knowledge of the other is fine:
- Deep Snowflake and AWS, with working Kafka knowledge (topics, connectors, schemas), or
- Deep Kafka/Confluent and AWS, with working Snowflake knowledge.
- Experience operating or migrating production systems across development, stage and production environments.
- Strong troubleshooting, incident-response, testing, documentation and cross-team communication skills.
- Experience with least-privilege access, change control, secrets handling and secure operational practices. Preferred
Qualifications:
- Apache Spark and Hadoop/Hive/HQL, including modernizing or migrating legacy workloads.
- Snowpark, dbt alternatives, AWS Glue, Monte Carlo, or other data-quality and catalog tools.
- Migrating legacy Airflow, Hadoop or Hive workloads to cloud-native or managed platforms.
- Experience working across a company migration or acquisition and aligning systems to a new organization's standards.
- Familiarity with Snowflake-to-Iceberg or Snowflake-to-data-lake migration patterns. Soft
Skills:
- Strong cross-functional communication skills. Additional
Requirements:
- This role requires the use of an Indeed-provisioned AWS WorkSpace. Candidates must demonstrate good connectivity to an AWS WorkSpace region by completing the connectivity test at https://clients.amazonworkspaces.com/Health and submitting a screenshot of the results with the candidate submission.
- Regular overlap with U.
S. Central Time is required.
Key Responsibilities
- Help migrate Glassdoor infrastructure and data-platform workloads from GD infrastructure to Indeed infrastructure.
- Help move the data-platform infrastructure and workloads to AWS us-east-2 (USE2), including required connectivity, deployment, and operational prerequisites.
- Enable secure, governed accessibility of Glassdoor data to Indeed data-platform consumers and downstream systems.
- Modernize the data-platform architecture, tooling, orchestration, storage, and operational practices to align with Indeed standards.
- Support Snowflake, Confluent/Kafka, AWS, and data-platform infrastructure migration and operations across stage and production.
- Participate in production troubleshooting, incident response, documentation, runbook creation, and cross-team migration coordination.
- Use Terraform/IaC, GitLab, monitoring and documented processes to deliver repeatable and auditable changes. Required
Qualifications:
- 3+ years of senior-level, hands-on experience in production data-platform engineering, with a platform/DevOps-leaning background and strong data experience.
- Strong Python, Bash and SQL skills.
- Production experience with both Snowflake and Confluent/Kafka, with a focus on DevOps and operations. Deep experience in one and working knowledge of the other is fine:
- Deep Snowflake and AWS, with working Kafka knowledge (topics, connectors, schemas), or
- Deep Kafka/Confluent and AWS, with working Snowflake knowledge.
- Experience operating or migrating production systems across development, stage and production environments.
- Strong troubleshooting, incident-response, testing, documentation and cross-team communication skills.
- Experience with least-privilege access, change control, secrets handling and secure operational practices. Preferred
Qualifications:
- Apache Spark and Hadoop/Hive/HQL, including modernizing or migrating legacy workloads.
- Snowpark, dbt alternatives, AWS Glue, Monte Carlo, or other data-quality and catalog tools.
- Migrating legacy Airflow, Hadoop or Hive workloads to cloud-native or managed platforms.
- Experience working across a company migration or acquisition and aligning systems to a new organization's standards.
- Familiarity with Snowflake-to-Iceberg or Snowflake-to-data-lake migration patterns. Soft
Skills:
- Strong cross-functional communication skills. Additional
Requirements:
- This role requires the use of an Indeed-provisioned AWS WorkSpace. Candidates must demonstrate good connectivity to an AWS WorkSpace region by completing the connectivity test at https://clients.amazonworkspaces.com/Health and submitting a screenshot of the results with the candidate submission.
- Regular overlap with U.
S. Central Time is required.