Sr Big Data Infrastructure Engineer

4 months ago


مصر, Egypt Rackspace Full time

**About the Role**:
**What you will be doing**:

- Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc to Build a reusable infra structure for stream and batch processing systems at scale.
- Create automation, whether that is building DevOps pipelines, scripting or creating Infrastructure as Code in Terraform
- Participating in work sessions with clients
- Completing technical documentation

**Requirements**:

- Experience in Developing and Scaling data Processing Systems This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark.
- Expertise in public cloud services, particularly in GCP.
- Experience with GCP managed services and understanding of cloud-based messaging/stream processing systems are critical.
- Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
- Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.
- Proven experience in engineering stream/batch processing systems at scale.
- Strong programming abilities in Java and Python.
- Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.

**Must Have**:

- Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification
- 4+ years of experience in customer-facing software/technology or consulting
- 4+ years of experience with “on-premises to cloud” migrations or IT transformations
- 4+ years of experience building, and operating solutions built on GCP (ideally) or AWS/Azure
- Technical degree: Computer Science, software engineering or related

**About Rackspace Technology**

**More on Rackspace Technology



  • مصر, Egypt Vodafone Full time

    **Role Purpose**: The Sr Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: - Integrate the necessary data from several sources necessary for analysis and for Technology...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Platform Developer **Purpose of the job** Building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. **Duties and responsibilities** 1. Contribute in executing team plans according to the department strategic vision. 2. Provide strong...

  • Big Data Engineer

    4 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership**: - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Architect **Purpose of the job** - As a solution architect you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance CVM data engineering pipelines, computing and data storage platform that underpins the diverse workloads running on data lake infrastructure. - You will...

  • Big Data Team Lead

    3 months ago


    مصر, Egypt Digital Talent MENA Full time

    Cairo, Egypt **Software** Digital Talent is hiring for one of our Clients the role of BIG Data Team Lead. Our Client is one of the leading Software companies in the financial sector in the MENA Region. About this role: This role will Create and manage the company’s Big Data infrastructure and tools, and knows how to get results from vast amounts of data...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, DevOps Engineer **Purpose of the job** As a Data Lake operations support specialist you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware,...

  • Big Data Engineer vois

    3 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: - The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...

  • Big Data Engineer vois

    4 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: - The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...


  • مصر, Egypt SSC Egypt Full time

    Manage and maintain our Big Data infrastructure, including HBase, Elastic search, and Cloudera. - Develop and implement processes for data ingestion, processing, and storage. - Work with other members of the DevOps team to troubleshoot and resolve issues related to Big Data systems. - Work with data scientists and architects to understand their...

  • Big Data

    5 months ago


    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data & Kubernetes Administrator**: As a Big Data & Kubernetes Administrator at in the IT department, you will play a crucial role in managing and optimizing our big data infrastructure and Kubernetes clusters. Your responsibilities will include ensuring the smooth operation of our big data...

  • Big Data Specialist

    4 months ago


    مصر, Egypt Vodafone Full time

    **What you’ll do**: **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership** - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely...

  • Big Data Administrator

    4 months ago


    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data Administrator**: As a Big Data Administrator, you will be responsible for managing and optimizing our organization's large data sets to ensure smooth operations and data integrity. - Manage and maintain our big data infrastructure - Implement data security and privacy measures - Optimize data...


  • مصر, Egypt Vodafone Full time

    **Role Purpose**: The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...

  • Sr. Data Engineer vois

    4 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: **The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain.** **Key accountabilities and decision ownership**: - **Both managed and independent research (POCs, white...

  • Sr. Data Engineer vois

    6 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. **Key accountabilities and decision ownership**: - Both managed and independent research (POCs, white papers,...


  • مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...

  • Big Data Engineer

    3 months ago


    مصر, Egypt Rackspace Full time

    Our Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Modeler **Purpose of the job** As a data engineer you'll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and...


  • مصر, Egypt Vodafone Full time

    **Role Purpose**: The role involves working on big data quality pipelines, monitoring workflow performance and data trends, administering full DB clusters, managing vendor communications, and performing system upgrades. **Key Accountabilities & Decision Ownership**: - ** Operations Management**:Take ownership of day-to-day operations, ensuring smooth...

  • Data Engineer

    3 months ago


    مصر, Egypt Envision Employment Solutions Full time

    **Job Summary**: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure and systems that support the organization's data-driven initiatives. **Responsibilities**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load large volumes of data from various...