Sr Big Data Engineer

7 months ago


مصر, Egypt Rackspace Full time

**About the Role**:
**What you will be doing**
- Build a reusable, and reliable code for stream and batch processing systems at scale. This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc.

**Requirements**:

- Experience in building a reusable, and reliable code for stream and batch processing systems at scale.
- Expertise in public cloud services, particularly in GCP.
- Experience with GCP managed services and understanding of cloud-based messaging/stream processing systems are critical.
- Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
- Ability to tackle complex challenges and devise effective solutions. Use critical thinking to approach problems from various angles and propose innovative solutions.
- Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.
- Proven experience in engineering stream/batch processing systems at scale.
- Strong programming abilities in Java and Python.
- Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.

**Must Have**:

- Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification
- 4+ years of experience in customer-facing software/technology or consulting
- 4+ years of experience with “on-premises to cloud” migrations or IT transformations
- 4+ years of experience building, and operating solutions built on GCP (ideally) or AWS/Azure
- Technical degree: Computer Science, software engineering or related

**About Rackspace Technology**

**More on Rackspace Technology



  • مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...

  • Big Data Engineer vois

    6 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: - The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...

  • Big Data Engineer vois

    6 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: - The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...

  • Big Data Engineer

    6 months ago


    مصر, Egypt Rackspace Full time

    Our Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Modeler **Purpose of the job** As a data engineer you'll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Platform Developer **Purpose of the job** Building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. **Duties and responsibilities** 1. Contribute in executing team plans according to the department strategic vision. 2. Provide strong...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Architect **Purpose of the job** - As a solution architect you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance CVM data engineering pipelines, computing and data storage platform that underpins the diverse workloads running on data lake infrastructure. - You will...

  • Sr. Data Engineer vois

    6 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: **The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain.** **Key accountabilities and decision ownership**: - **Both managed and independent research (POCs, white...

  • Sr. Data Engineer vois

    8 months ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. **Key accountabilities and decision ownership**: - Both managed and independent research (POCs, white papers,...

  • Big Data Specialist

    6 months ago


    مصر, Egypt Vodafone Full time

    **What you’ll do**: **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership** - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, DevOps Engineer **Purpose of the job** As a Data Lake operations support specialist you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware,...

  • Big Data Engineer

    8 months ago


    مصر, Egypt Talent Pal Full time

    Job Overview: Builds what the big data solutions architect has designed. Big data engineers develop, maintain, test and evaluate big data solutions within organizations. **Responsibilities

  • Big Data Team Lead

    6 months ago


    مصر, Egypt Digital Talent MENA Full time

    Cairo, Egypt **Software** Digital Talent is hiring for one of our Clients the role of BIG Data Team Lead. Our Client is one of the leading Software companies in the financial sector in the MENA Region. About this role: This role will Create and manage the company’s Big Data infrastructure and tools, and knows how to get results from vast amounts of data...


  • مصر, Egypt SSC Egypt Full time

    Manage and maintain our Big Data infrastructure, including HBase, Elastic search, and Cloudera. - Develop and implement processes for data ingestion, processing, and storage. - Work with other members of the DevOps team to troubleshoot and resolve issues related to Big Data systems. - Work with data scientists and architects to understand their...

  • Big Data Administrator

    6 months ago


    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data Administrator**: As a Big Data Administrator, you will be responsible for managing and optimizing our organization's large data sets to ensure smooth operations and data integrity. - Manage and maintain our big data infrastructure - Implement data security and privacy measures - Optimize data...


  • مصر, Egypt اورنچ مصر Full time

    About the job Supervisor, Big Data Modeler **Purpose of the job** As a data engineer youll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and...


  • مصر, Egypt Orange Full time

    **Purpose of the job** As a data engineer youll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and responsibilities** - Identifying data ingestion...

  • Big Data

    8 months ago


    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data & Kubernetes Administrator**: As a Big Data & Kubernetes Administrator at in the IT department, you will play a crucial role in managing and optimizing our big data infrastructure and Kubernetes clusters. Your responsibilities will include ensuring the smooth operation of our big data...

  • Big Data Ai Developer

    8 months ago


    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data AI Developer.**: As a Big Data AI Developer at CBS, you will play a crucial role in developing and implementing cutting-edge artificial intelligence solutions to drive business growth and innovation. - Design and develop AI algorithms to analyze large datasets - Implement machine learning...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Manager, Data Analytics & CVM **Purpose of the job** As a data analytics Sr. Manager you will be responsible for leading and managing a team of analysts and BI experts to drive actionable insights, reporting, and data-driven strategies to enhance customer experience and optimize business performance. This role requires a blend of...