Sr Big Data Infrastructure Engineer
7 months ago
**About the Role**:
**What you will be doing**:
- Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc to Build a reusable infra structure for stream and batch processing systems at scale.
- Create automation, whether that is building DevOps pipelines, scripting or creating Infrastructure as Code in Terraform
- Participating in work sessions with clients
- Completing technical documentation
**Requirements**:
- Experience in Developing and Scaling data Processing Systems This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark.
- Expertise in public cloud services, particularly in GCP.
- Experience with GCP managed services and understanding of cloud-based messaging/stream processing systems are critical.
- Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
- Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.
- Proven experience in engineering stream/batch processing systems at scale.
- Strong programming abilities in Java and Python.
- Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.
**Must Have**:
- Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification
- 4+ years of experience in customer-facing software/technology or consulting
- 4+ years of experience with “on-premises to cloud” migrations or IT transformations
- 4+ years of experience building, and operating solutions built on GCP (ideally) or AWS/Azure
- Technical degree: Computer Science, software engineering or related
**About Rackspace Technology**
**More on Rackspace Technology
-
Network Big Data Sr. Engineer vois
4 hours ago
مصر, Egypt Vodafone Full time**Role purpose: -** The Sr Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...
-
Senior Big Data Engineer vois
7 months ago
مصر, Egypt Vodafone Full time**Role Purpose**: The Sr Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: - Integrate the necessary data from several sources necessary for analysis and for Technology...
-
Sr. Supervisor, Data Platform Developer
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Platform Developer **Purpose of the job** Building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. **Duties and responsibilities** 1. Contribute in executing team plans according to the department strategic vision. 2. Provide strong...
-
Big Data Engineer
4 hours ago
مصر, Egypt Vodafone Full time**Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership**: - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different...
-
Sr. Supervisor, Data Architect
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Architect **Purpose of the job** - As a solution architect you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance CVM data engineering pipelines, computing and data storage platform that underpins the diverse workloads running on data lake infrastructure. - You will...
-
Big Data Team Lead
7 months ago
مصر, Egypt Digital Talent MENA Full timeCairo, Egypt **Software** Digital Talent is hiring for one of our Clients the role of BIG Data Team Lead. Our Client is one of the leading Software companies in the financial sector in the MENA Region. About this role: This role will Create and manage the company’s Big Data infrastructure and tools, and knows how to get results from vast amounts of data...
-
Sr. Supervisor, DevOps Engineer
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, DevOps Engineer **Purpose of the job** As a Data Lake operations support specialist you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware,...
-
Big Data Engineer vois
7 months ago
مصر, Egypt Vodafone Full time**Role purpose**: - The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...
-
Big Data Engineer vois
7 months ago
مصر, Egypt Vodafone Full time**Role purpose**: - The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...
-
Senior Big Data Administrator
7 months ago
مصر, Egypt SSC Egypt Full timeManage and maintain our Big Data infrastructure, including HBase, Elastic search, and Cloudera. - Develop and implement processes for data ingestion, processing, and storage. - Work with other members of the DevOps team to troubleshoot and resolve issues related to Big Data systems. - Work with data scientists and architects to understand their...
-
Big Data
9 months ago
مصر, Egypt Comprehensive Business Services CBS Full time**Our client A Company working in the field of IT seeking Big Data & Kubernetes Administrator**: As a Big Data & Kubernetes Administrator at in the IT department, you will play a crucial role in managing and optimizing our big data infrastructure and Kubernetes clusters. Your responsibilities will include ensuring the smooth operation of our big data...
-
Network Big Data Engineer
6 days ago
مصر, Egypt Vodafone Full timeRole purpose: The Big Data Engineer provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources in the Big Data Programme necessary for analysis and for Technology actions; 3. Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and...
-
Big Data Administrator
7 months ago
مصر, Egypt Comprehensive Business Services CBS Full time**Our client A Company working in the field of IT seeking Big Data Administrator**: As a Big Data Administrator, you will be responsible for managing and optimizing our organization's large data sets to ensure smooth operations and data integrity. - Manage and maintain our big data infrastructure - Implement data security and privacy measures - Optimize data...
-
Big Data Specialist
7 months ago
مصر, Egypt Vodafone Full time**What you’ll do**: **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership** - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely...
-
Sr. Data Engineer vois
9 months ago
مصر, Egypt Vodafone Full time**Role purpose**: The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. **Key accountabilities and decision ownership**: - Both managed and independent research (POCs, white papers,...
-
Senior Big Data Engineer
7 months ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Big Data Engineer
7 months ago
مصر, Egypt Rackspace Full timeOur Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering...
-
Sr. Supervisor, Data Modeler
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Modeler **Purpose of the job** As a data engineer you'll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and...
-
Big Data Engineer
1 week ago
مصر, Egypt Orange Business Services Full time**About the role**: Will be responsible, as part of Level 2 and Level 3 Operation team, for change, incident and performance management of Big Data used in a critical-to-Orange business environment in accordance with established measurements and documented Service Level Agreements. **About you**: Skills / Qualifications: - Proficient understanding of...
-
BI Big Data Tech Lead
1 week ago
مصر, Egypt Vodafone Full time**Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership**: - Design scalable & reliable data ingestion solutions - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different commercial teams to...