Network Big Data Engineer

5 days ago


مصر, Egypt Vodafone Full time

Role purpose:
The Big Data Engineer provides expert guidance and delivers through self and others to:
1. Integrate the necessary data from several sources in the Big Data Programme necessary for analysis and for Technology actions;
3. Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and support) to speed up the Local Markets and tenants delivery in the Big Data Programme, assuring quality, performance and alignment to the Group technology blueprint of components releases in the platform
4. Support local markets, tenants and Group functions in obtaining benefiting business value from the operational data

Key accountabilities and decision ownership:

- Design and implement core platform capabilities, tools, processes, ways of working and conventions under agile development to support the integration of the LM and tenant’s data sourcing and use cases implementation, towards reusability, to easy up delivery and ensure standardisation across Local Markets deliverables in the platform.
- Support the distributed data engineering teams, including technical support and training in the Big Data Programme frameworks and ways of working, revision and integration of source code, support to releasing and source code quality control
- Working with the Group architecture team to define the strategy for evolving the Big Data capability, including solution architectural decisions aligned with the platform architecture
- Defining the technologies to be used on the Big Data Platform and investigating new technologies to identify where they can bring benefits

Core competencies, knowledge and experience:

- Experience building systems to perform real-time data processing using Spark Streaming, Flink, Storm or Heron data processing frameworks, and Kafka, Beam, Dataflow, Kinesis or similar data streaming frameworks;;
- Experience with common SDLC, including SCM, build tools, unit, integration, functional and performance testing from automation perspective, TDD/BDD, CI and continuous delivery, under agile practises
- Experience working in large-scale multi tenancy big data environments;
Must have technical / professional qualifications:

- Expert level experience with Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn); desirable experience with Cloudera distribution; experience with similar cloud provider solutions also considered (AWS, GCP, Azure)
- Strong software development experience in Scala and Python programing languages; Java and functional languages desirable;
- Experience with Unix-based systems, including bash scripting
- Experience with columnar data formats
- Experience with other distributed technologies such as Cassandra, Splunk, Solr/ElasticSearch, Flink, Heron, Bean, would also be desirable.

_VOIS #Movewithus


  • Big Data Engineer

    2 weeks ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership**: - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different...

  • Big Data Engineer

    1 week ago


    مصر, Egypt Orange Business Services Full time

    **About the role**: Will be responsible, as part of Level 2 and Level 3 Operation team, for change, incident and performance management of Big Data used in a critical-to-Orange business environment in accordance with established measurements and documented Service Level Agreements. **About you**: Skills / Qualifications: - Proficient understanding of...

  • Big Data Specialist

    2 weeks ago


    مصر, Egypt Vodafone Full time

    **What you’ll do**: **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership** - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely...

  • Big Data Engineer

    12 hours ago


    مصر, Egypt Rackspace Full time

    Our Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering...


  • مصر, Egypt SSC Egypt Full time

    Manage and maintain our Big Data infrastructure, including HBase, Elastic search, and Cloudera. - Develop and implement processes for data ingestion, processing, and storage. - Work with other members of the DevOps team to troubleshoot and resolve issues related to Big Data systems. - Work with data scientists and architects to understand their...


  • مصر, Egypt Vodafone Full time

    **Role Purpose**: The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources necessary for analysis and for Technology...


  • مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data Administrator**: As a Big Data Administrator, you will be responsible for managing and optimizing our organization's large data sets to ensure smooth operations and data integrity. - Manage and maintain our big data infrastructure - Implement data security and privacy measures - Optimize data...

  • BI Big Data Tech Lead

    2 weeks ago


    مصر, Egypt Vodafone Full time

    **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership**: - Design scalable & reliable data ingestion solutions - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different commercial teams to...


  • مصر, Egypt Vodafone Full time

    **Role purpose**: to work on delivering high quality automated data ingestion pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership** - Design scalable & reliable data ingestion solutions - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different...

  • Big Data

    1 week ago


    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data & Kubernetes Administrator**: As a Big Data & Kubernetes Administrator at in the IT department, you will play a crucial role in managing and optimizing our big data infrastructure and Kubernetes clusters. Your responsibilities will include ensuring the smooth operation of our big data...