Big Data Quality Mgt. Specialist

2 days ago

مصر, Egypt Vodafone Full time

**Role Purpose**:
The role involves working on big data quality pipelines, monitoring workflow performance and data trends, administering full DB clusters, managing vendor communications, and performing system upgrades.

**Key Accountabilities & Decision Ownership**:

- **
Operations Management**:Take ownership of day-to-day operations, ensuring smooth functioning, availability, and reliability of the big data platform.
- ** System Monitoring and Maintenance**:Proactively monitor and address issues or bottlenecks in the health and performance of the big data system.
- ** Infrastructure Management**:Manage the provisioning, configuration, and optimization of servers, storage, and job workflows supporting the big data platform.
- ** Performance Optimization**: Optimize the performance of the big data system by tuning configurations, workflows, and addressing bottlenecks.
- ** Security Measures**:Make decisions on implementing security measures like access controls, encryption, and security patches.
- Ensure data delivery and availability through health checks and quality alerts.
- Tune operational jobs and services in BI and BD clusters and set up quality gates and alerts to not impact business trends
- Provide technical leadership and training for newcomers.
- Handle Cloudera manager services administration.
- Take responsibility for cluster resources, storage health, and vendor actions.

**Core Competencies, Knowledge, and Experience**:

- **Passionate about quality**:

- A love of writing a bugs-free code, tuning and analysis through a rigorous scientific approach.
- ** Agile** - Time spent working on closely-knit teams using Agile methodologies such as Scrum and kanban.
- ** Team Player**:

- You enjoy collaborating with, learning from, and teaching others so we all can become better. You assume the good intent in others, and actively do your part to create a positive work environment.
- ** Empathy for customers** - A desire to serve customers first. You love to help Vodafone’s customer to get them happy with your developed feature.

**Must have technical / professional qualifications**:

- Bachelor of computer Science or related domains
- 3+ years of Engineering Experience in building and supporting mission critical user-facing, large-scale and distributed systems.
- Excellent experience in open source technologies like Java, Scala, Python, C/C++, NoSQL, node.js, Angular, AWS, Kafka, Cassandra, Zookeeper..
- Understanding of distributed storage systems like Hadoop Distributed File System (HDFS).
- Knowledge of data processing frameworks, such as Apache Hadoop (MapReduce), Apache Spark, Apache Flink, etc.
- Proficiency in working with Big Data frameworks and technologies, including Apache Hadoop, Apache Spark, Apache Kafka, etc.
- Experience with tools like Apache Hive, Apache Pig, and others for data processing.
- Understanding of data warehousing concepts and technologies Familiarity with ETL tools and processes for efficiently moving and transforming data

  • Big Data Administrator

    2 weeks ago

    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data Administrator**: As a Big Data Administrator, you will be responsible for managing and optimizing our organization's large data sets to ensure smooth operations and data integrity. - Manage and maintain our big data infrastructure - Implement data security and privacy measures - Optimize data...

  • Big Data Engineer

    2 weeks ago

    مصر, Egypt Vodafone Full time

    **Role purpose**: to work on big data engineering pipelines, E2E solutions development, and system upgrades **Key accountabilities and decision ownership**: - Design scalable & reliable data ingestion solutions Promotional offers. - Manage day-by-day tasks in queue according to priorities set in sprint planning meetings. - Work closely with different...

  • Senior Big Data Engineer

    2 days ago

    مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...

  • Big Data

    2 weeks ago

    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data & Kubernetes Administrator**: As a Big Data & Kubernetes Administrator at in the IT department, you will play a crucial role in managing and optimizing our big data infrastructure and Kubernetes clusters. Your responsibilities will include ensuring the smooth operation of our big data...

  • Big Data Ai Developer

    2 weeks ago

    مصر, Egypt Comprehensive Business Services CBS Full time

    **Our client A Company working in the field of IT seeking Big Data AI Developer.**: As a Big Data AI Developer at CBS, you will play a crucial role in developing and implementing cutting-edge artificial intelligence solutions to drive business growth and innovation. - Design and develop AI algorithms to analyze large datasets - Implement machine learning...

  • Network Big Data Engineer

    1 week ago

    مصر, Egypt Vodafone Full time

    Role purpose: The Big Data Engineer provides expert guidance and delivers through self and others to: 1. Integrate the necessary data from several sources in the Big Data Programme necessary for analysis and for Technology actions; 3. Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and...

  • Senior Big Data Administrator

    1 week ago

    مصر, Egypt SSC Egypt Full time

    Manage and maintain our Big Data infrastructure, including HBase, Elastic search, and Cloudera. - Develop and implement processes for data ingestion, processing, and storage. - Work with other members of the DevOps team to troubleshoot and resolve issues related to Big Data systems. - Work with data scientists and architects to understand their...

  • Data Quality Specialist

    1 week ago

    مصر, Egypt IQVIA Full time

    **Position summary**: The Data Quality Specialist works with the R&D Data Platforms Team and other business functions to facilitate the creation, maintenance, and validation of strategic data assets. This role supports the deployment of established data quality practices, works with the Data Quality Lead to define quality measures and implement business...

  • Big Data Engineer

    2 weeks ago

    مصر, Egypt Orange Business Services Full time

    **About the role**: Will be responsible, as part of Level 2 and Level 3 Operation team, for change, incident and performance management of Big Data used in a critical-to-Orange business environment in accordance with established measurements and documented Service Level Agreements. **About you**: Skills / Qualifications: - Proficient understanding of...

  • Data Quality Specialist

    6 days ago

    مصر, Egypt D4DS Full time

    LOCATION :Cairo / Nasr City Our headquarter: Riyadh/ suadi arbia - Develop and implement data quality strategies and initiatives aligned with the NDMO framework to maintain high standards of data accuracy, completeness, consistency, and integrity. - Perform comprehensive data profiling and analysis to identify data quality issues, anomalies, and gaps across...