Senior Supervisor, Data Engineer

4 weeks ago


مصر, Egypt اورنچ مصر Full time

About the job Senior Supervisor, Data Engineer

**Purpose of the job**

Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the Data Warehouse, including all DWH stakes, DWH model, CLDM layer and PL layer. Assures the data management, integration & quality standards, and processes of the data engineering workflow are all met.

**Duties and responsibilities**
- Analyze new business integration needs, fully understand the requirements and perform the required technical analysis to accommodate the new requirements.
- Perform the required development for DWH model to achieve the targeted business needs which include model structure updates, ETL/ELT job load, PL layer jobs modification.
- Implement the right controls to maintain the DWH quality as per the standard Specs and continuously update these quality control checks.
- Work closely with DWH BI analyst to ensure correct and consistent mapping criteria between sources and DWH databases.
- Coordinate with data operations and administrators (system and database) to ensure the best performance monitoring and tuning.
- Optimize data integration platform to provide optimal performance under increasing data volumes.
- Build data pipelines,Analyze and organize data,Build data ingestion scripts/workflows, and Perform quality checks on data
- Drive integration projects from idea formulation, through design and implementation collaborating with partner teams.
- Participate in vendors technical requirements, gap analysis and RFPs
- Support technical decision making in the area of Big Data eco-system and data platform architecture and relevant migration use cases
- Collaborate with data scientists, BI analysts, modelers and IT team members on project goals.
- Monitor and optimize the performance of data platform systems and computing infrastructure.

**Job Specifications**:
**Education**
- Bachelor degree of Engineering in Computer Systems, or Computer Science.

**Experience**
- 5-8 years of hands-on Data engineering, ETL development, and Data Modeling experience
- Solid experience with IBM datastage and Teradata DWH tools/Models is a plus.
- At least 3 years of experience of, managing, designing, programming, administering, and tuning complex conversions moving data from multiple disparate Source Databases into separate/different Data Models
- Extensive experience using and tuning SQL
- Project management experience is a plus
- Expereince working in a big data/ Datalake environment and using big data tools ( NiFi, Airflow, spark, Hive, Kafka, etc )
- Experience with data infrastructure as a code, automation and DevOps practices.
- Excellent understanding of systems design patterns
- Past experience in telecom operators and service providers is preferred.

**Skills and abilities**
- Very good English both written & spoken.
- Excellent collaboration and communication skills and comfortable working across multiple teams.
- Strong hands-on skill, can drill deep into complex systems design and implementation.
- Strong problem solving and troubleshooting skills.
- Excellent knowledge of IBM DataStage and BI solutions
- Excellent programming and debugging skills.
- Excellent systems administration skills.


  • Data Engineer

    1 week ago


    مصر, Egypt Alpha Data Recruitment Full time

    Development experience with at least two different database platforms, such as Snowflake, Teradata, Oracle, or MS SQL. - Exposure to Business Intelligence and ETL tools such as Azure Data Factory, SSIS, MicroStrategy, Tableau, Power BI, Talend, etc. - Experience tuning ETL processes to ensure performance and reliability. - Strong SQL skills. - Experience in...


  • مصر, Egypt اورنچ مصر Full time

    About the job Senior Supervisor, Big Data Modeler **Purpose of the job** As a data engineer youll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties...


  • مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: **Key Responsibilities** - Design, build, and maintain data processing systems to migrate data from HDP to CDP Private Cloud. Work closely with the data engineering team, architects, and administrators to ensure the successful migration of data. Perform data analysis, data profiling, and data mapping to ensure data...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, Data Architect **Purpose of the job** - As a solution architect you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance CVM data engineering pipelines, computing and data storage platform that underpins the diverse workloads running on data lake infrastructure. - You will...


  • مصر, Egypt Orange Egypt Full time

    **Purpose of the job** As a Data Lake operations support supervisor you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware, software solutions and workflows. You will be working...

  • Senior Data Engineer

    4 weeks ago


    مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...


  • مصر, Egypt اورنچ مصر Full time

    About the job Data Quality Engineer, Sr. Supervisor **Purpose of the job**: **Duties and responsibilities** - Develop and implement data collection systems and other strategies and processes that optimize statistical efficiency and data quality - Identify, analyze, and interpret trends or patterns in complex data sets which could indicate possible quality...

  • Senior Data Engineer

    3 weeks ago


    مصر, Egypt b_labs Full time

    Imagine working with a world-class engineering team, building high-impact digital products that'll revolutionalize the consumer finance industry in Egypt... b_labs is the innovation arm of B.TECH, a cornerstone of the Egyptian retail industry. We are looking for a Senior Data Engineer to be part of the foundation team at our Fintech squad who will play a...

  • Senior Data Engineer

    2 weeks ago


    مصر, Egypt Shift EV Full time

    ABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...

  • Senior Data Engineer

    4 weeks ago


    مصر, Egypt Vezeeta Full time

    **About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...

  • Senior Data Engineer

    3 weeks ago


    مصر, Egypt Unifonic Full time

    Proudly voted a Great Place to Work®, we are a dynamic startup in the CPaaS (Communication Platform as a Service) space that is revolutionising the way businesses communicate. Our team is made up of 400+ energetic and passionate Unifones who are dedicated to delivering the best possible experience to 5000+ customer-centric companies. We pride ourselves on...


  • مصر, Egypt Orange Egypt Full time

    **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the Data Warehouse, including all DWH stakes, DWH...


  • مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...


  • مصر, Egypt اورنچ مصر Full time

    About the job Sr. Supervisor, CVM Data Engineer **Purpose of the job** **Duties and responsibilities** - Identifying data ingestion patterns and build framework to efficiently ingest the data to our Data Lake - Performance tuning ingestion jobs to improve throughput - Improving CI/CD process by automating build, test and deployment framework - Build...

  • Senior Data Engineer

    2 months ago


    مصر, Egypt Talent Pal Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your...


  • مصر, Egypt International Data Group, Inc. Full time

    Overview: IDC is looking for a research professional to join our Data & Analytics team in Cairo, Egypt as a Senior Research Analyst to support our software research business and emerging technologies such as Cloud, Big Data Analytics (BDA), Artificial Intelligence (AI), IT Services, Security software, etc. **Responsibilities**: - Collect and analyze data...


  • مصر, Egypt اورنچ مصر Full time

    About the job Supervisor, data Quality **Purpose of the job**: **Duties and responsibilities** - Develop and implement data collection systems and other strategies and processes that optimize statistical efficiency and data quality - Identify, analyze, and interpret trends or patterns in complex data sets which could indicate possible quality...

  • Senior Data Engineer

    4 weeks ago


    مصر, Egypt Siemens Healthineers Full time

    Siemens Industry Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly, the global leader in intelligent asset management solutions, enables organizations to transform the...

  • Senior Data Engineer

    4 weeks ago


    مصر, Egypt Nile Bits Full time

    As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...

  • Senior Data Engineer

    3 weeks ago


    مصر, Egypt Nile Bits Full time

    **Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...