Senior/lead Data Engineer

5 days ago


مصر, Egypt FlairsTech Full time

Cairo / Alexandria
- 7 years Experience
- Digital Solutions Department

**About the job**:
**Requirements and responsibilities**

***:
**Duties**:

- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into AWS-based data warehouses or data lakes.
- Collaborate with Data Scientists and Analysts to understand data requirements and implement solutions for data transformation and preparation.
- Create and manage data models in PostgreSQL and MySQL, ensuring data accuracy, consistency, and integrity across different systems.
- Monitor and troubleshoot data pipeline issues, identifying and resolving bottlenecks and data inconsistencies.
- Collaborate with DevOps and IT teams to ensure AWS data infrastructure availability, scalability, and disaster recovery.
- Document data engineering processes, standards, and best practices.
- Play a key role in hiring, promote our quality culture, and coach other engineers.
- Continuously invest in improving our data reliability metrics on AWS.
- Collaborate with product and business partners to evolve our AWS-based data systems, products, and services to better serve our customers.

**Technical Requirements**:

- 7+ years of experience in the same or similar role.
- Proven experience in Data Warehousing, Data Aggregation and Data Management.
- Familiarity with ETL tools and frameworks (e.g., Apache Spark) and orchestration tools like AWS Step Functions.
- Experience with AWS-based data warehousing concepts and technologies (e.g., Amazon Redshift, Redshift Data APIs).
- Deep knowledge of database technologies such as PostgreSQL and MySQL.
- Experience or familiarity with AWS services, especially AWS API Gateway.
- Knowledge of AWS as the primary cloud platform and its data services.
- Interest or experience in upcoming data visualization tools like PowerBI or QuickSight would be a plus.

**Non-Technical Requirements**:

- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Strong analytical and problem-solving abilities, with a focus on data-driven decision-making.
- Customer-centric mindset and the ability to empathize with user needs and pain points.
- Strong leadership/ team management abilities and coaching skills
- Ability to manage multiple priorities and adapt to changing requirements and priorities.



  • مصر, Egypt b_labs Full time

    Imagine working with a world-class engineering team, building high-impact digital products that'll revolutionalize the consumer finance industry in Egypt... b_labs is the innovation arm of B.TECH, a cornerstone of the Egyptian retail industry. We are looking for a Senior Data Engineer to be part of the foundation team at our Fintech squad who will play a...


  • مصر, Egypt Nile Bits Full time

    As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...


  • مصر, Egypt Nile Bits Full time

    **Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...

  • Senior Data Engineer

    2 weeks ago


    مصر, Egypt Vezeeta Full time

    **About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...


  • مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...


  • مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake preprocessing of structured and unstructured data. - Build the infrastructure required for optimal...

  • Senior Data Ops

    4 weeks ago


    مصر, Egypt DXC Technology Full time

    **As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...


  • مصر, Egypt Emprego EG Full time

    **Main Job Purpose**: This role will provide technical data leadership of our METR D&A Market teams. You will be responsible for - creating, expanding, optimizing and managing our Analytical stacks with the target of having "data as a consumable product" while keeping in mind correctness, freshness and quality of the data. - building and/or rolling out new...


  • مصر, Egypt Microsoft Corporation Full time

    We are looking for passionate, creative, and analytical engineers who love machine learning, data analytics, and shipping technology with agility at massive scale. For this position, we are hiring a senior software engineer to lead the team responsible for data engineering and data mining of GitHub Copilot. **Responsibilities**: - Lead the design and...


  • مصر, Egypt Microsoft Full time

    We are looking for passionate, creative, and analytical engineers who love machine learning, data analytics, and shipping technology with agility at massive scale. For this position, we are hiring a senior software engineer to lead the team responsible for data engineering and data mining of GitHub Copilot. **Responsibilities**: - Lead the design and...

  • Senior Data Engineer

    4 weeks ago


    مصر, Egypt Beinex Full time

    Beinex is looking for the best-in-class Data Engineer for its office in Egypt. **Responsibilities**: - Work with business requirements analysts to identify and solve business problems - Design and maintain cloud on-premises, and hybrid data platform architectures - Identify, design and implement full data warehouse and Big Data solutions - Design and...


  • مصر, Egypt Siemens Healthineers Full time

    Siemens Industry Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly, the global leader in intelligent asset management solutions, enables organizations to transform the...


  • مصر, Egypt JW Player Full time

    **About JW Player**: JW Player is the leading video software and data insights platform that gives our customers independence and control in today’s Digital Video Economy. Founded over a decade ago as an open source video player, JW Player’s technology platform now powers digital video for hundreds of thousands of businesses across NA, EMEA, APAC and...


  • مصر, Egypt International Data Group, Inc. Full time

    Overview: IDC is looking for a research professional to join our Data & Analytics team in Cairo, Egypt as a Senior Research Analyst to support our software research business and emerging technologies such as Cloud, Big Data Analytics (BDA), Artificial Intelligence (AI), IT Services, Security software, etc. **Responsibilities**: - Collect and analyze data...


  • مصر, Egypt Talent Pal Full time

    We are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...


  • مصر, Egypt Raisa Energy Full time

    We are looking for a **Senior **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil...


  • مصر, Egypt Plugin Talents Full time

    **About the job Senior data Engineer**: **Job Description**: - Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management - Strong ability to design, build and manage data pipelines for data structures encompassing data...


  • مصر, Egypt Arrow Electronics, Inc. Full time

    Position: Senior Data Intelligence Engineer **Job Description**: The employee also responds to ad-hoc reporting and analytics tasks for higher management, and indirectly support customer requests through the market intelligence team. Responsibilities and Duties: - Design, build, test and maintain internal market intelligence software products - Assist in...

  • Lead Data Engineer

    2 weeks ago


    مصر, Egypt Integrant Full time

    **Integrant Inc, is hiring a passionate and organized "Lead Data Engineer / AWS" to join us as part timer to support with below roles and responsibilities**: - Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (PostgreSQL RDS, DynamoDB, S3, Kinesis Data Streams and...


  • مصر, Egypt b_labs Full time

    Imagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Principal Data Engineer to join our Fintech squad. As a key member of our...