Senior/lead Data Engineer
5 days ago
Cairo / Alexandria
- 7 years Experience
- Digital Solutions Department
**About the job**:
**Requirements and responsibilities**
***:
**Duties**:
- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into AWS-based data warehouses or data lakes.
- Collaborate with Data Scientists and Analysts to understand data requirements and implement solutions for data transformation and preparation.
- Create and manage data models in PostgreSQL and MySQL, ensuring data accuracy, consistency, and integrity across different systems.
- Monitor and troubleshoot data pipeline issues, identifying and resolving bottlenecks and data inconsistencies.
- Collaborate with DevOps and IT teams to ensure AWS data infrastructure availability, scalability, and disaster recovery.
- Document data engineering processes, standards, and best practices.
- Play a key role in hiring, promote our quality culture, and coach other engineers.
- Continuously invest in improving our data reliability metrics on AWS.
- Collaborate with product and business partners to evolve our AWS-based data systems, products, and services to better serve our customers.
**Technical Requirements**:
- 7+ years of experience in the same or similar role.
- Proven experience in Data Warehousing, Data Aggregation and Data Management.
- Familiarity with ETL tools and frameworks (e.g., Apache Spark) and orchestration tools like AWS Step Functions.
- Experience with AWS-based data warehousing concepts and technologies (e.g., Amazon Redshift, Redshift Data APIs).
- Deep knowledge of database technologies such as PostgreSQL and MySQL.
- Experience or familiarity with AWS services, especially AWS API Gateway.
- Knowledge of AWS as the primary cloud platform and its data services.
- Interest or experience in upcoming data visualization tools like PowerBI or QuickSight would be a plus.
**Non-Technical Requirements**:
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Strong analytical and problem-solving abilities, with a focus on data-driven decision-making.
- Customer-centric mindset and the ability to empathize with user needs and pain points.
- Strong leadership/ team management abilities and coaching skills
- Ability to manage multiple priorities and adapt to changing requirements and priorities.
-
Senior Data Engineer
2 days ago
مصر, Egypt b_labs Full timeImagine working with a world-class engineering team, building high-impact digital products that'll revolutionalize the consumer finance industry in Egypt... b_labs is the innovation arm of B.TECH, a cornerstone of the Egyptian retail industry. We are looking for a Senior Data Engineer to be part of the foundation team at our Fintech squad who will play a...
-
Senior Data Engineer
7 days ago
مصر, Egypt Nile Bits Full timeAs a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...
-
Senior Data Engineer
5 days ago
مصر, Egypt Nile Bits Full time**Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...
-
Senior Data Engineer
2 weeks ago
مصر, Egypt Vezeeta Full time**About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...
-
Senior Data Engineer
6 days ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...
-
Senior Data Engineer
6 days ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake preprocessing of structured and unstructured data. - Build the infrastructure required for optimal...
-
Senior Data Ops
4 weeks ago
مصر, Egypt DXC Technology Full time**As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...
-
Met Data Engineering Lead
2 weeks ago
مصر, Egypt Emprego EG Full time**Main Job Purpose**: This role will provide technical data leadership of our METR D&A Market teams. You will be responsible for - creating, expanding, optimizing and managing our Analytical stacks with the target of having "data as a consumable product" while keeping in mind correctness, freshness and quality of the data. - building and/or rolling out new...
-
Software Engineering Lead
4 weeks ago
مصر, Egypt Microsoft Corporation Full timeWe are looking for passionate, creative, and analytical engineers who love machine learning, data analytics, and shipping technology with agility at massive scale. For this position, we are hiring a senior software engineer to lead the team responsible for data engineering and data mining of GitHub Copilot. **Responsibilities**: - Lead the design and...
-
Software Engineering Lead
4 weeks ago
مصر, Egypt Microsoft Full timeWe are looking for passionate, creative, and analytical engineers who love machine learning, data analytics, and shipping technology with agility at massive scale. For this position, we are hiring a senior software engineer to lead the team responsible for data engineering and data mining of GitHub Copilot. **Responsibilities**: - Lead the design and...
-
Senior Data Engineer
4 weeks ago
مصر, Egypt Beinex Full timeBeinex is looking for the best-in-class Data Engineer for its office in Egypt. **Responsibilities**: - Work with business requirements analysts to identify and solve business problems - Design and maintain cloud on-premises, and hybrid data platform architectures - Identify, design and implement full data warehouse and Big Data solutions - Design and...
-
Senior Data Engineer
1 week ago
مصر, Egypt Siemens Healthineers Full timeSiemens Industry Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly, the global leader in intelligent asset management solutions, enables organizations to transform the...
-
Senior Data Scientist
4 days ago
مصر, Egypt JW Player Full time**About JW Player**: JW Player is the leading video software and data insights platform that gives our customers independence and control in today’s Digital Video Economy. Founded over a decade ago as an open source video player, JW Player’s technology platform now powers digital video for hundreds of thousands of businesses across NA, EMEA, APAC and...
-
Senior Research Analyst
1 week ago
مصر, Egypt International Data Group, Inc. Full timeOverview: IDC is looking for a research professional to join our Data & Analytics team in Cairo, Egypt as a Senior Research Analyst to support our software research business and emerging technologies such as Cloud, Big Data Analytics (BDA), Artificial Intelligence (AI), IT Services, Security software, etc. **Responsibilities**: - Collect and analyze data...
-
Senior Data Engineer
1 week ago
مصر, Egypt Talent Pal Full timeWe are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...
-
Senior Data Scientist
3 days ago
مصر, Egypt Raisa Energy Full timeWe are looking for a **Senior **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil...
-
Senior Data Engineer
6 days ago
مصر, Egypt Plugin Talents Full time**About the job Senior data Engineer**: **Job Description**: - Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management - Strong ability to design, build and manage data pipelines for data structures encompassing data...
-
Senior Data Intelligence Engineer
1 week ago
مصر, Egypt Arrow Electronics, Inc. Full timePosition: Senior Data Intelligence Engineer **Job Description**: The employee also responds to ad-hoc reporting and analytics tasks for higher management, and indirectly support customer requests through the market intelligence team. Responsibilities and Duties: - Design, build, test and maintain internal market intelligence software products - Assist in...
-
Lead Data Engineer
2 weeks ago
مصر, Egypt Integrant Full time**Integrant Inc, is hiring a passionate and organized "Lead Data Engineer / AWS" to join us as part timer to support with below roles and responsibilities**: - Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (PostgreSQL RDS, DynamoDB, S3, Kinesis Data Streams and...
-
Principal Data Engineer
2 weeks ago
مصر, Egypt b_labs Full timeImagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Principal Data Engineer to join our Fintech squad. As a key member of our...