Senior/lead Data Engineer
5 months ago
Cairo / Alexandria
- 7 years Experience
- Digital Solutions Department
**About the job**:
**Requirements and responsibilities**
***:
**Duties**:
- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into AWS-based data warehouses or data lakes.
- Collaborate with Data Scientists and Analysts to understand data requirements and implement solutions for data transformation and preparation.
- Create and manage data models in PostgreSQL and MySQL, ensuring data accuracy, consistency, and integrity across different systems.
- Monitor and troubleshoot data pipeline issues, identifying and resolving bottlenecks and data inconsistencies.
- Collaborate with DevOps and IT teams to ensure AWS data infrastructure availability, scalability, and disaster recovery.
- Document data engineering processes, standards, and best practices.
- Play a key role in hiring, promote our quality culture, and coach other engineers.
- Continuously invest in improving our data reliability metrics on AWS.
- Collaborate with product and business partners to evolve our AWS-based data systems, products, and services to better serve our customers.
**Technical Requirements**:
- 7+ years of experience in the same or similar role.
- Proven experience in Data Warehousing, Data Aggregation and Data Management.
- Familiarity with ETL tools and frameworks (e.g., Apache Spark) and orchestration tools like AWS Step Functions.
- Experience with AWS-based data warehousing concepts and technologies (e.g., Amazon Redshift, Redshift Data APIs).
- Deep knowledge of database technologies such as PostgreSQL and MySQL.
- Experience or familiarity with AWS services, especially AWS API Gateway.
- Knowledge of AWS as the primary cloud platform and its data services.
- Interest or experience in upcoming data visualization tools like PowerBI or QuickSight would be a plus.
**Non-Technical Requirements**:
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Strong analytical and problem-solving abilities, with a focus on data-driven decision-making.
- Customer-centric mindset and the ability to empathize with user needs and pain points.
- Strong leadership/ team management abilities and coaching skills
- Ability to manage multiple priorities and adapt to changing requirements and priorities.
-
Senior Data Engineer
5 months ago
مصر, Egypt Shift EV Full timeABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...
-
Senior Data Engineer
5 months ago
مصر, Egypt Nile Bits Full time**Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...
-
Senior Data Engineer
5 months ago
مصر, Egypt Nile Bits Full timeAs a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...
-
Lead Data Engineer
5 months ago
مصر, Egypt Integrant Full timeWe're on the lookout for exceptional individuals to join our team as **Lead Data Engineers**. As a part of our team, you'll be driving change and making a significant impact in the gaming industry. - Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies. - Engage in...
-
Senior Data Engineer
4 months ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: **Key Responsibilities** - Design, build, and maintain data processing systems to migrate data from HDP to CDP Private Cloud. Work closely with the data engineering team, architects, and administrators to ensure the successful migration of data. Perform data analysis, data profiling, and data mapping to ensure data...
-
Senior Big Data Engineer
4 months ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Data Ops
7 months ago
مصر, Egypt DXC Technology Full time**As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...
-
Senior Data Engineer
6 months ago
مصر, Egypt Talent Pal Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your...
-
Senior Data Engineer
5 months ago
مصر, Egypt Talent Pal Full timeWe are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...
-
Senior Data Scientist
5 months ago
مصر, Egypt Raisa Energy Full timeWe are looking for a **Senior **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil...
-
Lead Data Scientist
5 months ago
مصر, Egypt Envision Employment Solutions Full time**Job Summary**: As Lead Data Scientist you are responsible for spearheading the predictive modeling and machine learning division of the data science department to facilitate growth, revolutionize processes and streamline our customer experience. **Responsibilities**: - Analyze complex financial datasets: Lead the analysis of intricate financial datasets...
-
Senior Supervisor, Data Engineer
5 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...
-
Data Engineer Lead
5 months ago
مصر, Egypt Nagwa Full time**Summary** **Responsibilities** - Partner with various teams to define, transform process and make data actionable for operational and analytic initiatives that create sustainable scalable implementations. - Design & build data pipeline that generates efficient insight data from multiple sources to create reports & dashboards to meet key business...
-
Data Engineer
4 months ago
مصر, Egypt Evolvice GmbH Full timeLocation: Egypt / Cairo - Employment Type: Full Time - Job ID: 33695 **Who we are**: Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital...
-
Senior Software Engineer
5 months ago
مصر, Egypt Procore Full timeThis is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...
-
Data Scientist
5 months ago
مصر, Egypt Raisa Energy Full timeWe are looking for a **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil and gas...
-
Senior Data Annotator
5 months ago
مصر, Egypt Dawarha Full time**About us**: Dawarha is at the forefront of the recycling movement, pioneering an innovative social recycling platform that combines AI-based Reverse Vending technology with a user-friendly mobile app. We proudly introduced this groundbreaking concept to the Egyptian market and the broader MENA region. As a subsidiary of the visionary Mind-Blowing company,...
-
Lead Data Scientist
5 months ago
مصر, Egypt SSC Egypt Full timeData Scientists work across the organization to help business and technical strategies by processing, analyzing, and interpreting huge data sets. Using analytical excellence and statistical methods, you mine through data to identify opportunities for our clients to operate more efficiently, from enhancing advertising efficacy to network infrastructure...
-
Senior Data Integration Engineer
5 months ago
مصر, Egypt Teradata Full timeWhat You’ll Do In this position you will play a key role in designing, implementing, and optimizing data infrastructure and pipelines. You should have a deep understanding of data engineering principles, possess excellent programming skills in Python and SQL, and have a strong grasp of modeling concepts. Who You’ll Work With The Teradata Core...
-
Manager, Data Architecture
5 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Manager, Data Architecture & Engineering **Purpose of the job** Oversee and lead a team of data engineers and modelers to design, implement and maintain robust data models and pipelines. The role is critical for data-driven decision making within the organization and ensuring the integrity and availbility of data for various business...