Jd Lead Data Engineer
3 months ago
**Job Summary**:
As the Lead Data Engineer, you will lead the data engineering team in building, testing, and optimizing sustainable data pipelines, architectures, and data lake platforms. You will collaborate closely with data architects and other stakeholders to ensure the seamless integration and transformation of data from various sources. Your role will be critical in setting the strategic direction for data engineering operations, ensuring data reliability, quality, and availability for business operations and advanced analytics.
**Duties and Responsibilities**
***-Lead the design, development, and optimization of data engineering pipelines, integrating and streaming data from diverse sources using ETL/ELT processes.
- Oversee the implementation of methods to improve data reliability and quality, ensuring that raw data is transformed into consistent, machine-readable formats.
- Architect and develop data systems that enable efficient data extraction and transformation for predictive and prescriptive modelling.
- Define and implement development, testing, release, update, and support processes for data engineering operations, including troubleshooting and bug fixing.
- Develop and validate big data models and use cases, ensuring they are ready for data operations and accessible to end users.
- Lead efforts to create and execute queries on structured and unstructured data sources to identify process issues or perform mass updates.
- Ensure that batch production scheduling and report distribution processes are accurate, timely, and efficient.
- Build and maintain processes that support data transformation, data structures, metadata management, and workload management.
- Manage and prioritize ad hoc requests from users, including data research, file manipulation/transfer, and process issue resolution.
Job Requirements
**Technical Skills**
- Extensive hands-on experience in selecting and deploying appropriate CI/CD tools.
- Strong expertise in building continuous integration, continuous development, and deployment pipelines (CI/CD Pipeline).
- Advanced problem-solving, troubleshooting, and process-oriented skills.
- Proficiency in object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.
- Extensive experience with ETL/ELT technologies, including both streaming and batch processing.
- Proven experience in building and optimizing big data pipelines, architectures, and datasets.
- Hands-on experience with big data tools such as Hadoop, Hive, Impala, Spark, Kafka, etc.
- Expertise in stream-processing systems like Storm, Spark-Streaming, etc.
- Knowledge of the Cloudera Ecosystem is an advantage.
- Understanding of data models, data mining, and segmentation techniques is beneficial.
**Qualifications and Experiences**
Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
Fluent in both written and spoken Arabic and English.
Preferred experience in leading or participating in large-scale Big Data projects.
7+ years of experience in data warehousing (DWH), ETL, and data engineering, with demonstrated leadership experience.
**Skills**:
- lead data engineer
Job poster
A1Softech company
-
Jd Lead Data Engineer
3 weeks ago
القاهرة, Egypt TechiTopia Full timeyou will lead the data engineering team in building, testing, and optimizing sustainable data pipelines, architectures, and data lake platforms. You will collaborate closely with data architects and other stakeholders to ensure the seamless integration and transformation of data from various sources Job Requirements - Bachelor's degree in computer science,...
-
Oracle Jd Edward Specialist
3 weeks ago
القاهرة, Egypt DevGate Consultancy Full time**Job Title: Oracle JDE (JD Edwards) Upgrade Specialist - Version 9.1 to 9.2** **Job Type**: Part-time, Project-based Engagement **Location**: Remote (Flexible Timings) **Position Overview**: We are seeking an experienced Oracle JD Edwards (JDE) Upgrade Specialist to manage and execute the upgrade of Oracle JD Edwards from version 9.1 to version 9.2. This...
-
Jd Data Architect
3 months ago
القاهرة, Egypt TechiTopia Full time**Job Summary**: The Data Architect is responsible for designing, developing, and managing the organization’s data architecture. This role involves creating blueprints for how data will be stored, consumed, integrated, and managed across different data systems. The Data Architect will work closely with data engineers, data scientists, and other...
-
Lead Data Engineer
1 month ago
القاهرة, Egypt Unifonic Full timeProudly voted a Great Place to Work®, we are a dynamic startup in the SaaS space that is revolutionizing the way businesses communicate. Our team is made up of 500 energetic and passionate Unifones who are dedicated to delivering the best possible experience to 5000+ customer-centric companies. We pride ourselves on our fun and collaborative work...
-
Data Engineering
1 month ago
القاهرة, Egypt MENA Alliances Full timeA leading multinational tech consulting firm in Egypt is seeking an **Egyptian** **Data Engineering Lead** to drive the design, development, and implementation of advanced data solutions. This role offers the chance to work on cutting-edge projects, lead a dynamic team, and make a significant impact. **Key Responsibilities**: - Solve complex data...
-
Data Engineering Tech Lead
2 months ago
القاهرة, Egypt Ethics HR Full timeIdentify and solve complex problems using a structured and logical approach. - Stay up to date on the latest data engineering technologies and trends. - Work with other engineering teams to integrate data engineering solutions with other systems. - Maintain and optimize data systems to ensure high availability and performance. - Design and implement data...
-
Team Lead Data Scientist
2 weeks ago
القاهرة, Egypt SWATX Full timeThe Team Lead Data Scientist will oversee the data science team, leading initiatives to develop and implement advanced machine learning models with some of the use cases tailored for the **telecommunications** sector. This role will ensure the delivery of the data science use cases as per plan with a supporting data stack by closely communicating with the...
-
Data Engineer
4 months ago
القاهرة, Egypt Applab Software Trading Full time**Company Description** Applab is a leading Qatari company specializing in online and digital platform development. Over the last five years, Applab’s success has been driven by our passionate and dedicated team. At Applab, we strive to create a lively, friendly, and collaborative environment where employees can thrive and develop their skills. We value...
-
Data Engineer
2 weeks ago
القاهرة, Egypt Envision Employment Solutions Full timeEnvision Employment Solutions is currently looking for a Data Engineer for one of our partners, a global leader in the chemical industry field. **Job Summary**: The Data Engineer is responsible for designing, building, and maintaining the data infrastructure and pipelines necessary to support the company's data needs. This role involves working with large...
-
Data Engineer
1 month ago
القاهرة, Egypt Envision Employment Solutions Full timeEnvision Employment Solutions is currently looking for a Data Engineer for one of our partners, a global leader in the chemical industry field. **Job Summary**: The Data Engineer is responsible for designing, building, and maintaining the data infrastructure and pipelines necessary to support the company's data needs. This role involves working with large...
-
Data Engineer
3 months ago
القاهرة, Egypt Giza Systems Full timeThe Role - Gathering the ETL/ELT requirements. - Design, Develop, Test ETL/ELT different scenarios and support the ETL/ELT processes to Extract, Transforming and Loading data from different sources to the data warehouse. - Create and maintain optimal integration solutions including data pipeline architecture. - Analyze multiple sources of structured and...
-
Data Engineer
2 months ago
القاهرة, Egypt Ethics HR Full timeCollaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to design, develop, and maintain data engineering solutions using Scala and Python. - Drive the exploration and implementation of new data engineering technologies, frameworks, and tools to enhance performance, scalability, and efficiency. - Work...
-
Data Engineer-data Integration
4 months ago
القاهرة, Egypt IBM Full timeIntroduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...
-
Data Test Lead
5 months ago
القاهرة, Egypt IBM Full timeIntroduction As a Test Specialist at IBM, your analytical and technical skills will directly impact the quality of the software we create. Come work in an agile environment where you will help each iteration reach the next level. Whether the testing is manual, automated, or cognitive, you hold a key role in releasing the best deliverables to IBM’ers and...
-
Data Engineer
5 months ago
القاهرة, Egypt SWATX Full timeSWATX is seeking a skilled and experienced Data Engineer with minimum 3 years of experience to join our team. In this role, you will be responsible for building and maintaining our data infrastructure and architecture, ensuring the availability, reliability, and scalability of our data solutions. You will work closely with cross-functional teams to design...
-
Data Engineer
3 months ago
القاهرة, Egypt Raisa Energy Full timeWe are looking for a** Data Engineer** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil and gas...
-
Data Engineering Manager
3 months ago
القاهرة, Egypt b_labs Full timeb_labs is the transformation and digitization arm of B.TECH, on a mission to change the industry as we know it. We spearhead tech innovation at B.TECH, an organization that has been a cornerstone of the Egyptian retail industry. We are the engine powering B.TECH in achieving its goal of becoming the leading omni-channel platform for consumer electronics and...
-
Data Governance Engineer
4 weeks ago
القاهرة, Egypt Vodafone Full time**Role Purpose : -**: As a Data Governance Engineer, you will play a key role in Digital Network Solutions and Insights team to support the Governance lead as a key point of contact for all topics relating to data quality, data governance and data privacy. You will drive data Standardization and consistency across markets in line with data privacy and...
-
Data Engineer
3 months ago
القاهرة, Egypt Unifonic Full timeProudly voted a Great Place to Work®, we are a dynamic startup in the SaaS space that is revolutionizing the way businesses communicate. Our team is made up of 500 energetic and passionate Unifones who are dedicated to delivering the best possible experience to 5000+ customer-centric companies. We pride ourselves on our fun and collaborative work...
-
Senior Data Engineer
3 months ago
القاهرة, Egypt On-Hire Full timeA leading Fintech company is currently seeking an experienced "Senior Data Engineer " to join their dynamic team. This role is pivotal in shaping the data architecture and analytics capabilities of our fintech services. You will collaborate with cross-functional teams, utilizing your extensive experience in data engineering to optimize data pipelines and...