Data Engineer
3 days ago
We are seeking a skilled and experienced Data Engineer to join our expanding data team at our digital marketing/adtech company. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure on AWS. In addition to strong data engineering skills, you should have experience with DevOps, ensuring scalability, reliability, and automation of our data processes.
- Responsibilities:_
- Design, build, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into our data platform on AWS.
- Develop and optimize ETL processes to ensure the timely delivery of high-quality data for analysis and reporting purposes.
- Implement data governance and data quality frameworks to ensure data integrity and consistency.
- Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
- Automate data workflows and processes using AWS services such as Lambda, Glue, Step Functions, and CloudWatch.
- Implement and manage CI/CD pipelines for data engineering workflows.
- Collaborate with data scientists and analysts to ensure the availability of reliable data for machine learning models and analytics.
- Monitor and troubleshoot data pipeline issues, ensuring data availability and reliability.
- Stay updated with the latest data engineering, DevOps, and MLOps trends and technologies.
**_ Essential Requirements:_**
- Bachelor's degree in Computer Science, Software Engineering, or a related field.
- Proven experience as a Data Engineer, preferably in a cloud-based environment using AWS.
- Strong proficiency in data modeling, ETL development, and data warehousing concepts.
- Experience with AWS services such as S3, Glue, Lambda, Athena, Step Functions, and CloudWatch.
- Experience with Apache Spark framework.
- Solid understanding of database technologies, including SQL and NoSQL databases.
- Experience with containerization technologies such as Docker and orchestration frameworks like Kubernetes is a plus.
- Solid programming skills in languages such as Python, Java, or Scala.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills with the ability to work effectively in a team environment.
**_ Preferred Requirements:_**
- Understanding of machine learning concepts and experience collaborating with data scientists is desirable.
- Familiarity with DevOps practices and tools, including infrastructure as code (IaC) and CI/CD pipelines.
-
Data Engineer
4 weeks ago
مصر, Egypt On-Hire Full timeOur Client is the largest digital classifieds and marketplace in Sudan. We need a self-driven leader who can execute quickly in a startup environment. You will have freedom and responsibility as the first person in that role. Your work will help us make better business decisions thanks to your insights visualized using dashboards. You will collaborate...
-
Data Engineer
4 days ago
مصر, Egypt Curenta Full time**Responsibilities**: - Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Functions, and other Azure services. - Implement data storage solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB. - Design and implement Modern Lakehouse Data Warehouse using Delta Lake and Spark, ensuring...
-
Data Engineer
4 weeks ago
مصر, Egypt Zeal Full time**About ZealPay**:ZealPay is an innovative Cairo-based technical startup backed by global strategic investors to empower brands with the next generation of payments, loyalty, and AI-powered insights. We provide our merchants with world-class data, analytics & tools to predict consumer behavior using Artificial Intelligence. Merchants can unlock the full...
-
Data Engineer
2 weeks ago
مصر, Egypt Giza Systems EG Full timeDevelop and maintain data pipelines implementing ETL processes. - Take responsibility for data warehouses and data lakes (i.e. Hadoop, Elastic Stack and Spark) development and implementation. - Work closely with a data scientists implementing data analytic pipelines. - Help define data governance policies and support data versioning processes. - Maintain...
-
Data Engineer
2 weeks ago
مصر, Egypt AUMET Inc. Full timeAUMET is the leading B2B marketplace to sell medical products between healthcare providers and distributors. We are innovating how distributors of medical supplies do business with consumer selling points such as pharmacies. With 500,000 transactions per month, AUMET marketplace is a fast growing product that is capturing market share and is on a road to...
-
Data Engineer
4 weeks ago
مصر, Egypt Giza Systems EG Full timeGathering the ETL/ELT requirements. - Design, Develop, Test ETL/ELT different scenarios and support the ETL/ELT processes to Extract, Transforming and Loading data from different sources to the data warehouse. - Create and maintain optimal integration solutions including data pipeline architecture. - Analyze multiple sources of structured and unstructured...
-
Senior Data Engineer
6 days ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...
-
Data Engineer
3 days ago
مصر, Egypt Envision Employment Solutions Full timeEnvision Employment Solutions is currently looking for a Data Engineer for one of our partners, a multinational bank. **Responsibilities**: - Database Development: Develop stored procedure, views, functions, partitions, etc., using SQL Server. - ETL Development: Develop, code, test, and debug using SSIS ETL (SQL Server Integration Services). Translate...
-
Data Engineer
1 day ago
مصر, Egypt Fivos Full timeFivos is the industry’s only provider of comprehensive data solutions for specialty providers, medical registries and device manufacturers. By taking a holistic approach to data capture, insights and action, we help drive innovation, improve outcomes and lower costs for unique clinical workflows. Vascular, cardiovascular, women’s health and other...
-
Senior Data Engineer
1 day ago
مصر, Egypt FlairsTech Full timeDetails Required Experience +4 years Department Digital Solutions Career Level Position Location Cairo **Skills**: - Data Warehousing Data management Data Integration Requirements and responsibilities **Role Objectives**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into...
-
Principal Data Engineer
2 weeks ago
مصر, Egypt b_labs Full timeImagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Principal Data Engineer to join our Fintech squad. As a key member of our...
-
Staff Data Engineer
2 weeks ago
مصر, Egypt b_labs Full timeImagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Staff Data Engineer to join our Fintech squad. As a key member of our...
-
Senior Data Engineer
2 weeks ago
مصر, Egypt Vezeeta Full time**About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...
-
Staff Data Engineer
2 weeks ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Principal Data Engineer
2 weeks ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Data Engineer-octopus
1 hour ago
مصر, Egypt robusta Full timeRobusta is currently seeking a talented Data Engineer to join Octopus, our business unit at Robusta Technology Group that matches tech talents with remote or onsite opportunities worldwide. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines and infrastructure. You will be working...
-
Data Engineer
6 days ago
مصر, Egypt Plugin Talents Full time**About the job Data Engineer**: **Requirements/Job Specification** - Conduct meetings to gather business requirements from all functions in order to support managing demand and change management processes - Identify new technologies, potential hardware, operating systems, and connectivity solutions in order to support the development/update of data...
-
Data Engineer
2 weeks ago
مصر, Egypt Orange Full time**votre rôle**: Deploy and operate Oracle IT systems within the Equant MHS Data centers. Perform regular day to day database operations including; Problem Resolution, Upgrades and Maintenance, Backups, Performance Monitoring and Tuning. Incident Management Maintain physical integrity (i.e. managed by the database engine) of databases ; this includes...
-
Data Integration Engineer
7 days ago
مصر, Egypt Giza Systems EG Full timeIntegration Engineer to support the delivery of multi-organizational integration projects and enterprise data-warehouse **Responsibilities** - Gathering the ETL/ELT requirements. - Design, Develop, Test ETL/ELT different scenarios and support the ETL/ELT processes to Extract, Transforming and Loading data from different sources to the data warehouse. -...
-
Senior Data Engineer
6 days ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake preprocessing of structured and unstructured data. - Build the infrastructure required for optimal...