Data Engineer
5 months ago
We are seeking a skilled and experienced Data Engineer to join our expanding data team at our digital marketing/adtech company. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure on AWS. In addition to strong data engineering skills, you should have experience with DevOps, ensuring scalability, reliability, and automation of our data processes.
- Responsibilities:_
- Design, build, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into our data platform on AWS.
- Develop and optimize ETL processes to ensure the timely delivery of high-quality data for analysis and reporting purposes.
- Implement data governance and data quality frameworks to ensure data integrity and consistency.
- Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
- Automate data workflows and processes using AWS services such as Lambda, Glue, Step Functions, and CloudWatch.
- Implement and manage CI/CD pipelines for data engineering workflows.
- Collaborate with data scientists and analysts to ensure the availability of reliable data for machine learning models and analytics.
- Monitor and troubleshoot data pipeline issues, ensuring data availability and reliability.
- Stay updated with the latest data engineering, DevOps, and MLOps trends and technologies.
**_ Essential Requirements:_**
- Bachelor's degree in Computer Science, Software Engineering, or a related field.
- Proven experience as a Data Engineer, preferably in a cloud-based environment using AWS.
- Strong proficiency in data modeling, ETL development, and data warehousing concepts.
- Experience with AWS services such as S3, Glue, Lambda, Athena, Step Functions, and CloudWatch.
- Experience with Apache Spark framework.
- Solid understanding of database technologies, including SQL and NoSQL databases.
- Experience with containerization technologies such as Docker and orchestration frameworks like Kubernetes is a plus.
- Solid programming skills in languages such as Python, Java, or Scala.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills with the ability to work effectively in a team environment.
**_ Preferred Requirements:_**
- Understanding of machine learning concepts and experience collaborating with data scientists is desirable.
- Familiarity with DevOps practices and tools, including infrastructure as code (IaC) and CI/CD pipelines.
-
Data Engineer
5 months ago
مصر, Egypt Envision Employment Solutions Full time**Job Summary**: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure and systems that support the organization's data-driven initiatives. **Responsibilities**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load large volumes of data from various...
-
Data Engineer
5 months ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Data Engineer
5 months ago
مصر, Egypt Appgain.io Full timeWe are searching for a talented and passionate Data Engineer to join our growing team! You will play a critical role in designing, building, and maintaining the data infrastructure that supports our data-driven initiatives. You will work closely with data scientists, analysts, and software engineers to ensure our data is clean, accessible, and ready for...
-
Data Engineer
5 months ago
مصر, Egypt Curenta Full time**Responsibilities**: - Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Functions, and other Azure services. - Implement data storage solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB. - Design and implement Modern Lakehouse Data Warehouse using Delta Lake and Spark, ensuring...
-
Data Engineer
5 months ago
مصر, Egypt Nawy Real Estate Full time**As a Data Engineer at Nawy, you will hold a pivotal role in designing, implementing, and maintaining data pipelines and infrastructure to support the organization's data needs. Additionally, you will play a key role in data management, ensuring data quality, integrity, and modeling. We are seeking an individual with a strong technical background, hands-on...
-
Data Engineer
5 months ago
مصر, Egypt Nawy Real Estate Full timeJob Responsibilities: - Data Pipeline Development: Design, develop, and maintain efficient and reliable data pipelines to collect, process, and transform raw data from various sources into usable formats for analysis. - Designing, implementing, and maintaining data pipelines that move data from various sources to the appropriate storage solution all while...
-
Data Engineer
6 months ago
مصر, Egypt DXC Technology Full time**Job Summary**: **The Data Engineer** will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities**: - Optimize and enhance...
-
Data Engineer
5 months ago
مصر, Egypt Opinov8 Technology Services Full time**WE ARE** Opinov8 is a technology service provider, with an **Opinion in Innovation**, we engage with our clients at any stage in their product engineering and innovation goals, with solutions being mainly collaborative and outcome-driven. We are driven by delivering **value**, for our clients, through **technological innovation**. We are a young...
-
Data Engineer
5 months ago
مصر, Egypt Giza Systems EG Full timeGathering the ETL/ELT requirements. - Design, Develop, Test ETL/ELT different scenarios and support the ETL/ELT processes to Extract, Transforming and Loading data from different sources to the data warehouse. - Create and maintain optimal integration solutions including data pipeline architecture. - Analyze multiple sources of structured and unstructured...
-
Data Engineer
5 months ago
مصر, Egypt Envision Employment Solutions Full timeEnvision Employment Solutions is currently looking for a Data Engineer for one of our partners, a multinational bank. **Responsibilities**: - Database Development: Develop stored procedure, views, functions, partitions, etc., using SQL Server. - ETL Development: Develop, code, test, and debug using SSIS ETL (SQL Server Integration Services). Translate...
-
Data Engineer
5 months ago
مصر, Egypt Evolvice GmbH Full timeLocation: Egypt / Cairo - Employment Type: Full Time - Job ID: 33695 **Who we are**: Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital...
-
Senior Data Engineer
5 months ago
مصر, Egypt Giza Systems EG Full timeDesign, develop, and maintain scalable and robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake. - Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and ensure efficient data integration and data...
-
Senior Data Engineer
5 months ago
مصر, Egypt FlairsTech Full timeDetails Required Experience +4 years Department Digital Solutions Career Level Position Location Cairo **Skills**: - Data Warehousing Data management Data Integration Requirements and responsibilities **Role Objectives**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into...
-
Data Engineer-octopus
5 months ago
مصر, Egypt robusta Full timeRobusta is currently seeking a talented Data Engineer to join Octopus, our business unit at Robusta Technology Group that matches tech talents with remote or onsite opportunities worldwide. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines and infrastructure. You will be working...
-
Data Engineer
6 months ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Data Engineer
5 months ago
مصر, Egypt Shift EV Full timeABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...
-
Data Engineer
5 months ago
مصر, Egypt NorthBay Solutions Full time**Our Tech Stack**: - ** Languages**: SQL & Python - ** Pipeline Orchestration Tool**: Dagster (Legacy: Airflow) - ** Data Stores**: Snowflake, Clickhouse - ** Platforms & Services**: Docker, Kubernetes - ** PaaS**: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others) - ** ETL**: FiveTran & DBT for transformation - ** IaC**: Terraform (with...
-
Data Engineer
6 months ago
مصر, Egypt elmenus technologies Full timeelmenus is a venture-backed food discovery startup based in Egypt that serves over 1 Million monthly users. We are building a platform that combines a social, visual, and personalized experience to help people discover and order the food they will love. We received a 1.5 Million USD in venture capital in mid-2017 to help us grow faster in the huge global...
-
Big Data Engineer
5 months ago
مصر, Egypt Rackspace Full timeOur Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering...
-
Ibm Data Engineer
5 months ago
مصر, Egypt IBM Full timeIntroduction IBM Systems Expert Labs is a Professional Services Team under IBM Technology Expert Labs. IBM Technology Expert Labs has the proven expertise to help leaders plan, design and implement the essential IT infrastructure for what comes next. We offer a wide range of IT infrastructure services for IBM Power Systems, IBM Z® and IBM LinuxONE...