Data Engineer
7 months ago
**Job Summary**:
**The Data Engineer** will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.
**Duties and Responsibilities**:
- Optimize and enhance data processing performance by identifying and resolving performance issues.
- Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks.
- Utilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiency.
- Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing.
- Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement.
- Participate in managing and monitoring data security and access anomalies.
- Document and keep up to date procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions.
**Requirements and Qualifications**:
- ** Must have from 3 years of experience in data engineering**:
- Cloud computing platforms: AWS/Azure/GCP
- Experience in data integration **(ETL/ELT)** development using **Python**, PySpark, and SparkSQL.
- Data warehouse technologies: Redshift/Snowflake/BigQuery
- Data lake technologies: Hadoop, Spark, and Hive
- Orchestration: Airflow/Control-M/(Any Orchestration tool)
- Machine learning frameworks: TensorFlow, PyTorch, and sci-kit-learn
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills
- Excellent English communication
-
Data Engineer
6 months ago
مصر, Egypt ArabyAds Full timeWe are seeking a skilled and experienced Data Engineer to join our expanding data team at our digital marketing/adtech company. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure on AWS. In addition to strong data engineering skills, you should have experience with DevOps, ensuring scalability,...
-
Data Engineer
6 months ago
مصر, Egypt Envision Employment Solutions Full time**Job Summary**: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure and systems that support the organization's data-driven initiatives. **Responsibilities**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load large volumes of data from various...
-
Data Engineer
6 months ago
مصر, Egypt Appgain.io Full timeWe are searching for a talented and passionate Data Engineer to join our growing team! You will play a critical role in designing, building, and maintaining the data infrastructure that supports our data-driven initiatives. You will work closely with data scientists, analysts, and software engineers to ensure our data is clean, accessible, and ready for...
-
Data Engineer
6 months ago
مصر, Egypt Nawy Real Estate Full time**As a Data Engineer at Nawy, you will hold a pivotal role in designing, implementing, and maintaining data pipelines and infrastructure to support the organization's data needs. Additionally, you will play a key role in data management, ensuring data quality, integrity, and modeling. We are seeking an individual with a strong technical background, hands-on...
-
Data Engineer
6 months ago
مصر, Egypt Nawy Real Estate Full timeJob Responsibilities: - Data Pipeline Development: Design, develop, and maintain efficient and reliable data pipelines to collect, process, and transform raw data from various sources into usable formats for analysis. - Designing, implementing, and maintaining data pipelines that move data from various sources to the appropriate storage solution all while...
-
Data Engineer
6 months ago
مصر, Egypt Opinov8 Technology Services Full time**WE ARE** Opinov8 is a technology service provider, with an **Opinion in Innovation**, we engage with our clients at any stage in their product engineering and innovation goals, with solutions being mainly collaborative and outcome-driven. We are driven by delivering **value**, for our clients, through **technological innovation**. We are a young...
-
Data Engineer
6 months ago
مصر, Egypt Envision Employment Solutions Full timeEnvision Employment Solutions is currently looking for a Data Engineer for one of our partners, a multinational bank. **Responsibilities**: - Database Development: Develop stored procedure, views, functions, partitions, etc., using SQL Server. - ETL Development: Develop, code, test, and debug using SSIS ETL (SQL Server Integration Services). Translate...
-
Data Engineer
6 months ago
مصر, Egypt Evolvice GmbH Full timeLocation: Egypt / Cairo - Employment Type: Full Time - Job ID: 33695 **Who we are**: Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital...
-
Senior Data Engineer
6 months ago
مصر, Egypt FlairsTech Full timeDetails Required Experience +4 years Department Digital Solutions Career Level Position Location Cairo **Skills**: - Data Warehousing Data management Data Integration Requirements and responsibilities **Role Objectives**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into...
-
Data Engineer-octopus
6 months ago
مصر, Egypt robusta Full timeRobusta is currently seeking a talented Data Engineer to join Octopus, our business unit at Robusta Technology Group that matches tech talents with remote or onsite opportunities worldwide. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines and infrastructure. You will be working...
-
Data Engineer
7 months ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Data Engineer
6 months ago
مصر, Egypt Shift EV Full timeABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...
-
Data Engineer
6 months ago
مصر, Egypt NorthBay Solutions Full time**Our Tech Stack**: - ** Languages**: SQL & Python - ** Pipeline Orchestration Tool**: Dagster (Legacy: Airflow) - ** Data Stores**: Snowflake, Clickhouse - ** Platforms & Services**: Docker, Kubernetes - ** PaaS**: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others) - ** ETL**: FiveTran & DBT for transformation - ** IaC**: Terraform (with...
-
Data Engineer
6 months ago
مصر, Egypt elmenus technologies Full timeelmenus is a venture-backed food discovery startup based in Egypt that serves over 1 Million monthly users. We are building a platform that combines a social, visual, and personalized experience to help people discover and order the food they will love. We received a 1.5 Million USD in venture capital in mid-2017 to help us grow faster in the huge global...
-
Big Data Engineer
6 months ago
مصر, Egypt Rackspace Full timeOur Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering...
-
Ibm Data Engineer
6 months ago
مصر, Egypt IBM Full timeIntroduction IBM Systems Expert Labs is a Professional Services Team under IBM Technology Expert Labs. IBM Technology Expert Labs has the proven expertise to help leaders plan, design and implement the essential IT infrastructure for what comes next. We offer a wide range of IT infrastructure services for IBM Power Systems, IBM Z® and IBM LinuxONE...
-
Lead Data Engineer
6 months ago
مصر, Egypt Integrant Full timeWe're on the lookout for exceptional individuals to join our team as **Lead Data Engineers**. As a part of our team, you'll be driving change and making a significant impact in the gaming industry. - Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies. - Engage in...
-
Principal Data Engineer
6 months ago
مصر, Egypt Integrant Full timeWe're on the lookout for exceptional individuals to join our team as **Principal Data Engineers**. As a part of our team, you'll be driving change and making a significant impact in the gaming industry. - Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies. - Engage in...
-
Senior Data Engineer
6 months ago
مصر, Egypt DXC Technology Full time**Job Summary**: **The Data Engineer** will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities**: - Optimize and enhance...
-
Senior Data Engineer
6 months ago
مصر, Egypt Nile Bits Full time**Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...