Data Engineer
2 days ago
**Job Summary**:
**The Data Engineer** will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.
**Duties and Responsibilities**:
- Optimize and enhance data processing performance by identifying and resolving performance issues.
- Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks.
- Utilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiency.
- Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing.
- Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement.
- Participate in managing and monitoring data security and access anomalies.
- Document and keep up to date procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions.
**Requirements and Qualifications**:
- ** Must have from 3 years of experience in data engineering**:
- Cloud computing platforms: AWS/Azure/GCP
- Experience in data integration **(ETL/ELT)** development using **Python**, PySpark, and SparkSQL.
- Data warehouse technologies: Redshift/Snowflake/BigQuery
- Data lake technologies: Hadoop, Spark, and Hive
- Orchestration: Airflow/Control-M/(Any Orchestration tool)
- Machine learning frameworks: TensorFlow, PyTorch, and sci-kit-learn
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills
- Excellent English communication
-
Data Engineer
2 days ago
مصر, Egypt Giza Systems EG Full timeDevelop and maintain data pipelines implementing ETL processes. - Take responsibility for data warehouses and data lakes (i.e. Hadoop, Elastic Stack and Spark) development and implementation. - Work closely with a data scientists implementing data analytic pipelines. - Help define data governance policies and support data versioning processes. - Maintain...
-
Data Engineer
4 days ago
مصر, Egypt Government Consulting Solutions, LLC Full timeWe are seeking a full-time Data Engineer in the Northern Virginia area to join our team. you will work with other motivated, talented individuals who inspire one another in a dynamic team environment. The position is an exciting opportunity to grow and be challenged in a role using cutting edge technologies to address exciting problems. **Key...
-
Data Engineer
4 days ago
مصر, Egypt AUMET Inc. Full timeAUMET is the leading B2B marketplace to sell medical products between healthcare providers and distributors. We are innovating how distributors of medical supplies do business with consumer selling points such as pharmacies. With 500,000 transactions per month, AUMET marketplace is a fast growing product that is capturing market share and is on a road to...
-
Data Engineer/data Modeler
2 weeks ago
مصر, Egypt Luxoft Full time**Project** Description**: One of our banking clients need Luxoft's expertise in designing and building a new data model to fit within their existing Data Warehouse The data will be sourced from a leading vendor platform and is focussed on Treasury data A data modeller is required to work as part on an agile team in delivering this **Responsibilities**: -...
-
Head of Data Engineering
1 week ago
مصر, Egypt b_labs Full timeThe Head of Data Engineering will lead the development and implementation of b_labs' data engineering strategy and oversee a team of data engineers. This role will play a crucial part in shaping the company's data infrastructure and collaborating with the Data Architect and Head of Analytics to drive data-driven decision-making across the organisation....
-
Data Engineer
1 week ago
مصر, Egypt Vodafone Full time**Role purpose**: The Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. **Key accountabilities and decision ownership**: - Build, test, monitor and maintain a highly scalable data...
-
Data Engineer
4 days ago
مصر, Egypt Evolvice GmbH Full timeLocation: Egypt / Cairo - Employment Type: Full Time - Job ID: 33695 **Who we are**: Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital...
-
Senior Data Engineer
1 week ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Principal Data Engineer
2 days ago
مصر, Egypt b_labs Full timeImagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Principal Data Engineer to join our Fintech squad. As a key member of our...
-
Staff Data Engineer
2 days ago
مصر, Egypt b_labs Full timeImagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Staff Data Engineer to join our Fintech squad. As a key member of our...