Senior Data Engineer

6 months ago


مصر, Egypt Talent Pal Full time

We are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams
- Technologies
- Python (fastapi, cython, scipy, Scikit-learn, Seaborn )
- Spark(Pyspark or Scala)
- Big data Tools
- Databases (SQL,NoSQL) Data warehouse
- Responsibilities
- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data sources, volume and complexity.
- Data manipulation and cleansing
- Operate and optimize AI solutions
- Act as focal point between AI Software Engineering and Data sources
- Data Modelling and Platforming for analytics
- Develop, construct, test and maintain architectures
- Align architecture with business requirements
- Deploy sophisticated analytics programs, machine learning and statistical methods
- Prepare data for predictive and prescriptive modeling
- Find hidden patterns using data
- Use data to discover tasks that can be automated Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
- Job Requirements
- BSc or Advanced degree in Data Science, Data Engineering, Statistics, Computer Science, or similar.
- Master Degree in a related field is a plus
- At least 3-5 years of experience in a similar position or in a Data engineering Role
- Experience With a Big Data & Hadoop Ecosystem, with experience in data profiling and transformations
- Experience with PySpark core, or PySpark SQL, and PySpark Dataframe
- Experience with core Java (and/or Scala, Python)
- Experience with NoSQL databases such as HBase, Cassandra, or MongoDB
- Experience with SQL databases
- Proficient in designing efficient and robust ETL/ELT workflows, schedulers, and event-based triggers
- Strong critical thinking, decision making, and problem-solving skills
- Excellent verbal/written communication skills, including communicating technical issues to non-technical audiences
- Exposure to Spark Streaming and Machine Learning
- Exposure to Data Mining, Data Engineering, and Data Modeling
- Exposure to Graph Databases


  • Senior Data Engineer

    5 months ago


    مصر, Egypt Shift EV Full time

    ABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...

  • Senior Data Engineer

    7 months ago


    مصر, Egypt Talent Pal Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your...

  • Senior Data Engineer

    5 months ago


    مصر, Egypt Nile Bits Full time

    **Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...

  • Senior Data Engineer

    5 months ago


    مصر, Egypt Nile Bits Full time

    As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...


  • مصر, Egypt اورنچ مصر Full time

    About the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...


  • مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...


  • مصر, Egypt Procore Full time

    This is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...

  • Senior Data Ops

    7 months ago


    مصر, Egypt DXC Technology Full time

    **As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...

  • Senior Data Engineer

    5 months ago


    مصر, Egypt Giza Systems EG Full time

    Design, develop, and maintain scalable and robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake. - Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and ensure efficient data integration and data...

  • Senior Data Engineer

    5 months ago


    مصر, Egypt FlairsTech Full time

    Details Required Experience +4 years Department Digital Solutions Career Level Position Location Cairo **Skills**: - Data Warehousing Data management Data Integration Requirements and responsibilities **Role Objectives**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into...

  • Senior Data Scientist

    5 months ago


    مصر, Egypt Raisa Energy Full time

    We are looking for a **Senior **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil...

  • Senior Data Analyst

    5 months ago


    مصر, Egypt ITWORX Full time

    Career Level: **Early Career** - Employment Type: **Full time** - Function: **Operational Excellence** **Senior Data Analyst**: Bachelor of Engineering, Computer Science, Business Informatics or any related From 3-5 years of relevant experience. Knowledge of data visualization software like Power BI. Excellent Excel and power point skills. Have high...

  • Senior Data Engineer

    5 months ago


    مصر, Egypt DXC Technology Full time

    **Job Summary**: **The Data Engineer** will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities**: - Optimize and enhance...

  • Data Engineer

    5 months ago


    مصر, Egypt Evolvice GmbH Full time

    Location: Egypt / Cairo - Employment Type: Full Time - Job ID: 33695 **Who we are**: Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital...


  • مصر, Egypt Orange Full time

    **key result / decision areas (outcomes) Work closely with your business to identify issues and use data to propose solutions for effective decision making and drive business insights Mine and analyze data from company databases to drive optimization and improvement of product development, marketing techniques and business strategies Maintain clear and...

  • Senior Data Engineers

    6 months ago


    مصر, Egypt DXC Technology Full time

    **Job Summary** The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities** - Optimize and enhance data...

  • Data Scientist

    5 months ago


    مصر, Egypt Raisa Energy Full time

    We are looking for a **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil and gas...

  • Senior Data Scientist

    5 months ago


    مصر, Egypt Ericsson Full time

    **About this opportunity.** As a Senior Data Scientist, you'll be responsible for developing scientific methods, processes, and systems to extract knowledge or insights to drive the future of applied analytics. Provide thought leadership, perform Sophisticated Statistical Analytics, and build insights into data to deliver to the business useful insights,...


  • مصر, Egypt Teradata Full time

    What You’ll Do In this position you will play a key role in designing, implementing, and optimizing data infrastructure and pipelines. You should have a deep understanding of data engineering principles, possess excellent programming skills in Python and SQL, and have a strong grasp of modeling concepts. Who You’ll Work With The Teradata Core...

  • Senior Data Annotator

    5 months ago


    مصر, Egypt Dawarha Full time

    **About us**: Dawarha is at the forefront of the recycling movement, pioneering an innovative social recycling platform that combines AI-based Reverse Vending technology with a user-friendly mobile app. We proudly introduced this groundbreaking concept to the Egyptian market and the broader MENA region. As a subsidiary of the visionary Mind-Blowing company,...