Senior Data Engineer

5 days ago


مصر, Egypt Talent Pal Full time

We are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams
- Technologies
- Python (fastapi, cython, scipy, Scikit-learn, Seaborn )
- Spark(Pyspark or Scala)
- Big data Tools
- Databases (SQL,NoSQL) Data warehouse
- Responsibilities
- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data sources, volume and complexity.
- Data manipulation and cleansing
- Operate and optimize AI solutions
- Act as focal point between AI Software Engineering and Data sources
- Data Modelling and Platforming for analytics
- Develop, construct, test and maintain architectures
- Align architecture with business requirements
- Deploy sophisticated analytics programs, machine learning and statistical methods
- Prepare data for predictive and prescriptive modeling
- Find hidden patterns using data
- Use data to discover tasks that can be automated Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
- Job Requirements
- BSc or Advanced degree in Data Science, Data Engineering, Statistics, Computer Science, or similar.
- Master Degree in a related field is a plus
- At least 3-5 years of experience in a similar position or in a Data engineering Role
- Experience With a Big Data & Hadoop Ecosystem, with experience in data profiling and transformations
- Experience with PySpark core, or PySpark SQL, and PySpark Dataframe
- Experience with core Java (and/or Scala, Python)
- Experience with NoSQL databases such as HBase, Cassandra, or MongoDB
- Experience with SQL databases
- Proficient in designing efficient and robust ETL/ELT workflows, schedulers, and event-based triggers
- Strong critical thinking, decision making, and problem-solving skills
- Excellent verbal/written communication skills, including communicating technical issues to non-technical audiences
- Exposure to Spark Streaming and Machine Learning
- Exposure to Data Mining, Data Engineering, and Data Modeling
- Exposure to Graph Databases



  • مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...


  • مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake preprocessing of structured and unstructured data. - Build the infrastructure required for optimal...


  • مصر, Egypt Vezeeta Full time

    **About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...

  • Senior Data Engineer

    3 weeks ago


    مصر, Egypt Beinex Full time

    Beinex is looking for the best-in-class Data Engineer for its office in Egypt. **Responsibilities**: - Work with business requirements analysts to identify and solve business problems - Design and maintain cloud on-premises, and hybrid data platform architectures - Identify, design and implement full data warehouse and Big Data solutions - Design and...


  • مصر, Egypt Siemens Healthineers Full time

    Siemens Industry Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly, the global leader in intelligent asset management solutions, enables organizations to transform the...


  • مصر, Egypt Nile Bits Full time

    As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...

  • Senior Data Engineer

    17 hours ago


    مصر, Egypt Nile Bits Full time

    **Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...


  • مصر, Egypt International Data Group, Inc. Full time

    Overview: IDC is looking for a research professional to join our Data & Analytics team in Cairo, Egypt as a Senior Research Analyst to support our software research business and emerging technologies such as Cloud, Big Data Analytics (BDA), Artificial Intelligence (AI), IT Services, Security software, etc. **Responsibilities**: - Collect and analyze data...


  • مصر, Egypt Plugin Talents Full time

    **About the job Senior data Engineer**: **Job Description**: - Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management - Strong ability to design, build and manage data pipelines for data structures encompassing data...


  • مصر, Egypt Arrow Electronics, Inc. Full time

    Position: Senior Data Intelligence Engineer **Job Description**: The employee also responds to ad-hoc reporting and analytics tasks for higher management, and indirectly support customer requests through the market intelligence team. Responsibilities and Duties: - Design, build, test and maintain internal market intelligence software products - Assist in...


  • مصر, Egypt Integrant Full time

    **Integrant Inc, is hiring a passionate and organized "Senior Data Engineer / AWS" to join us as part timer to support with below roles and responsibilities**: - Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (PostgreSQL RDS, DynamoDB, S3, Kinesis Data Streams and...


  • مصر, Egypt اورنچ مصر Full time

    About the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...

  • Senior Data Ops

    3 weeks ago


    مصر, Egypt DXC Technology Full time

    **As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...


  • مصر, Egypt Procore Full time

    This is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...


  • مصر, Egypt Homzmart Full time

    Company Description **Homzmart** is an end to end community that connects home professionals with homeowners who can browse home designs, furniture, accessories and products and also can find reviews, referring professionals, take advice from professionals and read articles about home improvement. **Job Description**: What you’ll be doing: - Build a new...

  • Senior Data Engineers

    2 weeks ago


    مصر, Egypt DXC Technology Full time

    **Job Summary** The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities** - Optimize and enhance data...

  • Senior Data Engineer

    3 weeks ago


    مصر, Egypt Centro CDx Full time

    Analyze, Design, and Develop BI\Datawarehouse-related enhancements - Support BI\Datawarehouse solution performance enhancements - Support BI\Datawarehouse deployment - Perform root cause analyses for common CRM problems and create fixing plans - Support in BI solution testing, training, and adaptation - Support domain architects in capturing solution key...

  • Staff Data Engineer

    7 days ago


    مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...


  • مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...


  • مصر, Egypt b_labs Full time

    Imagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Principal Data Engineer to join our Fintech squad. As a key member of our...