Big Data Engineer

2 weeks ago


Mansoura, Egypt Integrant Full time

We are Hiring

Integrant is looking for game changers to join us as " Big Data Engineers" with below responsibilities and benefits:
**Responsibilities**:

- Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, HBase, MapR, Cloudera)
- Contribute to multiple data solutions throughout their entire lifecycle (conception to launch)
- Partner with business stakeholders to understand and meet their data requirements
- Design, build, and maintain machine learning data pipelines
- Participate in an Agile development environment Cloud/AWS
- Collect, store, process, and support the analysis of huge sets of data, both structured and unstructured
- Choosing optimal solutions to use in big data use cases, then maintain, implement, monitor and integrate them with the data and IT architecture used across the company
- Build and teach the company about big data technologies, participate actively in the journey setup, from the discovery phase until the corporate data-centric transformation

**Requirements**:

- Bachelor’s degree in Computer Science, Engineering, or Information Management (or equivalent)
- 5+ years of professional experience, preferred in development.
- 3+ years of building data pipelines experience or equivalent
- Professional experience optimizing machine learning workflows and maintaining data pipelines
- Hands-on experience with Cloudera and Hadoop is a must
- Experience with Spark, HBase, MapR and machine learning technologies is a plus
- Experience with object-oriented scripting languages: Python / Scala
- Experience with Eco-Systems Kafka, Impala and kudu is a must
- Advanced knowledge of SQL and experience with relational databases
- Experience with UNIX shell scripts and commands
- Experience with version control (Git / GitHub)
- Ability to clearly document operational procedures and solution designs
- Ability to communicate effectively (both verbal and written)
- Ability to work collaboratively in a team environment
- Ability to balance competing priorities and expectations.

**Benefits**
- Why Integrant?
- Competitive compensation package
- PTO, full medical and dental coverage, etc.
- Opportunity to travel and work onsite with U.S. customers
- In-house Technical and English training programs
- Dedicated learning time (check out our 4Plus1 Program) [link]
- Interest free loans
- Flexible work schedules
- Perks: events, sponsored lunch, game area, rooftop hangout + more



  • Mansoura, Egypt Orange Egypt Full time

    **Purpose of the job** As a data engineer youll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and responsibilities** - Identifying data ingestion...


  • Mansoura, Egypt Orange Egypt Full time

    **Purpose of the job** As a data platform development senior engineer you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. You will be working with the team on problems involving large scale...

  • Data Lead Engineer

    1 week ago


    Mansoura, Egypt Shift EV Full time

    Who we are: Shift EV is a fast-growing electric vehicle technology company, based in Cairo, Egypt. Our vision is to accelerate the adoption of electric vehicles in Egypt and the region by developing state-of-the-art electric drivetrain solutions. You will work with world-class technology veterans from MIT, the University of Grenoble, Intel, and Corning to...

  • Software Engineer

    2 weeks ago


    Mansoura, Egypt Canonical - Jobs Full time

    Canonical is building a comprehensive automation suite to deliver a multi-cloud and on-premise data solution for the enterprise, which spans the full range of data stores and data technologies from big data, with Yugabyte, Spark and Kafka, through NoSQL and cache-layer capabilities like Redis, MongoDB and Opensearch, all the way to structured SQL engines...


  • Mansoura, Egypt Orange Egypt Full time

    **Purpose of the job** Building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. **Duties and responsibilities** 1. Contribute in executing team plans according to the department strategic vision. 2. Provide strong technical contribution with a focus on quality,...


  • Mansoura, Egypt Microsoft Full time

    We are looking for passionate, creative, and analytical engineers who love machine learning, data analytics, and shipping technology with agility at massive scale. For this position, we are hiring machine learning and data engineers to work on the data engineering and mining team of GitHub Copilot. **Responsibilities**: - Build highly scalable and secure...

  • Data Engineer

    2 days ago


    Mansoura, Egypt Qsource Business Services Full time

    Qsource is hiring Data Engineer for a well-known company working in the Financial Solution field located in 6th October City. Working Hours: 9 to 5 Day off: Friday, Saturday Duties: Working on developing data pipelines, ETL jobs, automation, data preparation; - Analyzing user requirements and translating them into Data Engineering problems; - Designing,...


  • Mansoura, Egypt Orange Egypt Full time

    **Purpose of the job** As a Data Lake operations support specialist you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware, software solutions and workflows. You will be working...

  • Data Scientist

    2 weeks ago


    Mansoura, Egypt MaxAB Full time

    Founded in 2018, MaxAB is a rapidly growing food and grocery B2B e-commerce and distribution platform that serves a network of traditional retailers (mom-and-pop stores) across the MENA region. Using proprietary technology, MaxAB offers a transformative pull-driven supply chain and a tech-product that empowers both traditional retailers and suppliers. MaxAB...


  • Mansoura, Egypt Orange Business Services Full time

    Responsible for data integrity of customer information in all systems/tools - Ensures all technical documentations are posted and updated. - Agree handover documentation requirements with key stakeholders and that key activities and deliverables are incorporated in the programme plan to meet the overall programme objectives - Manage and create the production...


  • Mansoura, Egypt Dell Technologies Full time

    Software Senior Engineer - Data & AI Pipelines (Telecom Co-innovation) We are looking for talented, driven, self-starter individuals to join our Telecom Co-innovation Expert Centre in the Telecom Systems Business Engineering organization. About business unit and team The Telecom Systems Business creates products and solutions catering for the worldwide...


  • Mansoura, Egypt Careem Full time

    **About Careem** Careem is the everyday Super App for the greater Middle East region, providing a host of daily services that people need to move around, order food, deliver things and transfer money in one unified smartphone app. Careem's mission is to simplify and improve the lives of people and build an awesome organization that inspires. Established in...


  • Mansoura, Egypt Orange Egypt Full time

    **Purpose of the job**: **Duties and responsibilities** - Develop and implement data collection systems and other strategies and processes that optimize statistical efficiency and data quality - Identify, analyze, and interpret trends or patterns in complex data sets which could indicate possible quality problems/issues and advise on possible resolutions. -...

  • Data Scientist

    1 day ago


    Mansoura, Egypt Giza Systems EG Full time

    **Responsibilities**: - Selecting features, building and optimizing classifiers using machine learning techniques - Data mining using state-of-the-art methods - Extending company’s / customers’ data with third party sources of information when needed - Enhancing data collection procedures to include information that is relevant for building analytic...

  • Data Intern, Cairo

    2 weeks ago


    Mansoura, Egypt Elite Recruitment Group Full time

    ABOUT THE COMPANY YOUR DUTIES The intern will be performing a variety of data-related tasks (“all rounder”) rather than being specialized in a specific data discipline. Such tasks will include: 1. Cleaning datasets (Python, Excel, or manually) 2. Updating database records 3. Working on the quality control of the data 4. Helping with data migration /...


  • Mansoura, Egypt Orange Business Full time

    **About the role**: **Key result / decision areas (outcomes)** - Have ownership on creation of deliverables (System Design and Installation, Platform configuration, Development and Production Deployment following testing process- Support on proposals/projects technical architecture blueprints based on AI software vendor’s specifics- Develop scalable...


  • Mansoura, Egypt Siemens Full time

    **Siemens Digital Industries Software - Where today meets tomorrow.** Let's make the difference together! **Meet the team - **Video** Siemens DISW is a global technology powerhouse. With some of the best-known brands in the world, Siemens has stood for engineering excellence, innovation, quality, and reliability for more than 165 years. The **Digital...

  • Data Architect vois

    2 weeks ago


    Mansoura, Egypt Vodafone Full time

    Role purpose: - Working on the D&A transformation programme to migrate all D&A data to Google Cloud across our Operating companies across Europe. You will be part of the workstream which delivers end-reporting to the Local Market D&A teams, and thereby enabling the decommissioning of the legacy reporting stack and on-premise data warehouses, with the help...


  • Mansoura, Egypt Orange Egypt Full time

    **Purpose of the job**: **Duties and responsibilities** - Develop and implement data collection systems and other strategies and processes that optimize statistical efficiency and data quality - Identify, analyze, and interpret trends or patterns in complex data sets which could indicate possible quality problems/issues and advise on possible resolutions. -...

  • Data Scientist

    7 months ago


    Mansoura, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...