Ibm Data Engineer

2 weeks ago

مصر, Egypt IBM Full time

Introduction

IBM Systems Expert Labs is a Professional Services Team under IBM Technology Expert Labs.

IBM Technology Expert Labs has the proven expertise to help leaders plan, design and implement the essential IT infrastructure for what comes next. We offer a wide range of IT infrastructure services for IBM Power Systems, IBM Z® and IBM LinuxONE systems, and IBM Storage & Software Defined Infrastructure. Technology Expert Labs - Systems’ consultants perform IT infrastructure services for clients on site, helping them solve business challenges, gain new skills and discover best practices. Expert Lab has a global presence and can deploy its consultants around the world.
- As a Storage Consultant, the role involves providing specialised storage services around the world. The Expert Labs specialist is a highly skilled expert with a deep knowledge of IBM's Storage Software portfolio and hardware products
- The Expert Labs consultant assume overall technical responsibility for the success of solution construction, implementation and system integration in a technology, industry or business specialty
- You deliver new and complex high-quality solutions to clients in response to varying business requirements
- Exposure to Containers and Kubernetes technology
- Should be ready to travel (once or twice a month)

Your Role and Responsibilities

As an IBM data engineer, you will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. You will work closely with data architects, data scientists, and business analysts to understand data requirements, design data models, and implement solutions that optimize data ingestion, storage, and processing.

Key Responsibilities:
1. Data Pipeline Development: Develop and maintain data pipelines to ingest, transform, and load structured and unstructured data from various sources into data storage systems such as data lakes, data warehouses, and databases.

2. Data Modeling: Design and implement efficient data models to support analytical and operational needs, ensuring data integrity, accuracy, and consistency across different data sets.

3. Data Integration: Integrate data from multiple sources, including internal databases, external APIs, third-party data providers, and streaming data sources, using appropriate tools and technologies.

4. Data Processing: Implement data processing workflows using tools like Apache Spark, Hadoop, or IBM Cloud Pak for Data to perform ETL (Extract, Transform, Load) operations, data cleansing, and data enrichment.

5. Database Management: Manage and optimize databases, including relational databases (e.g., IBM Db2, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra), to ensure high performance, availability, and scalability.

6. Data Quality Assurance: Develop and implement data quality checks, validation rules, and monitoring processes to ensure data accuracy, completeness, and consistency over time.

7. Performance Tuning: Optimize data pipelines, queries, and processes for performance, scalability, and efficiency, leveraging techniques such as indexing, partitioning, and caching.

8. Collaboration: Collaborate with cross-functional teams, including data scientists, business analysts, software engineers, and stakeholders, to understand data requirements, prioritize tasks, and deliver data-driven solutions.

9. Documentation: Create and maintain documentation for data pipelines, data models, data dictionaries, and technical specifications to ensure transparency, repeatability, and knowledge sharing within the team.

Required Technical and Professional Expertise

1. Bachelor's or Master's degree in computer science, information technology, data engineering, or a related field.

2. Proficiency in programming languages such as Python, Java, Scala, or SQL for data manipulation, scripting, and automation.

3. Experience with data pipeline orchestration tools like Apache Airflow, IBM DataStage, or Informatica.

4. Strong knowledge of database management systems (DBMS), data warehousing concepts, and data modeling techniques.

5. Familiarity with big data technologies such as Apache Hadoop, Apache Spark, Kafka, and distributed computing frameworks.

6. Experience with cloud platforms like IBM Cloud, AWS, Azure, or Google Cloud Platform for data storage, processing, and analytics.

7. Excellent problem-solving skills, analytical thinking, and attention to detail in designing and troubleshooting data solutions.

8. Effective communication skills to collaborate with diverse teams, present technical findings, and explain complex concepts to non-technical stakeholders.

9. Ability to work independently, prioritize tasks, and adapt to changing project requirements in a dynamic environment.

Preferred Technical and Professional Expertise

1. Certification in data engineering or related technologies (e.g., IBM Certified Data Engineer, AWS Certified Data Analytics - Specialty).

2. Experi

  • Data Engineer-enterprise Content Management

    4 days ago

    مصر, Egypt IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Data Engineer

    2 days ago

    مصر, Egypt Alpha Data Recruitment Full time

    Development experience with at least two different database platforms, such as Snowflake, Teradata, Oracle, or MS SQL. - Exposure to Business Intelligence and ETL tools such as Azure Data Factory, SSIS, MicroStrategy, Tableau, Power BI, Talend, etc. - Experience tuning ETL processes to ensure performance and reliability. - Strong SQL skills. - Experience in...

  • Site Reliability Engineer

    1 week ago

    مصر, Egypt IBM Full time

    Introduction management tasks more efficiently. We’re seeking skilled, automation-focused Network Engineers to maintain and administer the Power Virtual Server Cloud Infrastructure-as-a-Service environment and provide reliable and secure network operations. The Network Infrastructure Operations Site Reliability Engineer works with clients to...

  • Technical Account Manager Specialist

    2 weeks ago

    مصر, Egypt IBM Full time

    **Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's...

  • Senior Ibms Consultant

    1 week ago

    مصر, Egypt Orange Business Full time

    **About the role**: As iBMS (integrated buildings management system) consultant you will be responsible for Providing technical related consultancy and systems engineering in the field of building automation, building management systems, and energy management & analytics. The role will be responsible for delivering projects and services to Orange...

  • Government Business Development Executive

    4 days ago

    مصر, Egypt IBM Full time

    **Introduction** A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change...

  • Senior Data Integration Engineer

    2 days ago

    مصر, Egypt Teradata Full time

    What You’ll Do In this position you will play a key role in designing, implementing, and optimizing data infrastructure and pipelines. You should have a deep understanding of data engineering principles, possess excellent programming skills in Python and SQL, and have a strong grasp of modeling concepts. Who You’ll Work With The Teradata Core...

  • Application Developer

    22 hours ago

    مصر, Egypt IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Package Consultant SAP Hana Fin Fi

    2 weeks ago

    مصر, Egypt IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Package Consultant: SAP Fin Fi

    1 week ago

    مصر, Egypt IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Senior SAP Fin Fi Consultant

    7 days ago

    مصر, Egypt IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Senior SAP Fin Fi Consultant

    22 hours ago

    مصر, Egypt IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Big Data Team Lead

    5 days ago

    مصر, Egypt Digital Talent MENA Full time

    Cairo, Egypt **Software** Digital Talent is hiring for one of our Clients the role of BIG Data Team Lead. Our Client is one of the leading Software companies in the financial sector in the MENA Region. About this role: This role will Create and manage the company’s Big Data infrastructure and tools, and knows how to get results from vast amounts of data...

  • Business Analyst: Adm

    1 week ago

    مصر, Egypt IBM Full time

    Introduction Your Role and Responsibilities Required Technical and Professional Expertise - Experience as a senior Business Analyst in the area of Digital Transition in PA Entities - Good understanding of the business needs of the organization - Ability to interact with client’s SME in order to define business objectives and gather business...

  • Data Engineer

    1 week ago

    مصر, Egypt On-Hire Full time

    Our Client is the largest digital classifieds and marketplace in Sudan. We need a self-driven leader who can execute quickly in a startup environment. You will have freedom and responsibility as the first person in that role. Your work will help us make better business decisions thanks to your insights visualized using dashboards. You will collaborate...

  • Head of Data Engineering

    22 hours ago

    مصر, Egypt b_labs Full time

    The Head of Data Engineering will lead the development and implementation of b_labs' data engineering strategy and oversee a team of data engineers. This role will play a crucial part in shaping the company's data infrastructure and collaborating with the Data Architect and Head of Analytics to drive data-driven decision-making across the...

  • Data Engineer

    2 days ago

    مصر, Egypt Giza Systems EG Full time

    Develop and maintain data pipelines performing ETL processes. - Work closely with data scientists and software developers to implement pipelines performing advanced - analytics including machine learning models. - Selecting features, building and optimizing pipelines using machine learning supervised and - unsupervised techniques - Extending company’s /...

  • Data Engineer/data Modeler

    4 days ago

    مصر, Egypt Luxoft Full time

    **Project** Description**: One of our banking clients need Luxoft's expertise in designing and building a new data model to fit within their existing Data Warehouse The data will be sourced from a leading vendor platform and is focussed on Treasury data A data modeller is required to work as part on an agile team in delivering this **Responsibilities**: -...

  • Data Engineer

    7 days ago

    مصر, Egypt AlGooru Full time

    **AlGooru is hunting for the next generation of BizOps talents!** **We’re looking for a Data Engineer** **A bit about us** **Main responsibilities** - Data Quality Assurance: Identifying and eliminating anomalies by means of data profiling and cleansing. - Data Integration and Consolidation: Bringing information together from multiple systems into a...

  • Data Engineer

    22 hours ago

    مصر, Egypt Vodafone Full time

    **Role purpose**: The Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. **Key accountabilities and decision ownership**: - Build, test, monitor and maintain a highly scalable data...