Senior Supervisor, Data Engineer
22 hours ago
About the job Senior Supervisor, Data Engineer
**Purpose of the job**
Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the Data Warehouse, including all DWH stakes, DWH model, CLDM layer and PL layer. Assures the data management, integration & quality standards, and processes of the data engineering workflow are all met.
**Duties and responsibilities**
- Analyze new business integration needs, fully understand the requirements and perform the required technical analysis to accommodate the new requirements.
- Perform the required development for DWH model to achieve the targeted business needs which include model structure updates, ETL/ELT job load, PL layer jobs modification.
- Implement the right controls to maintain the DWH quality as per the standard Specs and continuously update these quality control checks.
- Work closely with DWH BI analyst to ensure correct and consistent mapping criteria between sources and DWH databases.
- Coordinate with data operations and administrators (system and database) to ensure the best performance monitoring and tuning.
- Optimize data integration platform to provide optimal performance under increasing data volumes.
- Build data pipelines,Analyze and organize data,Build data ingestion scripts/workflows, and Perform quality checks on data
- Drive integration projects from idea formulation, through design and implementation collaborating with partner teams.
- Participate in vendors technical requirements, gap analysis and RFPs
- Support technical decision making in the area of Big Data eco-system and data platform architecture and relevant migration use cases
- Collaborate with data scientists, BI analysts, modelers and IT team members on project goals.
- Monitor and optimize the performance of data platform systems and computing infrastructure.
**Job Specifications**:
**Education**
- Bachelor degree of Engineering in Computer Systems, or Computer Science.
**Experience**
- 5-8 years of hands-on Data engineering, ETL development, and Data Modeling experience
- Solid experience with IBM datastage and Teradata DWH tools/Models is a plus.
- At least 3 years of experience of, managing, designing, programming, administering, and tuning complex conversions moving data from multiple disparate Source Databases into separate/different Data Models
- Extensive experience using and tuning SQL
- Project management experience is a plus
- Expereince working in a big data/ Datalake environment and using big data tools ( NiFi, Airflow, spark, Hive, Kafka, etc )
- Experience with data infrastructure as a code, automation and DevOps practices.
- Excellent understanding of systems design patterns
- Past experience in telecom operators and service providers is preferred.
**Skills and abilities**
- Very good English both written & spoken.
- Excellent collaboration and communication skills and comfortable working across multiple teams.
- Strong hands-on skill, can drill deep into complex systems design and implementation.
- Strong problem solving and troubleshooting skills.
- Excellent knowledge of IBM DataStage and BI solutions
- Excellent programming and debugging skills.
- Excellent systems administration skills.
-
Senior Supervisor, Big Data Modeler
6 days ago
مصر, Egypt اورنچ مصر Full timeAbout the job Senior Supervisor, Big Data Modeler **Purpose of the job** As a data engineer youll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties...
-
Senior Data Engineer
22 hours ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...
-
Sr. Supervisor, Data Architect
2 weeks ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Architect **Purpose of the job** - As a solution architect you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance CVM data engineering pipelines, computing and data storage platform that underpins the diverse workloads running on data lake infrastructure. - You will...
-
Data Quality Engineer, Sr. Supervisor
6 days ago
مصر, Egypt اورنچ مصر Full timeAbout the job Data Quality Engineer, Sr. Supervisor **Purpose of the job**: **Duties and responsibilities** - Develop and implement data collection systems and other strategies and processes that optimize statistical efficiency and data quality - Identify, analyze, and interpret trends or patterns in complex data sets which could indicate possible quality...
-
Senior Data Engineer
22 hours ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake preprocessing of structured and unstructured data. - Build the infrastructure required for optimal...
-
Senior Data Engineer
6 days ago
مصر, Egypt Vezeeta Full time**About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...
-
Supervisor, Data Quality
6 days ago
مصر, Egypt اورنچ مصر Full timeAbout the job Supervisor, data Quality **Purpose of the job**: **Duties and responsibilities** - Develop and implement data collection systems and other strategies and processes that optimize statistical efficiency and data quality - Identify, analyze, and interpret trends or patterns in complex data sets which could indicate possible quality...
-
Senior Data Engineer
3 weeks ago
مصر, Egypt Beinex Full timeBeinex is looking for the best-in-class Data Engineer for its office in Egypt. **Responsibilities**: - Work with business requirements analysts to identify and solve business problems - Design and maintain cloud on-premises, and hybrid data platform architectures - Identify, design and implement full data warehouse and Big Data solutions - Design and...
-
Senior Data Engineer
4 days ago
مصر, Egypt Siemens Healthineers Full timeSiemens Industry Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly, the global leader in intelligent asset management solutions, enables organizations to transform the...
-
Senior Data Engineer
2 days ago
مصر, Egypt Nile Bits Full timeAs a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...
-
Senior Research Analyst
4 days ago
مصر, Egypt International Data Group, Inc. Full timeOverview: IDC is looking for a research professional to join our Data & Analytics team in Cairo, Egypt as a Senior Research Analyst to support our software research business and emerging technologies such as Cloud, Big Data Analytics (BDA), Artificial Intelligence (AI), IT Services, Security software, etc. **Responsibilities**: - Collect and analyze data...
-
Senior Data Engineer
4 days ago
مصر, Egypt Talent Pal Full timeWe are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...
-
Senior Data Engineer
22 hours ago
مصر, Egypt Plugin Talents Full time**About the job Senior data Engineer**: **Job Description**: - Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management - Strong ability to design, build and manage data pipelines for data structures encompassing data...
-
Senior Data Intelligence Engineer
4 days ago
مصر, Egypt Arrow Electronics, Inc. Full timePosition: Senior Data Intelligence Engineer **Job Description**: The employee also responds to ad-hoc reporting and analytics tasks for higher management, and indirectly support customer requests through the market intelligence team. Responsibilities and Duties: - Design, build, test and maintain internal market intelligence software products - Assist in...
-
Senior Data Engineer
6 days ago
مصر, Egypt Integrant Full time**Integrant Inc, is hiring a passionate and organized "Senior Data Engineer / AWS" to join us as part timer to support with below roles and responsibilities**: - Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (PostgreSQL RDS, DynamoDB, S3, Kinesis Data Streams and...
-
Senior Data Ops
3 weeks ago
مصر, Egypt DXC Technology Full time**As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...
-
Senior Software Engineer
22 hours ago
مصر, Egypt Procore Full timeThis is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...
-
Sr. Supervisor, Data Platform Developer
6 days ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Platform Developer **Purpose of the job** Building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. **Duties and responsibilities** 1. Contribute in executing team plans according to the department strategic vision. 2. Provide strong...
-
Sr. Supervisor, Data Platform Developer
22 hours ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Platform Developer **Purpose of the job** Building an elastic, high performance computing and storage platform that underpins the diverse workloads running on data lake infrastructure. **Duties and responsibilities** 1. Contribute in executing team plans according to the department strategic vision. 2. Provide strong...
-
Sr. Supervisor, Data Lake DevOps
6 days ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Lake DevOps **Purpose of the job** As a Data Lake operations support specialist you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware,...