Senior Supervisor, Data Engineer
2 weeks ago
**Purpose of the job**
Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the Data Warehouse, including all DWH stakes, DWH model, CLDM layer and PL layer. Assures the data management, integration & quality standards, and processes of the data engineering workflow are all met.
**Duties and responsibilities**
- Analyze new business integration needs, fully understand the requirements and perform the required technical analysis to accommodate the new requirements.
- Perform the required development for DWH model to achieve the targeted business needs which include model structure updates, ETL/ELT job load, PL layer jobs modification.
- Implement the right controls to maintain the DWH quality as per the standard Specs and continuously update these quality control checks.
- Work closely with DWH BI analyst to ensure correct and consistent mapping criteria between sources and DWH databases.
- Coordinate with data operations and administrators (system and database) to ensure the best performance monitoring and tuning.
- Optimize data integration platform to provide optimal performance under increasing data volumes.
- Build data pipelines,Analyze and organize data,Build data ingestion scripts/workflows, and Perform quality checks on data
- Drive integration projects from idea formulation, through design and implementation collaborating with partner teams.
- Participate in vendors technical requirements, gap analysis and RFPs
- Support technical decision making in the area of Big Data eco-system and data platform architecture and relevant migration use cases
- Collaborate with data scientists, BI analysts, modelers and IT team members on project goals.
- Monitor and optimize the performance of data platform systems and computing infrastructure.
**Job Specifications**:
**Education**
- Bachelor degree of Engineering in Computer Systems, or Computer Science.
**Experience**
- 5-8 years of hands-on Data engineering, ETL development, and Data Modeling experience
- Solid experience with IBM datastage and Teradata DWH tools/Models is a plus.
- At least 3 years of experience of, managing, designing, programming, administering, and tuning complex conversions moving data from multiple disparate Source Databases into separate/different Data Models
- Extensive experience using and tuning SQL
- Project management experience is a plus
- Expereince working in a big data/ Datalake environment and using big data tools ( NiFi, Airflow, spark, Hive, Kafka, etc )
- Experience with data infrastructure as a code, automation and DevOps practices.
- Excellent understanding of systems design patterns
- Past experience in telecom operators and service providers is preferred.
**Skills and abilities**
- Very good English both written & spoken.
- Excellent collaboration and communication skills and comfortable working across multiple teams.
- Strong hands-on skill, can drill deep into complex systems design and implementation.
- Strong problem solving and troubleshooting skills.
- Excellent knowledge of IBM DataStage and BI solutions
- Excellent programming and debugging skills.
- Excellent systems administration skills.
**Contract**:
Regular
-
Senior Supervisor, Data Engineer
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...
-
Data Engineer
7 months ago
مصر, Egypt Alpha Data Recruitment Full timeDevelopment experience with at least two different database platforms, such as Snowflake, Teradata, Oracle, or MS SQL. - Exposure to Business Intelligence and ETL tools such as Azure Data Factory, SSIS, MicroStrategy, Tableau, Power BI, Talend, etc. - Experience tuning ETL processes to ensure performance and reliability. - Strong SQL skills. - Experience in...
-
Senior Data Engineer
1 week ago
مصر, Egypt Raisa Energy Full timeWe are looking for a **Senior Data Engineer** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil and...
-
Senior Supervisor, DevOps Data Platform Engineer
2 weeks ago
مصر, Egypt Orange Egypt Full time**Purpose of the job** As a Data Lake operations support supervisor you'll work in a Big Data environment, to design, develop, implement and support high quality, reliable and resilient big data systems. You will be working on deploying, configuring, monitoring, supporting and troubleshooting hardware, software solutions and workflows. You will be working...
-
Sr. Supervisor, Data Architect
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Architect **Purpose of the job** - As a solution architect you'll work in a Big Data environment, to lead supervise and contribute to building an elastic, high performance CVM data engineering pipelines, computing and data storage platform that underpins the diverse workloads running on data lake infrastructure. - You will...
-
Senior Data Engineer
1 week ago
مصر, Egypt plugin talents Full timeWe are hiring a talented & experienced Urgently Senior Data Engineer for one of the biggest fintech companies in Egypt: **Job Description**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake to...
-
Senior Data Engineer
7 months ago
مصر, Egypt Shift EV Full timeABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...
-
Senior Data Engineer
1 week ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Data Engineer
7 months ago
مصر, Egypt Unifonic Full timeProudly voted a Great Place to Work®, we are a dynamic startup in the CPaaS (Communication Platform as a Service) space that is revolutionising the way businesses communicate. Our team is made up of 400+ energetic and passionate Unifones who are dedicated to delivering the best possible experience to 5000+ customer-centric companies. We pride ourselves on...
-
Sr. Supervisor, Cvm Data Engineer
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, CVM Data Engineer **Purpose of the job** **Duties and responsibilities** - Identifying data ingestion patterns and build framework to efficiently ingest the data to our Data Lake - Performance tuning ingestion jobs to improve throughput - Improving CI/CD process by automating build, test and deployment framework - Build...
-
Senior Data Engineer
2 days ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Data Engineer
4 days ago
مصر, Egypt Siemens Full timeSiemens Digital Industries Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly Software is a leading provider of cloud based operations management software to optimize...
-
Senior Data Engineer
4 days ago
مصر, Egypt Siemens Digital Industries Software Full timeSiemens Digital Industries Software in Egypt is looking for a Senior Data Engineer with hands-on knowledge in maintaining, supporting, and improving developer experience and production operations to join the Smart Infrastructure - Brightly Software segment. Brightly Software is a leading provider of cloud based operations management software to optimize...
-
Senior Data Engineer
9 months ago
مصر, Egypt Talent Pal Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your...
-
Senior Data Engineer
1 week ago
مصر, Egypt Beinex Full timeBeinex is looking for the best-in-class Data Engineer for its office in Egypt. **Responsibilities**: - Work with business requirements analysts to identify and solve business problems - Design and maintain cloud on-premises, and hybrid data platform architectures - Identify, design and implement full data warehouse and Big Data solutions - Design and...
-
Senior Data Engineer
7 months ago
مصر, Egypt Nile Bits Full time**Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...
-
Senior Data Engineer
7 months ago
مصر, Egypt Nile Bits Full timeAs a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data...
-
Senior Advisor, Data Engineering
16 hours ago
مصر, Egypt Dell Technologies Full timeSenior Data Engineering Advisor Data Science is all about breaking new ground to enable businesses to answer their most urgent questions. Pioneering massively parallel data-intensive analytic processing, our mission is to develop a whole new approach to generating meaning and value from petabyte-scale data sets and shape brand new methodologies, tools,...
-
Data Engineer/data Modeler
7 months ago
مصر, Egypt Luxoft Full time**Project** Description**: One of our banking clients need Luxoft's expertise in designing and building a new data model to fit within their existing Data Warehouse The data will be sourced from a leading vendor platform and is focussed on Treasury data A data modeller is required to work as part on an agile team in delivering this **Responsibilities**: -...
-
Sr. Supervisor, Data Modeler
7 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Sr. Supervisor, Data Modeler **Purpose of the job** As a data engineer you'll work as s a Big Data Modeler, you will play a vital role enabling self-service business users, data analysts and data scientists to extract the most value out of company data with the least effort by delivering rich, optimized, scalable data models. **Duties and...