Data Engineer
2 weeks ago
Develop and maintain data pipelines performing ETL processes.
- Work closely with data scientists and software developers to implement pipelines performing advanced
- analytics including machine learning models.
- Selecting features, building and optimizing pipelines using machine learning supervised and
- unsupervised techniques
- Extending company’s / customers’ data with third party sources of information when needed.
- Enhancing data collection procedures to include information that is relevant for building analytic
- systems
- Processing, cleansing, and validating the integrity of data used for analysis.
- Building high quality data services.
- Preparing unit test cases and writing unit test code.
- Writing automated build, execution, and deployment scripts for software artifacts.
- Fixing bugs in open-source software supported by the company and software products developed by the company.
**Personal Skills**:
- Self-starter with a proactive attitude
- Excellent written and verbal communication skills for coordinating across teams.
- Individual contributor who is able to work effectively across different teams
- Excellent organizational, time management, and presentation skills.
- Ability to communicate effectively with peers, management, & business groups
**Technical Skills**:
- Experience with Big Data platforms like Hadoop Eco-System and tools like Spark, Kafka, and NiFi.
- Experience with building ETL pipelines using different types of data sources and types.
- Experience with NoSQL databases, such as MongoDB, Cassandra, HBase, ArangoDB, Neo4J, and Elastic
Search.
- Good Coding Skills in Python are required and other coding knowledge and experience with
Java and Scala are highly desirable.
- Writing scripts to preprocess training data and sending it as input to a model automatically.
- Previous knowledge of container management (I.e., Docker) is preferred.
- Experience with Linux administration.
- Deep understanding with applied experience of OOP concepts and writing modularized code.
- Excellence at using common python data science packages like Scikit-Learn, NumPy, SciPy, Matplotlib,
and Plotly.
- Proficiency in using query languages such as SQL.
- Proven hands-on experience in dealing with a variety of data models including structured, semi
- structured and unstructured data.
- Knowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial
neural networks, etc.) and their real-world advantages/drawbacks is preferred.
- Python
- ETL
- Django
- Apache Spark
- Apache NiFi
- Graph Data Model
- SQL / NoSQL
- Machine Learning
- Streaming Analytics
- OOP
**Education**:
Bachelor’s degree or equivalent experience. Preferred Computer science or engineering.
**Job Details**:
Job Location
Cairo, Egypt
Company Industry
System Integrator
Company Type
Employer (Private Sector)
Job Role
Engineering
Employment Status
Full time
Job Division
COO Office
SW Engineering
Career Level
Entry Level
Years of Experience
Min: 0 Max: 2
Degree
Bachelor's degree
-
Data Engineer
4 weeks ago
مصر, Egypt ArabyAds Full timeWe are seeking a skilled and experienced Data Engineer to join our expanding data team at our digital marketing/adtech company. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure on AWS. In addition to strong data engineering skills, you should have experience with DevOps, ensuring scalability,...
-
Data Engineer
4 weeks ago
مصر, Egypt Curenta Full time**Responsibilities**: - Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Functions, and other Azure services. - Implement data storage solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB. - Design and implement Modern Lakehouse Data Warehouse using Delta Lake and Spark, ensuring...
-
Senior Data Engineer
4 weeks ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...
-
Data Engineer
38 minutes ago
مصر, Egypt Envision Employment Solutions Full timeEnvision Employment Solutions is currently looking for a Data Engineer for one of our partners, a multinational bank. **Responsibilities**: - Database Development: Develop stored procedure, views, functions, partitions, etc., using SQL Server. - ETL Development: Develop, code, test, and debug using SSIS ETL (SQL Server Integration Services). Translate...
-
Data Engineer
4 weeks ago
مصر, Egypt Plugin Talents Full time**About the job Data Engineer**: **Requirements/Job Specification** - Conduct meetings to gather business requirements from all functions in order to support managing demand and change management processes - Identify new technologies, potential hardware, operating systems, and connectivity solutions in order to support the development/update of data...
-
Data Integration Engineer
4 weeks ago
مصر, Egypt Giza Systems EG Full timeIntegration Engineer to support the delivery of multi-organizational integration projects and enterprise data-warehouse **Responsibilities** - Gathering the ETL/ELT requirements. - Design, Develop, Test ETL/ELT different scenarios and support the ETL/ELT processes to Extract, Transforming and Loading data from different sources to the data warehouse. -...
-
Senior Data Engineer
4 weeks ago
مصر, Egypt Plugin Talents Full time**About the job Senior Data Engineer**: - Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules. - Develop and implement databases and data collection systems & Undertake preprocessing of structured and unstructured data. - Build the infrastructure required for optimal...
-
Data Engineer
5 days ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Ibm Data Engineer
4 weeks ago
مصر, Egypt IBM Full timeIntroduction IBM Systems Expert Labs is a Professional Services Team under IBM Technology Expert Labs. IBM Technology Expert Labs has the proven expertise to help leaders plan, design and implement the essential IT infrastructure for what comes next. We offer a wide range of IT infrastructure services for IBM Power Systems, IBM Z® and IBM LinuxONE...
-
Data Engineer I
4 weeks ago
مصر, Egypt Arrow Electronics, Inc. Full time**Position**: Data Engineer I **ESSENTIAL DUTIES & RESPONSIBILITIES** - Develop Customer requests after handling them to enter in Database. **SKILLS & EXPERIENCE REQUIREMENTS**: - B.Sc. in electrical or electronics engineering. - 0 to 1 year of experience. - Familiar with electronic components and systems. - Good experience with Microsoft Office. - Very...
-
Senior Data Engineer
6 days ago
مصر, Egypt Talent Pal Full timeWe are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...
-
Manager, Data Architecture
4 weeks ago
مصر, Egypt Orange Egypt Full time**Purpose of the job** Oversee and lead a team of data engineers and modelers to design, implement and maintain robust data models and pipelines. The role is critical for data-driven decision making within the organization and ensuring the integrity and availbility of data for various business functions. **Duties and responsibilities** - Identifying and...
-
Data Quality Engineer
7 days ago
مصر, Egypt SSC Egypt Full timeDevelop and implement data quality processes. - Performing statistical tests on large datasets to determine data quality and integrity. - Work closely with cross-functional teams to ensure accuracy and completeness of data - Execute and automate test cases. **Requirements**: - Bachelor's degree in computer science or a related field. - 2 to 3 years...
-
Senior Data Engineer
4 weeks ago
مصر, Egypt Plugin Talents Full time**About the job Senior data Engineer**: **Job Description**: - Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management - Strong ability to design, build and manage data pipelines for data structures encompassing data...
-
Data Engineer
4 weeks ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Supervisor, Data Engineer
4 weeks ago
مصر, Egypt اورنچ مصر Full timeAbout the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...
-
Senior Data Engineer-data Integration
4 weeks ago
مصر, Egypt IBM Full timeIntroduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...
-
Senior Software Engineer
4 weeks ago
مصر, Egypt Procore Full timeThis is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...
-
Sr. Data Engineer vois
4 weeks ago
مصر, Egypt Vodafone Full time**Role purpose**: **The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain.** **Key accountabilities and decision ownership**: - **Both managed and independent research (POCs, white...
-
Sr. Data Engineer vois
4 weeks ago
مصر, Egypt Vodafone Full time**Role purpose**: The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. **Key accountabilities and decision ownership**: - Both managed and independent research (POCs, white papers,...