Senior Data Engineer
7 months ago
As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data visualization. All of our infrastructure runs on AWS.
Tasks
- Designing and implementing core functionality within our data pipeline in order to support key business processes
- Shaping the technical direction of the data engineering team
- Supporting our Data Warehousing approach and strategy
- Maintaining our data infrastructure so that our jobs run reliably and at scale
- Taking responsibility for all parts of the data ecosystem, including data governance, monitoring and alerting, data validation, and documentation
- Mentoring and upskilling other members of the team
**Requirements**:
- Experience building data pipelines and/or ETL processes
- Experience working in a Data Engineering role
- Confident writing performant and readable code in Python, building upon the rich Python ecosystem wherever it makes sense to do so.
- Good software engineering knowledge & skills: OO programming, design patterns, SOLID design principles and clean code
- Confident writing SQL and good understanding of database design.
- Experience working with web APIs.
- Experience leading projects from a technical perspective
- Knowledge of Docker, shell scripting, working with Linux
- Experience with a cloud data warehouse
- Experience in managing deployments and implementing observability and fault tolerance in cloud based infrastructure (i.e. CI/CD, Infrastructure as Code, container-based infrastructure, auto-scaling, monitoring and alerting)
- Pro-active with a self-starter mindset; able to identify elegant solutions to difficult problems and able to suggest new and creative approaches.
- Able to lead technical discussions, shape the direction of the team, identify opportunities for innovation and improvement
- Able to lead and deliver projects, ensuring stakeholders are kept up-to-date through regular communication
- Willing to support the rest of the team when necessary, sharing knowledge and best practices, documenting design decisions, etc.
- Willing to step outside your comfort zone to broaden your skills and learn new technologies.
- Experience working with open source orchestration frameworks like Airflow or data analytics tools such as dbt
- Experience with AWS services or those of another cloud provider
- Experience with Snowflake
- Good understanding of Agile
**Benefits**:
- All employees benefits for free (our famous games room, daily breakfast, fruits, coffee and other hot drinks, soft drinks and juices, company days out and parties )
- Social insurance
- Open-door management policy
- Full Medical insurance
- Accommodation and Transportation Allowance
- Friendly environment that values innovation and efficiency
- Exciting opportunities for career growth and talent development
- Feedback encouragement
- Recognition and reward programs
- Competitive salaries and incentives
- Friendly environment
- Flexible and Comfortable schedule
- Fun committees
- Monetary rewards
- Fun, smart and creative people
- Career possibilities with growing team
- Paid vacations
- Social benefits
For more information about Nile Bits, please visit our website:
nilebits dot com
-
Senior Data Engineer
6 months ago
مصر, Egypt Shift EV Full timeABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...
-
Senior Data Engineer
8 months ago
مصر, Egypt Talent Pal Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your...
-
Senior Data Engineer
6 months ago
مصر, Egypt Nile Bits Full time**Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...
-
Senior Data Engineer
7 months ago
مصر, Egypt Talent Pal Full timeWe are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...
-
Senior Supervisor, Data Engineer
6 months ago
مصر, Egypt اورنچ مصر Full timeAbout the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...
-
Senior Big Data Engineer
6 months ago
مصر, Egypt Envision Employment Solutions Full time**Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...
-
Senior Software Engineer
6 months ago
مصر, Egypt Procore Full timeThis is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...
-
Senior Data Ops
8 months ago
مصر, Egypt DXC Technology Full time**As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...
-
Senior Data Engineer
6 months ago
مصر, Egypt FlairsTech Full timeDetails Required Experience +4 years Department Digital Solutions Career Level Position Location Cairo **Skills**: - Data Warehousing Data management Data Integration Requirements and responsibilities **Role Objectives**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into...
-
Senior Data Scientist
6 months ago
مصر, Egypt Raisa Energy Full timeWe are looking for a **Senior **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil...
-
Senior Data Analyst
6 months ago
مصر, Egypt ITWORX Full timeCareer Level: **Early Career** - Employment Type: **Full time** - Function: **Operational Excellence** **Senior Data Analyst**: Bachelor of Engineering, Computer Science, Business Informatics or any related From 3-5 years of relevant experience. Knowledge of data visualization software like Power BI. Excellent Excel and power point skills. Have high...
-
Senior Data Engineer
6 months ago
مصر, Egypt DXC Technology Full time**Job Summary**: **The Data Engineer** will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities**: - Optimize and enhance...
-
Data Engineer
6 months ago
مصر, Egypt Evolvice GmbH Full timeLocation: Egypt / Cairo - Employment Type: Full Time - Job ID: 33695 **Who we are**: Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital...
-
Software & Data Engineer
6 months ago
مصر, Egypt Orange Full time**key result / decision areas (outcomes) Work closely with your business to identify issues and use data to propose solutions for effective decision making and drive business insights Mine and analyze data from company databases to drive optimization and improvement of product development, marketing techniques and business strategies Maintain clear and...
-
Senior Data Engineers
7 months ago
مصر, Egypt DXC Technology Full time**Job Summary** The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices. **Duties and Responsibilities** - Optimize and enhance data...
-
Data Scientist
6 months ago
مصر, Egypt Raisa Energy Full timeWe are looking for a **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil and gas...
-
Senior Data Scientist
6 months ago
مصر, Egypt Ericsson Full time**About this opportunity.** As a Senior Data Scientist, you'll be responsible for developing scientific methods, processes, and systems to extract knowledge or insights to drive the future of applied analytics. Provide thought leadership, perform Sophisticated Statistical Analytics, and build insights into data to deliver to the business useful insights,...
-
Senior Data Annotator
6 months ago
مصر, Egypt Dawarha Full time**About us**: Dawarha is at the forefront of the recycling movement, pioneering an innovative social recycling platform that combines AI-based Reverse Vending technology with a user-friendly mobile app. We proudly introduced this groundbreaking concept to the Egyptian market and the broader MENA region. As a subsidiary of the visionary Mind-Blowing company,...
-
Data Engineer
6 months ago
مصر, Egypt ArabyAds Full timeWe are seeking a skilled and experienced Data Engineer to join our expanding data team at our digital marketing/adtech company. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure on AWS. In addition to strong data engineering skills, you should have experience with DevOps, ensuring scalability,...
-
Data Engineer
6 months ago
مصر, Egypt Envision Employment Solutions Full time**Job Summary**: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure and systems that support the organization's data-driven initiatives. **Responsibilities**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load large volumes of data from various...