Senior Data Engineer

4 months ago


مصر, Egypt Nile Bits Full time

As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for BI and data visualization. All of our infrastructure runs on AWS.

Tasks
- Designing and implementing core functionality within our data pipeline in order to support key business processes
- Shaping the technical direction of the data engineering team
- Supporting our Data Warehousing approach and strategy
- Maintaining our data infrastructure so that our jobs run reliably and at scale
- Taking responsibility for all parts of the data ecosystem, including data governance, monitoring and alerting, data validation, and documentation
- Mentoring and upskilling other members of the team

**Requirements**:

- Experience building data pipelines and/or ETL processes
- Experience working in a Data Engineering role
- Confident writing performant and readable code in Python, building upon the rich Python ecosystem wherever it makes sense to do so.
- Good software engineering knowledge & skills: OO programming, design patterns, SOLID design principles and clean code
- Confident writing SQL and good understanding of database design.
- Experience working with web APIs.
- Experience leading projects from a technical perspective
- Knowledge of Docker, shell scripting, working with Linux
- Experience with a cloud data warehouse
- Experience in managing deployments and implementing observability and fault tolerance in cloud based infrastructure (i.e. CI/CD, Infrastructure as Code, container-based infrastructure, auto-scaling, monitoring and alerting)
- Pro-active with a self-starter mindset; able to identify elegant solutions to difficult problems and able to suggest new and creative approaches.
- Able to lead technical discussions, shape the direction of the team, identify opportunities for innovation and improvement
- Able to lead and deliver projects, ensuring stakeholders are kept up-to-date through regular communication
- Willing to support the rest of the team when necessary, sharing knowledge and best practices, documenting design decisions, etc.
- Willing to step outside your comfort zone to broaden your skills and learn new technologies.
- Experience working with open source orchestration frameworks like Airflow or data analytics tools such as dbt
- Experience with AWS services or those of another cloud provider
- Experience with Snowflake
- Good understanding of Agile

**Benefits**:

- All employees benefits for free (our famous games room, daily breakfast, fruits, coffee and other hot drinks, soft drinks and juices, company days out and parties )
- Social insurance
- Open-door management policy
- Full Medical insurance
- Accommodation and Transportation Allowance
- Friendly environment that values innovation and efficiency
- Exciting opportunities for career growth and talent development
- Feedback encouragement
- Recognition and reward programs
- Competitive salaries and incentives
- Friendly environment
- Flexible and Comfortable schedule
- Fun committees
- Monetary rewards
- Fun, smart and creative people
- Career possibilities with growing team
- Paid vacations
- Social benefits

For more information about Nile Bits, please visit our website:
nilebits dot com


  • Data Engineer

    3 months ago


    مصر, Egypt Alpha Data Recruitment Full time

    Development experience with at least two different database platforms, such as Snowflake, Teradata, Oracle, or MS SQL. - Exposure to Business Intelligence and ETL tools such as Azure Data Factory, SSIS, MicroStrategy, Tableau, Power BI, Talend, etc. - Experience tuning ETL processes to ensure performance and reliability. - Strong SQL skills. - Experience in...

  • Senior Data Engineer

    3 months ago


    مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: **Key Responsibilities** - Design, build, and maintain data processing systems to migrate data from HDP to CDP Private Cloud. Work closely with the data engineering team, architects, and administrators to ensure the successful migration of data. Perform data analysis, data profiling, and data mapping to ensure data...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt Plugin Talents Full time

    **About the job Senior Data Engineer**: **Roles & Responsibilities** We are seeking a talented Cloudera Data Platform (CDP) Data Engineer with experience in migrating data from Hortonworks Data Platform (HDP) to CDP Private Cloud. As a CDP Data Engineer, you will be responsible for designing, building, and maintaining data processing systems that will...

  • Senior Data Engineer

    3 months ago


    مصر, Egypt Shift EV Full time

    ABOUT SHIFT EV: Based in Cairo, Egypt, Shift EV is an emerging leader in electric vehicle technology. We are dedicated to accelerating EV adoption in the region through innovative electric drivetrain solutions. Join us and collaborate with top-tier technology experts from MIT, Intel, and Corning to drive transformative change. Overview: As Shift EV’s...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt Vezeeta Full time

    **About us** Vezeeta is the leading Digital Healthcare Platform in Middle East and Africa that is transforming healthcare accessibility across the region. Having served to date more than 10 Million patients across 78 cities in 6 countries through cutting-edge digital solutions, we empower patients throughout the entirety of their healthcare journey allowing...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt Unifonic Full time

    Proudly voted a Great Place to Work®, we are a dynamic startup in the CPaaS (Communication Platform as a Service) space that is revolutionising the way businesses communicate. Our team is made up of 400+ energetic and passionate Unifones who are dedicated to delivering the best possible experience to 5000+ customer-centric companies. We pride ourselves on...

  • Senior Data Engineer

    3 months ago


    مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...

  • Senior Data Engineer

    5 months ago


    مصر, Egypt Talent Pal Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt Nile Bits Full time

    **Company Description** As a senior data engineer the main product you’ll be working on is our data pipeline, which has been built using the best-of-breed ETL/data warehousing tools and technologies. We predominantly use Python, with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse, together with Tableau for...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt Talent Pal Full time

    We are looking for Senior Data engineers to join our fast-growing analytics and AI team, you will be responsible for designing and optimizing data pipeline architecture as well as optimizing data flow and collection for cross functional teams - Technologies - Python (fastapi, cython, scipy, Scikit-learn, Seaborn ) - Spark(Pyspark or Scala) - Big data Tools -...


  • مصر, Egypt Luxoft Full time

    **Project** Description**: One of our banking clients need Luxoft's expertise in designing and building a new data model to fit within their existing Data Warehouse The data will be sourced from a leading vendor platform and is focussed on Treasury data A data modeller is required to work as part on an agile team in delivering this **Responsibilities**: -...


  • مصر, Egypt اورنچ مصر Full time

    About the job Senior Supervisor, Data Engineer **Purpose of the job** Develop, build and maintain new data models and data pipelines with various source systems. Manage the development of data resources and support new product launches. Ensure data quality across the product vertical and related business areas. Develop all integration activities within the...


  • مصر, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...

  • Senior Data Ops

    5 months ago


    مصر, Egypt DXC Technology Full time

    **As a Data Migration Engineer, your responsibilities will include**: Overseeing the design and delivery of data transformation projects with clients. This will include: - Migration Strategy - Migration Approach and Design - Migration Mappings Specifications (Entitry Level / Attrivute Level) - _Design and Build of Migration Jobs using ETL, Python, etc.._ -...


  • مصر, Egypt Procore Full time

    This is a full-time position and will report to our Senior Manager of Software Engineering and will be based in the Cairo, Egypt office, but employees can choose to work remotely. We are looking for someone to join our team immediately. **What you’ll do**: - Create scalable data pipelines and microservices using a variety of technologies such as Java,...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt Giza Systems EG Full time

    Design, develop, and maintain scalable and robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake. - Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and ensure efficient data integration and data...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt FlairsTech Full time

    Details Required Experience +4 years Department Digital Solutions Career Level Position Location Cairo **Skills**: - Data Warehousing Data management Data Integration Requirements and responsibilities **Role Objectives**: - Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from various sources into...

  • Senior Data Scientist

    4 months ago


    مصر, Egypt Raisa Energy Full time

    We are looking for a **Senior **Data Scientist** to join our team in Cairo. **Summary**: Raisa is an energy fintech company that uses proprietary technologies (in-house tech, machine learning microservices, securitization) to manage large investments in the United States. With over $2 billion of private funding, Raisa has built a diverse portfolio of oil...

  • Senior Data Analyst

    4 months ago


    مصر, Egypt ITWORX Full time

    Career Level: **Early Career** - Employment Type: **Full time** - Function: **Operational Excellence** **Senior Data Analyst**: Bachelor of Engineering, Computer Science, Business Informatics or any related From 3-5 years of relevant experience. Knowledge of data visualization software like Power BI. Excellent Excel and power point skills. Have high...

  • Senior Data Engineer

    4 months ago


    مصر, Egypt SSC Egypt Full time

    Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system. - Develop, build, and implement new data collection systems where needed. - Provide training and guidance on new systems that are being implemented. - Keep the code used on file for future upgrades and repairs to...