Senior Data Engineer

2 months ago


Cairo, Egypt Nile Bits Full time

As a senior data engineer the main product youll be working on is our data pipeline which has been built using the bestofbreed ETL/data warehousing tools and technologies. We predominantly use Python with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse together with Tableau for BI and data visualization. All of our infrastructure runs on AWS.

Tasks
  • Designing and implementing core functionality within our data pipeline in order to support key business processes
  • Shaping the technical direction of the data engineering team
  • Supporting our Data Warehousing approach and strategy
  • Maintaining our data infrastructure so that our jobs run reliably and at scale
  • Taking responsibility for all parts of the data ecosystem including data governance monitoring and alerting data validation and documentation
  • Mentoring and upskilling other members of the team
Requirements
  • Experience building data pipelines and/or ETL processes
  • Experience working in a Data Engineering role
  • Confident writing performant and readable code in Python building upon the rich Python ecosystem wherever it makes sense to do so.
  • Good software engineering knowledge & skills: OO programming design patterns SOLID design principles and clean code
  • Confident writing SQL and good understanding of database design.
  • Experience working with web APIs.
  • Experience leading projects from a technical perspective
  • Knowledge of Docker shell scripting working with Linux
  • Experience with a cloud data warehouse
  • Experience in managing deployments and implementing observability and fault tolerance in cloud based infrastructure (i.e. CI/CD Infrastructure as Code containerbased infrastructure autoscaling monitoring and alerting)
  • Proactive with a selfstarter mindset; able to identify elegant solutions to difficult problems and able to suggest new and creative approaches.
  • Analytical problemsolving and an effective communicator; leveraging technology and subject matter expertise in the business to accelerate our roadmap.
  • Able to lead technical discussions shape the direction of the team identify opportunities for innovation and improvement
  • Able to lead and deliver projects ensuring stakeholders are kept uptodate through regular communication
  • Willing to support the rest of the team when necessary sharing knowledge and best practices documenting design decisions etc.
  • Willing to step outside your comfort zone to broaden your skills and learn new technologies.
  • Experience working with open source orchestration frameworks like Airflow or data analytics tools such as dbt
  • Experience with AWS services or those of another cloud provider
  • Experience with Snowflake
  • Good understanding of Agile
Benefits
  • All employees benefits for free (our famous games room daily breakfast fruits coffee and other hot drinks soft drinks and juices company days out and parties)
  • Social insurance
  • Opendoor management policy
  • Full Medical insurance
  • Accommodation and Transportation Allowance
  • Friendly environment that values innovation and efficiency
  • Exciting opportunities for career growth and talent development
  • Feedback encouragement
  • Recognition and reward programs
  • Competitive salaries and incentives
  • Friendly environment
  • Flexible and Comfortable schedule
  • Fun committees
  • Monetary rewards
  • Fun smart and creative people
  • Career possibilities with growing team
  • Paid vacations
  • Social benefits

For more information about Nile Bits please visit our website:

nilebits dot com



  • Cairo, Egypt vodafone Senior Testing Engineer Full time

    Interacts with the project team to gain an understanding of the business environment, technical context, and conformance criteria.Understands and uses appropriate automated testing processes and tools.Stays current on established tools, techniques, and technologies.Supports knowledge management and collaboration through participation in testing discussions,...


  • Cairo, Cairo, Egypt Data Dynamics Full time

    At Data Dynamics, we take a holistic approach to managing the explosive growth of unstructured data We care about delivering storage optimization and data optimization. Our Unified Unstructured Data Management Platform is an industry leader in Unstructured Data Management and our journey has just begun. With over 300 clients operating globally, we have an...

  • Senior Data Engineer

    4 weeks ago


    Cairo, Egypt SIGMA Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a parttime basis. As a Senior Data Engineer you will be responsible for designing and developing data pipelines optimizing data collection and flow across various data sources and ensuring a consistent data delivery architecture throughout ongoing projects. Your...

  • Senior Data Engineer

    3 months ago


    Cairo, Egypt Talent Pal Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a parttime basis. As a Senior Data Engineer you will be responsible for designing and developing data pipelines optimizing data collection and flow across various data sources and ensuring a consistent data delivery architecture throughout ongoing projects. Your...

  • Senior Data Engineer

    2 weeks ago


    Cairo, Egypt Reliance Health Full time

    **Role Summary** As a Senior Data Engineer you will drive the architectural paradigm and good practices that will allow Reliance Health data practice and tools to scale effectively. Joining us, your work will have an immediate influence on the shape of the tools and data consumed by teams across the company. Your depth of experience and past achievements...

  • Senior Data Engineer

    2 weeks ago


    Cairo, Cairo, Egypt Nile Bits Full time

    As a senior data engineer the main product youll be working on is our data pipeline which has been built using the bestofbreed ETL/data warehousing tools and technologies. We predominantly use Python with Airflow being our orchestration framework of choice. We use Snowflake as our cloud data warehouse together with Tableau for BI and data visualization. All...

  • Senior Data Engineer

    4 weeks ago


    Cairo, Egypt Andela Full time

    Job DescriptionJob descriptionWe are looking for an engineer skilled in developing analytics, BI, data vis platformsPrimary Skills Required: Looker engineer skilled in data vis, snowflake, data engineering, data architectures, reporting/analytics and dashboard building, data warehousing, SQL.Our Andelan Data Engineers are masters of consistent execution....

  • Senior Data Engineer

    1 month ago


    Cairo, Egypt Giza Systems Egypt Full time

    Responsibilities:• Design, develop, and maintain scalable and robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.• Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and ensure...

  • Senior Data Engineer

    2 weeks ago


    Cairo, Cairo, Egypt Giza Systems Egypt Full time

    Responsibilities: Design, develop, and maintain scalable and robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake. Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and ensure efficient data...


  • Cairo, Egypt MAGRABi Retail Group Full time

    BI and Data Senior Manager play a key role in driving data-driven decision-making across MAGRABi by developing and implementing a comprehensive data strategy. MINIMUM QUALIFICATIONS/ EDUCATION/ EXPERIENCE/ Qualifications And Education Bachelor’s degree in computer engineering, computer science or any relevant field.Deep understanding of BI tools and...


  • Cairo, Cairo, Egypt MAGRABi Retail Group Full time

    BI and Data Senior Manager play a key role in driving data-driven decision-making across MAGRABi by developing and implementing a comprehensive data strategy. MINIMUM QUALIFICATIONS/ EDUCATION/ EXPERIENCE/ Qualifications And Education Bachelor's degree in computer engineering, computer science or any relevant field.Deep understanding of BI tools and...

  • Data Engineer

    3 months ago


    Cairo, Egypt Arrow Electronics Egypt Full time

    Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.Apply...

  • Data Engineer

    2 weeks ago


    Cairo, Cairo, Egypt Arrow Electronics Egypt Full time

    Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.Apply...


  • Cairo, Egypt Careem Full time

    Careem is building 'the everything app' for the greater Middle East, making it easier than ever to move around, order food and groceries, manage payments, and more. Careem is led by a powerful purpose to simplify and improve the lives of people and build an awesome organisation that inspires. Since 2012, Careem has created earnings for over 2.5 million...

  • Data Engineer

    3 weeks ago


    Cairo, Egypt Envision Employment Solutions Full time

    Envision Employment Solutions is currently looking for a Data Engineer for one of our partners, a global leader in consulting, digital transformation, technology and engineering services. This position requires flexibility to work on US times and flexibility to travel abroad when needed. **Responsibilities**: - Design, implement, and maintain scalable and...


  • Cairo, Egypt Careem Full time

    Careem is building the Everything App for the greater Middle East, making it easier than ever to move around, order food and groceries, manage payments, and more. Careem is led by a powerful purpose to simplify and improve the lives of people and build an awesome organisation that inspires. Since 2012, Careem has created earnings for over 2.5 million...

  • Data engineer

    3 months ago


    Cairo, Egypt Capgemini Full time

    We are looking for a Data Engineer with a DevOps focus and a proven experience in the Oil & Gas or Energy sector. Leveraging expertise in Big Data, Cloud-based storage management, and data management, the candidate will contribute to the success of key initiatives, ensuring the seamless flow and optimal utilization of data across various systems....

  • Data Engineer

    2 weeks ago


    Cairo, Cairo, Egypt Envision Employment Solutions Full time

    Envision Employment Solutions is currently looking for a Data Engineer for one of our partners, a global leader in consulting, digital transformation, technology and engineering services.This position requires flexibility to work on US times and flexibility to travel abroad when needed.Responsibilities: Design, implement, and maintain scalable and efficient...

  • Data Engineer

    4 weeks ago


    Cairo, Egypt Envision Employment Solutions Full time

    **Ready and hungry for a new adventure? You are definitely in the right place! We at **Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale! - Our partners offer awesome work environment, competitive salaries, full benefits, and many others...


  • Cairo, Egypt Careem Full time

    Careem is building ‘the everything app’ for the greater Middle East, making it easier than ever to move around, order food and groceries, manage payments, and more. Careem is led by a powerful purpose to simplify and improve the lives of people and build an awesome organisation that inspires. Since 2012, Careem has created earnings for over 2.5 million...