Principal Data Engineer

Imagine being part of a world-class engineering team, spearheading the development of cutting-edge data-driven solutions that will revolutionize the fintech industry in Egypt... At b_labs, the innovation arm of B.TECH - a cornerstone of the Egyptian retail industry - we are seeking a Principal Data Engineer to join our Fintech squad. As a key member of our foundation team, you will play a critical role in building Egypt’s leading consumer finance product. As a Principal Data Engineer, you will lead the technical vision for our digital product and drive the development of scalable and high-performance distributed systems. Collaborating closely with design and product teams, you will utilize your extensive experience to implement best practices and solve complex data engineering challenges. If you are passionate about architecting innovative data solutions and thrive in a collaborative and inclusive team, b_labs is the perfect opportunity for you. Join us at the forefront of Fintech innovation in Egypt and play a pivotal role in shaping the future of our industry, one breakthrough at a time. **Responsibilities** - Develop and oversee end-to-end data solutions and architectures, utilizing cutting-edge technologies such as Spark and Kafka, to support our high-volume, high-velocity data processing needs - Use your extensive technical expertise and experience to mentor and provide technical leadership to a team of talented data engineers - Work closely with business and technical stakeholders to identify strategic data initiatives and prioritize them based on their impact to the business - Build robust data pipelines utilizing advanced ETL tools and techniques to deliver reliable data to data science and business analytics teams - Establish data engineering best practices and standards across the organization, ensuring consistency, scalability, and maintainability in all data architectures and solutions - Implement and follow modern DevOps practices, automating and streamlining data deployment processes - Collaborate with cross-functional teams including software engineers, data scientists, product managers, designers operating in an agile setting - Research, evaluate and implement emerging data technologies to continuously innovate and enhance our data infrastructure and capabilities - Foster a culture of innovation, ownership, and collaboration, promoting a safe, inclusive, and empowering work environment for all employees **Requirements**: - 7+ years of experience in designing and building complex, large-scale data processing and analysis systems using distributed big data frameworks like Spark and Kafka - Proven track record of solving complex reliability, scalability, and performance challenges in a distributed environment and implementing resilient and fault-tolerant systems - Strong expertise in Python and SQL, and experience in implementing effective data storage and retrieval solutions - Excellent communication and collaboration skills with a demonstrated ability to work effectively with cross-functional teams and stakeholders to drive results - Strong analytical skills with a deep understanding of statistical and data analysis techniques and tools, and experience in developing and deploying machine learning models - Demonstrated ability to collaborate with senior engineers and architects to design and implement innovative data solutions that match business needs and requirements - Strong leadership skills with experience in leading and mentoring a team of data engineers, and promoting a culture of diversity, inclusion, and continuous learning - Passionate about technology and keeping up with the latest trends and emerging technologies in data engineering and data science **Benefits** Office environment: When you come to our b_labs office, you'll find creative workspaces, a well-equipped kitchen, and an open design to foster collaboration between teams. Education budget: We believe the learning journey never ends, therefore you will be entitled to an annual education budget to take part in trainings, courses or onsite conferences of your choice. Flexibility: You know best whether you want to work from home or in the office. However, if you want to join your teammates onsite, we will subsidize the costs for lunch to foster the b_labs office community Mobility package: When you are joining the b_labs office, we will subsidize your mobility expenses for public transport. Equipment: From "Day 1" you will receive all the equipment you need be successful at work. Therefore, you can choose your laptop and get all the tools you need to stay on top of your game.