Senior Data Engineer
Lisbon, Portugal
há 1 dia
source : Just Join IT

Distributed systems (regular)


Brainly is scaling! We are looking for an experienced, highly motivated Senior Data Engineer to join our Search Team and help us build data infrastructure that will enable scaling and improvement of Brainly’s search ecosystem.

You will be working with a team of engineers and data scientists on problems spanning from data ingestion, operating platform at scale, and experimenting on information retrieval algorithms and relevance tuning.

Your areas of expertise will help us mostly in these areas :

  • Developing efficient data ingestion and transformation from multiple sources
  • Building and enhancing data pipelines for search quality monitoring
  • Are you a goal-driven team player ? Do you like tackling new challenges using leading-edge industry tools? Can you adapt to rapidly changing conditions while learning and bettering yourself?

    Are you a detail-oriented expert who loves focusing on quality? If you answered yes to these questions, you might just be the perfect candidate for this role!


  • Design, develop and own operational data solutions for gathering and preparing data sets for further usage by search engineers and data scientists
  • Design, develop and own reporting data solutions for further understanding Brainly search and optimizing processes
  • Evaluate existing data processing architectures and identifying optimizations in terms of scalability
  • Work with multiple data sources : analytics and log data
  • Design and implement scalable ETL pipelines for providing the datasets required for rapid experimenting as well as for production use cases
  • Establish the data framework to be used by various search system technologies
  • Assemble and transform complex unstructured datasets into features that are digestible for search systems and solutions
  • Collaborate with other teams across the organization

  • 4+ years of experience developing and maintaining data processing workflows and applications using one of few solutions like Matillion, AWS Glue, Apache Spark, EMR, or similar
  • Experience with writing code in one of the programming languages (Python preferred)
  • Hands-on experience with developing and maintaining distributed systems
  • Understanding and experience in working on streaming and batch processing
  • Solid understanding of object-oriented and functional programming
  • Solid understanding, experience with designing and implementation of ETL, ELT

  • Experience with Docker, Kubernetes, Terraform, and AWS Ecosystem
  • Experience with Matillion, AWS Redshift,, Snowflake, AWS Kinesis
  • MS degree in Computer Science, a similar technical field of study, or have equivalent practical experience

  • We want to see you grow along with us you will have 800$ per year for personal development, extra time for attending conferences and workshops, and unlimited access to an online learning platform (courses from Coursera, Udacity, Udemy, Harvard ManageMentor, and many others!)
  • Health is important, which is why at Brainly, we fully cover private health & dental care packages for you and your family and provide you with a sport card (Multisport Plus in Poland, Andjoy in Spain)
  • You will also get an access to online individual psychological consultations with professionals in English & Polish via the Mental Health Helpline
  • Flexible working hours working requires communication, so we work within the European business hours, but we also know that life may be unpredictable, so if you need to jump out of work (doctor’s appointment, emergency, anything) no problem!
  • Your personal concierge AskHenry will support you in your daily duties, eg. planning your dream vacation
  • We will provide you with all the necessary equipment & tools , including an additional budget for accessories which will make your remote setup even more comfortable.
  • You can join internal communities and contribute to charity, diversity and inclusion initiatives, take part in great internal events or represent Brainly at conferences or meet-ups.

    Brainly is the online learning platform where over 350 million students and parents go from questioning to understanding.

    With their smartphones, users can snap a photo to instantly solve any problem or homework question and be matched with a Brainly product such as Community Q&A, Brainly Tutor, Math Solver or Textbook Detective.

    Brainly is built to provide students, parents, experts, and teachers with a collaborative platform and tools needed to succeed in any educational environment.

    Based in Kraków, Poland, with U.S. headquarters in New York City, Brainly apps and websites are visited by users from over 35 countries.

    Backed by Prosus, Point Nine Capital, General Catalyst, Runa Capital, Learn Capital and Kulczyk Investments. Learn more about Brainly at .

    By sending us your application you agree that Brainly sp. z o.o. will process your personal data to participate in this recruitment process.

    If you want to know more about how Brainly processes your personal data please click here .

    Reportar esta oferta de trabalho

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Meu email
    Ao clicar em "Continuar", autorizo a neuvoo a processar os meus dados e a enviar-me alertas de e-mail, conforme detalhado na Política de Privacidade da neuvoo . Posso retirar o meu consentimento ou cancelar a subscrição a qualquer momento.
    Formulário de candidatura