Data Engineer
Lisbon, Portugal
há 2 dias
source :

At CGD (Permanent), in Lisbon, Portugal

Expires at : 2021-01-18

CGD, the largest financial institution in Portugal, is looking for an experienced Data Engineer to join our team in Lisbon.

Main requirements

  • Degree in information systems and computer engineering, computer science, or other related technical fields with equivalent practical experience;
  • 2+ years of experience performing Data Engineering projects;
  • Experience performing the full lifecycle of data including ingestion, processing, loading and serving phases;
  • Experience with data modeling and storage using concepts such as Data Lake, Data Warehouse, Data Vault, 3NF, Data Marts, Star Schemas, SCD;
  • Demonstrated knowledge of different data architectures, their unique specificities and use cases;
  • Experience building and implementing distributed software solutions for high performance data integration and transformation with large datasets either on batch or real-time / streaming;
  • Strong software engineering principles and experience in OO or functional programming : Java, Scala and / or Python;
  • Knowledge of other programming languages : R, C++, bash, sh, powershell, other;
  • Strong knowledge on Linux operating systems;
  • Experience with Big Data technologies : Hive, Impala, HDFS, Sqoop, Spark, Kudu, HBase, Kafka / Confluent, or any other Big Data Cloud equivalent;
  • Experience with non-relational & relational databases - SQL and NoSQL - PostgreSQL, Oracle, DB2, Hive, Kudu, HBase, MongoDB or other;
  • Advanced query language and data exploration skills;
  • Experience working with Orchestration and Scheduling tools for produtization of data pipelines and workflows such as Apache Airflow, Oozie or similar;
  • Experience with Java oriented technologies (JBoss, Spring, Spring MVC, Hibernate, REST / SOAP);
  • Demonstrated Experience in using CI / CD concepts and tooling : Git, GitLab, Jira, Confluence, Maven, Nexus, Harbor, SonarQube, JUnit, PyTest, PyCharm, ScalaTest, IntelliJ, FlywayDB, Liquibase, ELK Stack or other;
  • Experience with container based deployments such as Docker & Kubernetes;
  • Knowledge of data governance tools such as : Apache Atlas, Cloudera Navigator, IBM IIS, Collibra or similar;
  • Experience with Agile / Scrum development methodologies;
  • Strong team spirit, proactivity, creativity, innovation and dynamism;
  • Strong communication skills (written and spoken) to communicate between platform, engineering, data analysis, data science, management and client teams.
  • Nice to have

  • Experience in bank or financial sectors is a plus
  • Reportar esta oferta de trabalho

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Meu email
    Ao clicar em "Continue", autorizo a neuvoo a processar os meus dados e a enviar-me alertas de e-mail, conforme detalhado na Política de Privacidade da neuvoo . Posso retirar o meu consentimento ou cancelar a subscrição a qualquer momento.
    Formulário de candidatura