Senior Data Engineer
Michael Page Portugal
Lisboa, PT
há 4 dias
source : ITJobs

Profile

  • 3+ years extensive experience of building big data pipelines with Apache Spark - real-time and batch processing
  • 3+ years experience of interacting with big data and cloud data stores, both SQL and noSQL such as Hive, Presto, Apache Kudu, Big Query, AWS Athena or related big data store systems
  • 3+ years' experience of Python
  • Experience building large scale distributed systems or applications
  • Experience with Kafka, Kinesis, Storm, Spark and other data pipeline technologies
  • Strong knowledge of Design Patterns
  • Strong data modeling skills (NoSQL & RDBMS)
  • Experience with Linux, good knowledge of Linux administration
  • Experience with Unix Shell Scripting - Experience with cloud technologies such as Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform
  • Experience HAProxy, NginX, Netty, Docker
  • Exposure to modern execution frameworks like Mesos or Kubernetes as well as management tools like Terraform
  • Experience with Continuous Integration, QA, Stress Testing
  • Experience with configuration management tools like Puppet, Chef, Ansible or Saltstack
  • Strong knowledge of Agile development methodology
  • Job Offer

    Join a leading company.

    Reportar esta oferta de trabalho
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Candidate-se
    Meu email
    Ao clicar em "Continue", autorizo a neuvoo a processar os meus dados e a enviar-me alertas de e-mail, conforme detalhado na Política de Privacidade da neuvoo . Posso retirar o meu consentimento ou cancelar a subscrição a qualquer momento.
    Continue
    Formulário de candidatura