Oferta pracy

Senior Data Engineer (Nifi/Groovy)

ING Tech Poland

  • Konduktorska 35, Katowice
    Katowice, Silesian
  • offer expired a month ago
  • contract of employment
  • full-time
  • senior specialist (Senior)
  • remote recruitment

ING Tech Poland

Konduktorska 35

Katowice

Your responsibilities

  • Build the solutions required for optimal loading of data from a wide variety of datasources

  • Create and maintain, with the team, an optimal data pipeline architecture

  • Assemble large, complex data sets that meet functional / non-functional requirements

  • Identify, design, and implement internal process improvements

  • Keep data separated and secure across international boundaries through multiple data centers

  • Work with data and analytics experts to strivefor greater functionality in our data systems

  • Work with stakeholders including the Data and Design teams to assist with data-related technical issues and support their data infrastructure needs

Our requirements

  • You have experience with Nifi, especially writing custom processors in Groovy,

  • You have advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases,

  • You have great development skills in Groovy, Scala or Python

  • You have 5+ years of experience in a Data and/or Software Engineer role,

  • You are communicative person,

  • You have very good analitical skills and can solve complex problems,

  • You can complete tasks and achieves results in an efficient, timely and high-quality manner.

Optional

  • Experience with HDFS/Hive and generally with Hadoop

  • Spring/springboot based microservices creation,

  • Bash and/or Ansible knowledge,

  • Experience in the financial services area.

  • Experience with stream-processing using Flink or Kafka,

  • Experience in building and optimizing big scale data pipelines, architectures and data sets - in both batch and real-time data integration,

  • Working knowledge of message queuing, stream processing, and highly scalable BigData data stores,

  • Experience working in a DevOps environment - CI/CD, Azure DevOps, Test automation, Dockereld.

What we offer

  • Wielokierunkowy rozwój

  • Certyfikacje i transfer wiedzy

  • Najnowsze technologie

  • Międzynarodowe projekty

  • Stabilne warunki zatrudnienia

  • Pełne wyposażenie stanowiska pracy

  • Benefits

  • sharing the costs of sports activities

  • private medical care

  • sharing the costs of foreign language classes

  • sharing the costs of professional training & courses

  • life insurance

  • integration events

  • corporate gym

  • video games at work

  • parking space for employees

  • leisure zone

Information about squad:

We are the biggest datalake in ING. Besides batch ingestion we do support near real-time data ingestion and distribution using Kafka. We plan to move to a new streaming ingest platform, using container technologies and focus more on being an event based datalake. We have build a generic, metadata driven, data pipeline on top of Nifi. You will be joining a team of experts, where you can learn, share and will have fun.