Oferta pracy

Senior Data Engineer (Spark)

ING Tech Poland

ING Tech Poland

Konduktorska 35



Your responsibilities

  • Build the solutions required for optimal loading of data from a wide variety of datasources

  • Create and maintain, with the team, an optimal data pipeline architecture

  • Assemble large, complex data sets that meet functional / non-functional requirements

  • Identify, design, and implement interna lprocess improvements

  • Keep data separated and secure across international boundaries through multipledata centers

  • Work with data and analytics experts to strivefor greater functionality in our data systems

  • Work with stakeholders including the Data and Design teams to assist with data-related technical issues and support their data infrastructure needs

Our requirements

  • You have experience with Spark and Kafka,

  • You have experience with HDFS/Hive and generally with Hadoop,

  • You have advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases,

  • You have great development skills in Scala, Python or Java,

  • You hav 5+ years of experience in a Data and/or Software Engineer role,

  • You are communicative person,

  • You have very good analitical skills and can solve complex problems,

  • You can complete tasks and achieves results in an efficient, timely and high-quality manner.


  • Experience with Nifi and groovy based processors,

  • Spring/springboot based microservices creation,

  • Bash and/or Ansible knowledge,

  • Experience in the financial services area.

  • Experience with stream-processing using Flink or Kafka,

  • Experience in building and optimizing big scale data pipelines, architectures and data sets - in both batch and real-time data integration,

  • Working knowledge of message queuing, stream processing, and highly scalable BigData data stores,

  • Experience working in a DevOps environment - CI/CD, Azure DevOps, Test automation, Dockereld.

What we offer

  • Wielokierunkowy rozwój

  • Certyfikacje i transfer wiedzy

  • Najnowsze technologie

  • Międzynarodowe projekty

  • Stabilne warunki zatrudnienia

  • Pełne wyposażenie stanowiska pracy

  • Benefits

  • sharing the costs of sports activities

  • private medical care

  • sharing the costs of foreign language classes

  • sharing the costs of professional training & courses

  • life insurance

  • integration events

  • corporate gym

  • video games at work

  • parking space for employees

  • leisure zone

Information about squad:

We are the biggest datalake in ING. Besides batch ingestion we do support near real-time data ingestion and distribution using Kafka. We plan to move to a new streaming ingest platform, using container technologies and focus more on being an event based datalake. We have build a generic, metadata driven, data pipeline on top of Nifi. You will be joining a team of experts, where you can learn, share and will have fun.