Pracuj.plsharing the costs of sports activities
ISS/IT/Data/39509
Wszystkie informacje o przetwarzaniu danych osobowych w tej rekrutacji znajdziesz w formularzu aplikacyjnym, po kliknięciu w przycisk "Aplikuj Teraz".
Data Engineer
DSV ISS
- Taśmowa 10, Mokotów, WarszawaWarszawa, Masovian
- valid for 23 daysuntil: 14 Jun 2022
- contract of employment
- full-time
- specialist (Mid / Regular)
- remote recruitment
DSV ISS
Taśmowa 10
Mokotów
Warszawa
Technologies we use
Expected
Kafka
Your responsibilities
Sourcing data from systems in DSV via the appropriate pattern for the use case (e.g. REST services, event streaming) or in the beginning of projects before the real integration is established (e.g. simple file dumps on FTP servers)
Building near real-time event streaming data flows with separated micro services for different functional purposes (e.g. file upload, image extraction, file extraction, etc.)
Re-configure the event streaming broker for optimization
Establish domain-based ontologies for data to ensure semantic interoperability between different systems
Making data available in the needed form to use in ML models and for visualization by business applications with a frontend – and collect the inputs of the users as data enrichment from the frontend
Ensuring scalability of data flows by removing bottlenecks
Working together with the logging team, who set guidelines for how to structure your log outputs
Our requirements
Event streaming: Confluent Kafka, Kafka streams, KSQL
Logging & Monitoring: Elastic, Kibana, Grafana, Logstash, FluentD
Coding languages: Python, Java, Scala
Storage technologies such as: SQL database (we use MySQL), NoSQL database (we use MongoDB), file systems (E.g. Azure Files, Filestore), Blob storage (E.g. Azure Blob Storage, S3)
Version control: Git (we use Atlassian BitBucket as a wrapper on top of Git)
Containerization: Docker/containerd
Container orchestration: Kubernetes
OS: OS Linux (CentOS/RHCOS) and Win
BI tools: PowerBI, Qlik, etc.
Moderate experience with Cloud platforms: AWS, Azure, T-platforms, GCP
Optional
Other data processing frameworks: E.g. Spark or Ray
ML model serving: TensorFlow serving, Torch serving
Authentication: Open ID Connect 2.0 (we use Red Hat KeyCloak as identity broker)
CI/CD Pipelines: Jenkins (our templates are written in Groovy) and AzureDevOps
Load balancing: NGINX
Installation scripts: Ansible
Requirements: Jira
Documentation: Confluence
Frontend technologies: React JS, Material UI, JavaScript/TypeScript, Redux
Test framework: Jest
ML Frameworks: TensorFlow / PyTorch
What we offer
Employment contract
Buddy
Comprehensive onboarding program
Internal training catalogue and e-learning platform
Culture of feedback
Internal transition program
Scandinavian work culture
Work-life Harmony
Benefits
private medical care
sharing the costs of foreign language classes
life insurance
corporate gym
christmas gifts
charity initiatives
modern & ergonomic eco-office
bike parking
electric vehicle charging stations
canteen
Recruitment stages
1
CV Analysis
2
Telephone contact
3
1st Recruitment meeting
4
Tests (optional)
5
2nd Recruitment meeting (optional)
6
Feedback
Take a 360-degree Virtual Tour of the DSV ISS Office
https://social.dsv.com/2QS
Take a 360-degree Virtual Tour of the DSV ISS Office
https://social.dsv.com/2QS
DSV ISS
DSV Group is one of the world’s leading transport, freight forwarding and logistics companies. Our headquarters are located in Denmark and our offices – in more than 90 other countries.
DSV consists of following divisions: DSV ISS | DSV Road | DSV Air&Sea | DSV Solutions | DSV Services.
DSV International Shared Services (DSV ISS) in Warsaw is in a phase of dynamic development. We employ more than 1200 fantastic people and this number is constantly increasing.
We provide global IT services within areas like: Service Desk, Network, EDI, SAP, WMS, Software Development, Corporate Integration, Citrix.