Pracodawca zakończył zbieranie zgłoszeń na tę ofertę
Big Data Engineer
KITRUM
- Company location
Yaroslavska St, 58 Kyiv, Ukraine
abroad - offer expired 8 days ago
- contract for specific work
- full-time
- specialist (Mid / Regular)
- home office work
- Immediate employment
- remote recruitment
- запрошуємо працівників з України
- Робота для іноземцівбез польської
Poland (remote work)
- Specializations:Big Data / Data Science
Technologies we use
Expected
Hadoop
Apache Spark
Hive
Flink
Samza
Storm
Elasticsearch
Druid
Cassandra
Scala
SQL
Optional
Kafka
AWS
Jira
Slack
JetBrains IDEs
Git
GitLab
Docker
Jenkins
Terraform
DataBricks
About the project
Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform.
The platform allows:
• anyone to share his/her ideas with the world;
• access to audio books;
• access to world’s composers who publish their music;
• incorporates articles from private publishers and world magazines;
• allows access to exclusive content.
Core Platform provides robust and foundational software, increasing operational excellence to scale apps and data. We are focused on building, testing, deploying apps and infrastructure which will help other teams rapidly scale, inter-operate, integrate with real-time data, and incorporate machine learning into their products. Working with our customers in the Data Science and Content Engineering, and our peers in Internal Tools and Infrastructure teams we bring systems-level visibility and focus to our projects.
Client’s goal is not total architectural or design perfection, but rather choosing the right trade-offs to strike a balance between speed, quality and cost.
Your responsibilities
Manage data quality and integrity
Assist with building tools and technology to ensure that downstream customers can have faith in the data they’re consuming
Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines
Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets
Our requirements
3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets.
Proficiency in Spark
Expertise in Scala, and/or Python
Fluency with at least one dialect of SQL
Level of English: Upper-Intermediate
Optional
Experience with Streaming platforms, typically based around Kafka
Experience in Terraform, Airflow
Strong grasp of AWS data platform services and their strengths/weaknesses
Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins
Experience using DataBricks
This is how we organize our work
This is how we work
- at the client's site
- you have influence on the choice of tools and technologies
- you have influence on the technological solutions applied
- you have influence on the product
Development opportunities we offer
development budget
external training
What we offer
High compensation according to your technical skills
Long-term projects (12m+) with great Customers
5-day working week, 8-hour working day, flexible schedule
Democratic management style & friendly environment
Full remote
Annual Paid vacation — 20 b/days + unpaid vacation
Paid sick leaves — 6 b/days per year
12 national holidays
Corporate Perks (external training, English courses, corporate events/team buildings)
Professional and personal growth
Recruitment interview
Technical interview
Client interview
Why us?
We realize that one of the most crucial things for developers — is adequate clients and fascinating projects. So we qualify our clients to make sure that they:
— have an idea that they believe will make the world a better place;
— think long-term and looking for a trusted-tech partner;
— want to rely on and avoid micromanaging;
— are not jackasses :-)
KITRUM
KitRUM is a one-stop custom software development company headquartered in sunny Florida with development centers in Ukraine and Poland.
With a pool of 300+ top-notch engineering resources, we help CxOs of VC-backed startups and fast-growing tech companies in the US, EU and Australia to custom build software engineering teams packed with top-tier talent.