Data Engineer

Wymagane

• Python

• Java

• Hadoop

• MongoDB

• SQL

• 3+ years of professional programming experience and hands-on experience in building modern data platforms/pipelines

• At least one programming language: Python / Scala / Java

• Experience in job orchestration (Airflow, Composer, etc)

• At least two of the following skillsets:

• Experience in one of the major Cloud Hyperscalers (AWS, Azure, GCP)

• Experience in Data Engineering related technology stack (Azure Synapse, ADF, AWS Glue, Google Big Query - this is not an exhaustive list)

• Databricks or Snowflake is a plus

• Active certificates are a plus

• Knowledge of more than one cloud is a plus

• Experience in Big Data technologies (in the cloud or on-prem)

• Spark (Scala or pySpark)

• Hadoop, HDFS, Hive/Impala, Pig

• Familiarity with Big Data file formats

• MongoDB or Cassandra is a plus

• Familiarity with data lake architectures is a plus

• Experience in SQL

• Data modeling (Kimball, Inmon, Data Vault, etc)

• Advanced SQL in any SQL dialect

• Commercial and open-source databases

• Hive / Impala

• Presto / Trino

• Experience building ETL processes for data warehousing solutions

• Consultancy experience

• Previous experience gained in mid-size/large, international companies

• Fluent communication skills in English

Mile widziane

• “Hold my beer – I got this” attitude

• Insight Geek needs constant feeding

• Strong communication skills