Lead Data Engineer
Globaldev Group
Responsibilities:
- Manage the end to end data pipelines that pull data from operational system and from different end points, transform and load the data to the company data lake
- Current environment is set up on hadoop, but the team will be responsible to complete migration to a new Spark based environment on AWS
Qualifications:
- 4+ years of hands-on experience as a Data Engineer
- BA/BSc in a related field such as CS, engineering, information systems, or equivalent.
- High proficiency in SQL & Python
- Experience working with cloud-hosted data warehouses (Hive, Snowflake)
- Hands-on experience with developing end-to-end ETL/ELT processes (Spark and SQL)
- Experience with the Hadoop framework and parallel computing (EMR, HIVE, Presto/Trino/Athena, Glue)
- Proven experience with data warehousing, modeling paradigms, and architectures, proficient in DWH methodologies and best practices
Will be a plus:
- Familiar with Kafka, Confluent, Fluentd, Spark, and Airflow
- Experience with data visualization tools such as Tableau
- Experience with the media or TV industry – an advantage
Soft skills:
- Strong analytical skills and attention to detail
- Team player
- Ability to handle several tasks simultaneously
- Comfortable working independently and leading projects from end to end
About the company
Globaldev Group is a team of professionals specializing in creating engineering teams for technological businesses for the Western Europe, Israel, USA. Only long-term product teams for EU with investments and a modern stack of technologies.
We set up the company in 2010 in Kharkiv. In 2017 we opened the office in Berlin. Currently, there are 220 of us and we are constantly growing.
Now in 2022 we have development hubs in Israel, Ukraine, Portugal and Poland.
If you’re interested in joining the team and taking part in decision making that will affect the product and business – let us know!
Source ⇲
remotive.com