Schwarz Digits schafft das technologische Fundament für digitale Entscheidungsfreiheit in Europa. Als IT- und Digitalsparte der Schwarz Gruppe entwickeln und verantworten wir einerseits die IT-Infrastrukturen für die Handelssparten Lidl und Kaufland sowie die Schwarz Produktion und PreZero. Gleichzeitig agieren wir als unabhängiger Anbieter am externen Markt, um Unternehmen in ganz Europa bei ihrer digitalen Transformation zu unterstützen. Unsere Kernleistungen bündeln wir in den Bereichen Cloud, Cyber Security, Data & AI, Communication und Workspace. Trage auch du zur digitalen Entscheidungsfreiheit in Europa bei.Bei uns arbeitest du an der Schnittstelle zwischen Agilität und Sicherheit: Du profitierst von den schnellen Entscheidungswegen, genießt echte Gestaltungsspielräume in deinen Projekten und baust dabei auf das stabile Fundament der Schwarz Gruppe.Deine AufgabenDevelop and operate productive ETL pipelines for reports, analysis and machine learning and ensure their quality and sustainabilityUse your software development skills and set new standards for development and deploymentOptimize the performance of data engineering solutions and guarantee their scalabilityEnsure data quality and consistency through data validation and cleansingMonitor and fix errors in the data infrastructure to minimize downtimeImplement data security and privacy measuresWork in interdisciplinary agile teams with data scientists, data engineers, product owners and departmentsDein Profil+4 years of industry experience as a Data EngineerExperience developing large scale batch & streaming ETLs in spark, preferably in DatabricksExpertise developing in Python. Scala knowledge is a plusGood command of Apache Airflow for workflow orchestrationExperience working in cloud environments, preferably GCPStrong hands-on experience with modern, open-source table formats such as Apache Iceberg or Delta Lake to manage large-scale data lakehouse architecturesProven track record managing data access controls, CLS, RLS and cataloging workflows. Experience with Unity Catalog is a plusHands-on experience working with containerized applications, preferably orchestrated in KubernetesExperience working with Google Pub/Sub is preferredKnowledge of the software development cycle and its best practices (e.g. CI/CD, DevOps, testing)Analytical skills, an eye for data quality, agile mindset, independence and hands-on mentality
Sourced from LinkedIn. Relocantly aggregates public job postings; apply on the original site.