🇵🇱 Warszawa, Poland · 5w ago

Senior Data Engineer (PostgreSQL & Databricks)

Webellian Sp. z o.o.

Pracuj.plseniorEnglish-friendlyonsite
Your responsibilities, Design and build scalable data pipelines for ingestion, transformation, and serving of structured and unstructured data — supporting both batch and real-time AI workloads., Develop and maintain Databricks-based data processing workflows: Delta Lake table management, PySpark transformations, notebook orchestration, and Unity Catalog governance., Architect and optimise PostgreSQL data models: schema design, indexing strategies, partitioning, query performance tuning, and integration patterns for AI service consumption., Build and maintain data orchestration workflows using Apache Airflow, Databricks Workflows, or equivalent — ensuring reliable scheduling, dependency management, and failure recovery., Implement data quality frameworks: validation rules, anomaly detection, data contracts, and automated alerting on pipeline health and data freshness., Design and manage feature engineering pipelines: transforming raw data into ML-ready feature sets, integrating with feature stores, and versioning feature definitions., Own data integration patterns between operational PostgreSQL databases and the Databricks lakehouse: CDC (Change Data Capture), event-driven ingestion via Kafka, and batch export strategies., Implement data governance standards: lineage tracking, cataloguing, access control, PII handling, data retention policies, and audit logging., Collaborate with ML Engineers to design and deliver data pipelines supporting model training, batch inference, and real-time feature serving., Monitor and operate data infrastructure: pipeline observability dashboards, SLA tracking, incident response, and root-cause analysis for data issues., Champion Claude Code as an active daily tool for pipeline development, SQL generation, data exploration scripting, and documentation. What we offer, Contract under Polish law: B2B or Umowa o Pracę, Benefits such as private medical care, group insurance, Multisport card, English classes available, Hybrid work (at least 1 day/week on-site) in Warsaw (Mokotów), Opportunity to work with excellent professionals, High standards of work and focus on the quality of code, New technologies in use, Continuously learning and growth, International team, Pinball, PlayStation & much more (on-site)

Sourced from Pracuj.pl. Relocantly aggregates public job postings; apply on the original site.