🇪🇸 Madrid, Spain · 2w ago
Platform Engineer
System Recruitment Specialists
LinkedInmidEnglish-friendly
Databricks Platform / DevOps Engineer (Azure)Hybrid - 2 days a week in the office in MadridABOUT THE ROLEAs a Databricks Platform Engineer within the Infrastructure function, you will focus on the secure, scalable, and reliable operation of a Databricks platform in the Azure cloud. You will play a key role in automating infrastructure, integrating platform capabilities into broader enterprise services, and ensuring strong networking, storage, and governance alignment.You will collaborate closely with platform, security, and data teams to deliver a high-performing and compliant analytics environment.YOUR RESPONSIBILITIESAdminister and operate Databricks workspaces, jobs, clusters, and Unity Catalog across multiple environmentsAutomate infrastructure provisioning and platform operations using Terraform, CI/CD pipelines, and Databricks APIsEnsure robust network integration, including secure VNet peering, firewall rules, and private endpoint configurationsSupport integration with Azure Blob Storage, ensuring efficient and secure data access for ingestion and analytics use casesConfigure and troubleshoot external database connections (e.g. via JDBC) and downstream system integrationsManage access control and identity using SCIM, Azure Active Directory, and role-based permissions across workspaces and Unity CatalogImplement and maintain platform observability through telemetry pipelines (e.g. Datadog, Grafana, Dagster/Dragster)Collaborate with security teams to ensure compliance with policies and standards (e.g. encryption, audit logging, GDPR)Contribute to API integrations, including working with API gateways to interface Databricks workloads with internal and external servicesDevelop and maintain platform documentation, reusable modules, and operational runbooksAct as a technical point of contact for platform-related issues and incident resolutionWHAT YOU BRINGDegree in Computer Science, IT, or a related technical fieldProven experience operating Databricks in enterprise or cloud-native environmentsStrong hands-on expertise in Azure networking (VNet integration, firewalls, and network security controls)Experience integrating Databricks with Azure Blob Storage, external databases, and enterprise APIsWorking knowledge of API gateways (e.g. Azure API Management) and secure API exposure/consumptionProficiency in Terraform, Azure DevOps, and scripting languages such as Python or ShellSolid understanding of authentication, authorization, and identity federation in cloud environmentsExperience with cost monitoring and performance optimisation in Databricks and AzureStrong communication skills with a collaborative, team-oriented mindsetFluent EnglishTECHNOLOGIES YOU’LL WORK WITHCloud & Infrastructure: Microsoft Azure, Azure VNet, Private Endpoints, Blob Storage, API ManagementData Platform: Databricks, Delta Lake, Unity Catalog, SparkIaC & Automation: Terraform, Azure DevOps, GitHub/Bitbucket, CI/CDIntegration & Scripting: Python, REST APIs, JDBC, SCIMObservability: Datadog, Grafana, Dagster/DragsterOther: Docker, Linux, Azure Active DirectoryNICE TO HAVEExperience with multi-workspace governance and account-level Databricks configurationsFamiliarity with container platforms (e.g. AKS, Docker)Experience working in regulated environments (e.g. energy, finance)Knowledge of orchestration tools such as Airflow or DagsterSourced from LinkedIn. Relocantly aggregates public job postings; apply on the original site.