🇪🇸 Madrid, Spain · 2w ago
Sr Engineer – GenAI Quality Assurance
Johnson & Johnson Innovative Medicine
LinkedInseniorEnglish-friendly
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com.As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.Job FunctionR&D Product DevelopmentJob Sub FunctionR&D Machine LearningJob CategoryScientific/TechnologyAll Job Posting Locations:Cornellà de Llobregat, Barcelona, Spain, Madrid, SpainJob DescriptionJohnson & Johnson Innovative Medicine R&D Data Science and Digital Health is recruiting for a Senior Engineer – GenAI Quality Assurance. This role can be based in Madrid or Barcelona. Hybrid working.J&J Innovative Medicine develops treatments that improve the health of people worldwide. Research and development areas encompass oncology, immunology, neuroscience, cardiopulmonary and specialty ophthalmology. Our goal is to help people live longer, healthier lives. We have produced and marketed many first-in-class prescription medications and are poised to serve the broad needs of the healthcare market – from patients to practitioners and from clinics to hospitals. To learn more about Johnson & Johnson Innovative Medicine visit https://innovativemedicine.jnj.com/Description: We’re hiring a professional who specializes in designing, testing, and refining complex GenAI applications, primarily in scientific or ML-driven environments. You'll be responsible for validating, stress-testing, and improving Gen-AI powered products (pipelines and AI-assisted workflows) across the product lifecycle – from pre-deployment validation to post-release monitoring.Key ResponsibilitiesDesign and implement automated and manual QA strategies for GenAI systemsBuild regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy, grounding, robustness, safetyValidate prompt logic, model behavior and evaluation metricsExecute tests and debug pipelinesSupport deployment of GenAI productsLead system design reviews, advocating best practices for architecture and reliability of GenAI applicationsCollaborate closely with data scientists and developers to embed testing and quality checkpointsEstablish testing standards and workflows for continuous integration and deploymentConduct code reviews with a focus on design, testability, and maintainabilityDocument system design decisions, test cases, and best practicesClose collaboration with domain experts and stakeholders to validate developed solutionsTechnical Skills & Experience NeededStrong software engineering background with QA ownershipFamiliarity with RAG & Graph frameworks3+ years of experience as a software engineer (preferably 5), or QA engineer in production systems, preferably including at least 1 year experience in GenAI systemsAdvanced Python skillsExperience working with LLM-based systems in real environmentsHands-on experience with:LLM APIsAWS Bedrock (Anthropic & OSS)Azure Foundry (OpenAI)GCP (Gemini)Cloud platforms (AWS, Azure, GCP)Proven ability to implement test frameworks for GenAI applicationsKnowledge of API testing, data validation, and data pipeline testingExperience with version control (Git)Experience with building and deploying AI/ML products through the full product lifecycleGood understanding of scientific computing and ML frameworksSolid understanding of safety, bias, and failure modes of GenAI systemsComfortable working in a relatively fast-moving environment where priorities may shift and initiative is valuedProactive problem-solver who can anticipate needs and find solutionsComfortable working independently, but also a strong team playerNice-to-HaveExperience with Jenkins, SonarqubeMonitoring and observability tools (Prometheus, Grafana etc)Devops experience (docker, jenkins)Experience deploying GenAI services to production at scaleExposure to ML Ops or production ML systems#JRDDS#JNJDataScience#JRDRequired SkillsLarge Language Models (LLMs), Microsoft Azure AI foundry, OpenAI, Python (Programming Language), Software Quality Assurance (SQA)Preferred SkillsArtificial Intelligence (AI), Coaching, Cognitive Computing, Critical Thinking, Cross-Functional Collaboration, Curious Mindset, Data Structures, Distributed Computing, Emerging Technologies, Human-Computer Relationships, Machine Learning (ML), Persistence and Tenacity, Program Management, Research and Development, SAP Product Lifecycle Management, Scripting Languages, Technologically SavvySourced from LinkedIn. Relocantly aggregates public job postings; apply on the original site.