SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Downloaden Sie, um offline zu lesen
“Where have all the hours gone?”
Medical Device Development - Death by documentation?
May 2015
Aligned AG
About Aligned AG
 Provider or Aligned Elements -
a Medical Device ALM
 Founded in 2006 in Zürich, Switzerland
 Team highly experienced in Medical
Device Development
 Experts in Medical Device
Documentation Management
Aligned AG
Medical Devices and Documentation
 Up to 30% of development effort
 The documents are interdependent
 Constant change in content
 Changing regulatory landscape
 Difficult to detect gaps and errors
 Large potential penalties
Aligned AG
Trends and Observations
 Curbs innovation velocity
 “Everyone” is documenting
 Continuously growing burden
 People get bored and leave the company
Aligned AG
Not all documents are alike
 Documentation is here to stay
 A competitive dimension
 Can we make it efficient?
 Note: A document ALWAYS incur a cost!
 Total Cost of Document
 What are the drivers for increased
documentation costs?
Aligned AG
Where is the work? Example I
4%
32%
19%
45%
Requirements
Specifications
Risk Analysis
V &V
Aligned AG
Where is the work? Example II
21%
25%
54%
Other
Design Output
V &V
Aligned AG
Where is the work? Example III
Type RQ Risk Spec Test Case Test Report
Avg. # Changes 1.8 3.6 6.3 8.5 2.4
Total # Items 251 992 1652 2370 2045
Aligned AG
What causes work? Example I
 Q manager 1: „Do not leave table cells empty, use dashes“
 Q manager 2: “Do not use dashes in table cells, use N/A”
 Q manager 3: “All N/A in table cells must be explicitly qualified”
Aligned AG
What causes work? Example II
References
Ref. # Document name Version
1 397884 Guideline test case template V1.1
2 01440_97555 Software tool validation plan trace matrix generator V1.3
3 01440_97556 TraceMatrixGenerator Specification Document V1.0
Aligned AG
Reasons
 Reality changes
 Templates/Process/People changes
Many vs. Few modifications
What can we do?
 Understand the true cost of template/process changes
 Reduce the risk for committing formal errors
 Reduce / outsource dependencies between documents
 Use automated tools to detect and correct inconsistencies
 Correcting “formal” errors
 Document interdependencies
Aligned AG
The more the merrier
Write
Dry run
Peer
review
Q review
Tester
Releases
Update
TC
Overview
Dry run
by other
Tester
Update
TC
overview
Ready
for real
test run
Aligned AG
Three is a crowd
 Signatures per Test Case: 3
 Total Number of signatures: 18000
 Avg. time to collect a signature: 0.5h
 Total time: 5 man-years
Aligned AG
Reasons
 Interdisciplinary documents
 Many stakeholders
Involves many vs. few people
What can we do?
 Ask yourself: “Does this make the product safer and better?”
 Reduce number of people involved
 Trim down Review – Release – Sign-off procedures
 Assign deputy rights
 “Enforce” responsibility
 Extensive workflows
Aligned AG
The extensive master template
Aligned AG
“One size fits all”- template
Aligned AG
Reasons
 Fear of non-compliance (“better safe than sorry”)
 Extensive master templates
 “One size fits all” - templates
Content vs. Overhead in Document
What can we do?
 Challenge template growth
 Identify and eliminate overhead sections and actions
 Allow for variation in the template
 Increase the content/overhead ratio by aggregation
Aligned AG
Rigid Workflows
 “I can’t sign this document before the author has signed it.”
 “The review cannot start until the draft is official.”
 “She can’t write the test case because she only has testing
authorization, not test case writing authorization.”
 “This test iteration does not start until all bugs have been
assigned to a tester.”
 „We cannot start until Q-manager has signed off the reqs.“
Aligned AG
Changing specifications
 Common knowledge says: “Start with testing early”
 The specifications are going to change
 Changing specifications =>
Test changes + Additional test cycles
 What shall we do? Write tests early or wait until the end?
Aligned AG
Reasons
 Reality changes
 Complex collaborations
Long time vs. Short time to completion
What can we do?
 Wait for stabilization, “Document late” / J.I.T when you need them
 Prepare for writing – set the table
 Separate stable data from unstable data
 Allow for variations in workflows
 Allow parallel workflows
 Data has not stabilized
 Rigid, sequential workflows
Aligned AG
Repetitive tasks I
21%
25%
54%
Other
Design Output
V &V
Aligned AG
Repetitive tasks II
 Monday morning:
Hi Bob,
The milestone is
coming up Friday.
Here is the 240
page document to
review!
Aligned AG
Reasons
 Reoccurring tasks (e.g. reviews)
 Design control item (e.g. Test Cases)
 Unwarranted division of content
Many instance vs. few instances
What can we do?
 Analyze the creation and modification process
 Relentlessly eliminate unnecessary process steps
 Use minimalistic templates
 Focus Reviews on changes
 Aggregate content where applicable
Aligned AG
The “ideal” document
 Easy to write
 Fast to complete
 High content vs. overhead ratio
 Involves few people
 Does not get sent around
 Few modifications
 Few dependencies
Aligned AG
 Administrative overhead in creation and modification of documents
 Template Designers  Documentation Executer
 Extensive Templates (capture all info needed for any situation)
 Templates that do not fit the task (“one size fits all”)
 Workflows involving lots of people (tends to create bottlenecks)
 Workflows with rigid order (“this can’t start until that is finished”)
 “Good intentions” can have unexpected effects
Common Culprits
Aligned AG
 Optimize process and templates for reoccurring doc types
 Trim down the master templates
 Allow for variations in templates
 Allow for variation in workflows
 Trim down the review-release-sign-off process
 Keep interdependencies in separate documents
 Use automated tools for version, change and trace management
Proposed solutions
Aligned AG
Aligned Elements – a medical device ALM
 Manages the Technical Documentation
 Version Control + Traceability + Documents
 Integrated Risk Management
 Integrated DHF Index
 Reviews + Workflows + E-signatures
 Automatically finds formal gaps and errors
 Ensures completeness and consistency
Thank You!Aligned AG
Binzmühlstrasse 210
CH-8050 Zürich
Switzerland
t +41 (0)44 312 50 20
f +41 (0)44 312 50 20
m info@aligned.ch
w www.aligned.ch

Weitere ähnliche Inhalte

Was ist angesagt?

Agile Development And Medtech
Agile Development And MedtechAgile Development And Medtech
Agile Development And MedtechRobert Ginsberg
 
General Principals Of Software Validation
General Principals Of Software ValidationGeneral Principals Of Software Validation
General Principals Of Software Validationstaciemarotta
 
QAdvis - software risk management based on IEC/ISO 62304
QAdvis - software risk management based on IEC/ISO 62304QAdvis - software risk management based on IEC/ISO 62304
QAdvis - software risk management based on IEC/ISO 62304Robert Ginsberg
 
IEC 62304: SDLC Conformance and Management
IEC 62304: SDLC Conformance and Management IEC 62304: SDLC Conformance and Management
IEC 62304: SDLC Conformance and Management MethodSense, Inc.
 
FDA/EC/WHO Expectations for Computer System Validation
FDA/EC/WHO Expectations for Computer System Validation FDA/EC/WHO Expectations for Computer System Validation
FDA/EC/WHO Expectations for Computer System Validation Muhammad Luqman Ikram
 
Software Quality Assurance and Testing at NIIT
Software Quality Assurance and Testing at NIITSoftware Quality Assurance and Testing at NIIT
Software Quality Assurance and Testing at NIITVikas Maheshwary
 
Gamp Riskbased Approch To Validation
Gamp Riskbased Approch To ValidationGamp Riskbased Approch To Validation
Gamp Riskbased Approch To ValidationRajendra Sadare
 
Quality iso-ieee-standards
Quality iso-ieee-standardsQuality iso-ieee-standards
Quality iso-ieee-standardsTestingGeeks
 
Codex validation Group presentation
Codex validation Group presentationCodex validation Group presentation
Codex validation Group presentationWalter Acevedo
 
How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...
How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...
How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...Intland Software GmbH
 
IoT Development; Managing hardware and software Development
IoT Development; Managing hardware and software DevelopmentIoT Development; Managing hardware and software Development
IoT Development; Managing hardware and software DevelopmentIntland Software GmbH
 
Overview of Computerized Systems Compliance Using the GAMP® 5 Guide
Overview of Computerized Systems Compliance Using the GAMP® 5 GuideOverview of Computerized Systems Compliance Using the GAMP® 5 Guide
Overview of Computerized Systems Compliance Using the GAMP® 5 GuideProPharma Group
 
Requirements of ISO 26262
Requirements of ISO 26262Requirements of ISO 26262
Requirements of ISO 26262Torben Haagh
 
Software Testing Life Cycle
Software Testing Life CycleSoftware Testing Life Cycle
Software Testing Life CycleUdayakumar Sree
 
Software Testing and Quality Assurance Assignment 3
Software Testing and Quality Assurance Assignment 3Software Testing and Quality Assurance Assignment 3
Software Testing and Quality Assurance Assignment 3Gurpreet singh
 
Secure SDLC Framework
Secure SDLC FrameworkSecure SDLC Framework
Secure SDLC FrameworkRishi Kant
 
Applying IEC 62304 Risk Management in Aligned Elements - the medical device ALM
Applying IEC 62304 Risk Management in Aligned Elements - the medical device ALMApplying IEC 62304 Risk Management in Aligned Elements - the medical device ALM
Applying IEC 62304 Risk Management in Aligned Elements - the medical device ALMAligned AG
 

Was ist angesagt? (20)

Agile Development And Medtech
Agile Development And MedtechAgile Development And Medtech
Agile Development And Medtech
 
General Principals Of Software Validation
General Principals Of Software ValidationGeneral Principals Of Software Validation
General Principals Of Software Validation
 
QAdvis - software risk management based on IEC/ISO 62304
QAdvis - software risk management based on IEC/ISO 62304QAdvis - software risk management based on IEC/ISO 62304
QAdvis - software risk management based on IEC/ISO 62304
 
IEC 62304: SDLC Conformance and Management
IEC 62304: SDLC Conformance and Management IEC 62304: SDLC Conformance and Management
IEC 62304: SDLC Conformance and Management
 
FDA/EC/WHO Expectations for Computer System Validation
FDA/EC/WHO Expectations for Computer System Validation FDA/EC/WHO Expectations for Computer System Validation
FDA/EC/WHO Expectations for Computer System Validation
 
Cv 1
Cv 1Cv 1
Cv 1
 
Software Quality Assurance and Testing at NIIT
Software Quality Assurance and Testing at NIITSoftware Quality Assurance and Testing at NIIT
Software Quality Assurance and Testing at NIIT
 
Gamp Riskbased Approch To Validation
Gamp Riskbased Approch To ValidationGamp Riskbased Approch To Validation
Gamp Riskbased Approch To Validation
 
Quality iso-ieee-standards
Quality iso-ieee-standardsQuality iso-ieee-standards
Quality iso-ieee-standards
 
Codex validation Group presentation
Codex validation Group presentationCodex validation Group presentation
Codex validation Group presentation
 
How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...
How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...
How to Achieve Gapless End-to-End Traceability in Hardware and Software Devel...
 
IoT Development; Managing hardware and software Development
IoT Development; Managing hardware and software DevelopmentIoT Development; Managing hardware and software Development
IoT Development; Managing hardware and software Development
 
Software Quality Assurance
Software Quality AssuranceSoftware Quality Assurance
Software Quality Assurance
 
Medical Device Software
Medical Device SoftwareMedical Device Software
Medical Device Software
 
Overview of Computerized Systems Compliance Using the GAMP® 5 Guide
Overview of Computerized Systems Compliance Using the GAMP® 5 GuideOverview of Computerized Systems Compliance Using the GAMP® 5 Guide
Overview of Computerized Systems Compliance Using the GAMP® 5 Guide
 
Requirements of ISO 26262
Requirements of ISO 26262Requirements of ISO 26262
Requirements of ISO 26262
 
Software Testing Life Cycle
Software Testing Life CycleSoftware Testing Life Cycle
Software Testing Life Cycle
 
Software Testing and Quality Assurance Assignment 3
Software Testing and Quality Assurance Assignment 3Software Testing and Quality Assurance Assignment 3
Software Testing and Quality Assurance Assignment 3
 
Secure SDLC Framework
Secure SDLC FrameworkSecure SDLC Framework
Secure SDLC Framework
 
Applying IEC 62304 Risk Management in Aligned Elements - the medical device ALM
Applying IEC 62304 Risk Management in Aligned Elements - the medical device ALMApplying IEC 62304 Risk Management in Aligned Elements - the medical device ALM
Applying IEC 62304 Risk Management in Aligned Elements - the medical device ALM
 

Andere mochten auch

Create Your Company Page
Create Your Company PageCreate Your Company Page
Create Your Company PageTariq Ahmad
 
Beyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability Matrix
Beyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability MatrixBeyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability Matrix
Beyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability MatrixSeapine Software
 
Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...
Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...
Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...Intland Software GmbH
 
Death to project documentation with eXtreme Programming
Death to project documentation with eXtreme ProgrammingDeath to project documentation with eXtreme Programming
Death to project documentation with eXtreme ProgrammingAlex Fernandez
 
ISO 14971 Risk Management - how others do it
ISO 14971 Risk Management - how others do itISO 14971 Risk Management - how others do it
ISO 14971 Risk Management - how others do itAligned AG
 
Building your credibility with LinkedIn
Building your credibility with LinkedInBuilding your credibility with LinkedIn
Building your credibility with LinkedInTariq Ahmad
 
What Is SEO? A Guide to Search Engine Optimization
What Is SEO? A Guide to Search Engine OptimizationWhat Is SEO? A Guide to Search Engine Optimization
What Is SEO? A Guide to Search Engine OptimizationWill Marlow Agency
 
The 7 Biggest Trends in SEO: 2016
The 7 Biggest Trends in SEO: 2016The 7 Biggest Trends in SEO: 2016
The 7 Biggest Trends in SEO: 2016Rand Fishkin
 
Introduction to SlideShare for Businesses
Introduction to SlideShare for BusinessesIntroduction to SlideShare for Businesses
Introduction to SlideShare for BusinessesSlideShare
 

Andere mochten auch (10)

Create Your Company Page
Create Your Company PageCreate Your Company Page
Create Your Company Page
 
Beyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability Matrix
Beyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability MatrixBeyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability Matrix
Beyond FDA Compliance Webinar: 5 Hidden Benefits of Your Traceability Matrix
 
Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...
Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...
Compliance with medical standards iec 62304, iso 14971, iec 60601, fda title ...
 
Death to project documentation with eXtreme Programming
Death to project documentation with eXtreme ProgrammingDeath to project documentation with eXtreme Programming
Death to project documentation with eXtreme Programming
 
ISO 14971 Risk Management - how others do it
ISO 14971 Risk Management - how others do itISO 14971 Risk Management - how others do it
ISO 14971 Risk Management - how others do it
 
Building your credibility with LinkedIn
Building your credibility with LinkedInBuilding your credibility with LinkedIn
Building your credibility with LinkedIn
 
What Is SEO? A Guide to Search Engine Optimization
What Is SEO? A Guide to Search Engine OptimizationWhat Is SEO? A Guide to Search Engine Optimization
What Is SEO? A Guide to Search Engine Optimization
 
The 7 Biggest Trends in SEO: 2016
The 7 Biggest Trends in SEO: 2016The 7 Biggest Trends in SEO: 2016
The 7 Biggest Trends in SEO: 2016
 
Introduction to SlideShare for Businesses
Introduction to SlideShare for BusinessesIntroduction to SlideShare for Businesses
Introduction to SlideShare for Businesses
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
 

Ähnlich wie Death by documentation - Medical Device Development Challenges

STLDODN - Agile Testing in a Waterfall World
STLDODN - Agile Testing in a Waterfall WorldSTLDODN - Agile Testing in a Waterfall World
STLDODN - Agile Testing in a Waterfall WorldAngela Dugan
 
Innovative Engineering Workshop Npi 30march10
Innovative Engineering Workshop   Npi   30march10Innovative Engineering Workshop   Npi   30march10
Innovative Engineering Workshop Npi 30march10mccall1966
 
Chicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall worldChicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall worldAngela Dugan
 
SCM: An Introduction
SCM: An IntroductionSCM: An Introduction
SCM: An IntroductionAlec Clews
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven TestingJorge Boria
 
Design For Six Sigma Overview
Design For Six Sigma OverviewDesign For Six Sigma Overview
Design For Six Sigma OverviewTravis Eck
 
Why don't small companies do big a agile?
Why don't small companies do big a agile?Why don't small companies do big a agile?
Why don't small companies do big a agile?activelylazy
 
Transactional Blackbelts are different
Transactional Blackbelts are differentTransactional Blackbelts are different
Transactional Blackbelts are differentreachab7
 
Who Needs Documentation Anyway?
Who Needs Documentation Anyway?Who Needs Documentation Anyway?
Who Needs Documentation Anyway?CEE-SEC(R)
 
Document Control
Document ControlDocument Control
Document ControlAnggi Hafiz
 
Best Practices for Rating and Policy Administration System Replacement
Best Practices for Rating and Policy Administration System ReplacementBest Practices for Rating and Policy Administration System Replacement
Best Practices for Rating and Policy Administration System ReplacementEdgewater
 
Agile Testing Pasadena JUG Aug2009
Agile Testing Pasadena JUG Aug2009Agile Testing Pasadena JUG Aug2009
Agile Testing Pasadena JUG Aug2009Grig Gheorghiu
 
Document Control
Document ControlDocument Control
Document ControlDan Junkins
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperRyan Dowd
 

Ähnlich wie Death by documentation - Medical Device Development Challenges (20)

STLDODN - Agile Testing in a Waterfall World
STLDODN - Agile Testing in a Waterfall WorldSTLDODN - Agile Testing in a Waterfall World
STLDODN - Agile Testing in a Waterfall World
 
Innovative Engineering Workshop Npi 30march10
Innovative Engineering Workshop   Npi   30march10Innovative Engineering Workshop   Npi   30march10
Innovative Engineering Workshop Npi 30march10
 
April 08
April 08April 08
April 08
 
Chicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall worldChicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall world
 
SCM: An Introduction
SCM: An IntroductionSCM: An Introduction
SCM: An Introduction
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven Testing
 
Design For Six Sigma Overview
Design For Six Sigma OverviewDesign For Six Sigma Overview
Design For Six Sigma Overview
 
Why don't small companies do big a agile?
Why don't small companies do big a agile?Why don't small companies do big a agile?
Why don't small companies do big a agile?
 
Transactional Blackbelts are different
Transactional Blackbelts are differentTransactional Blackbelts are different
Transactional Blackbelts are different
 
Who Needs Documentation Anyway?
Who Needs Documentation Anyway?Who Needs Documentation Anyway?
Who Needs Documentation Anyway?
 
Document Control
Document ControlDocument Control
Document Control
 
Document Control
Document ControlDocument Control
Document Control
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Best Practices for Rating and Policy Administration System Replacement
Best Practices for Rating and Policy Administration System ReplacementBest Practices for Rating and Policy Administration System Replacement
Best Practices for Rating and Policy Administration System Replacement
 
Agile Testing Pasadena JUG Aug2009
Agile Testing Pasadena JUG Aug2009Agile Testing Pasadena JUG Aug2009
Agile Testing Pasadena JUG Aug2009
 
Document Control
Document ControlDocument Control
Document Control
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - Whitepaper
 
Future of QA
Future of QAFuture of QA
Future of QA
 

Kürzlich hochgeladen

Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Servicevidya singh
 
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...Garima Khatri
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...aartirawatdelhi
 
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...indiancallgirl4rent
 
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls JaipurCall Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipurparulsinha
 
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...narwatsonia7
 
Call Girls Kochi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Kochi Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Kochi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Kochi Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...astropune
 
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...CALL GIRLS
 
Vip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls Available
Vip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls AvailableVip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls Available
Vip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls AvailableNehru place Escorts
 
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls JaipurRussian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipurparulsinha
 
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...narwatsonia7
 
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...Call Girls in Nagpur High Profile
 
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Nagpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Nagpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Nagpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Nagpur Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 

Kürzlich hochgeladen (20)

Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
 
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
 
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
 
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls JaipurCall Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
 
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
 
Call Girls Kochi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Kochi Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Kochi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Kochi Just Call 9907093804 Top Class Call Girl Service Available
 
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
 
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
 
Vip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls Available
Vip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls AvailableVip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls Available
Vip Call Girls Anna Salai Chennai 👉 8250192130 ❣️💯 Top Class Girls Available
 
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
 
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls JaipurRussian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
 
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
 
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
 
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
 
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Nagpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Nagpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Nagpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Nagpur Just Call 9907093804 Top Class Call Girl Service Available
 

Death by documentation - Medical Device Development Challenges

  • 1. “Where have all the hours gone?” Medical Device Development - Death by documentation? May 2015
  • 2. Aligned AG About Aligned AG  Provider or Aligned Elements - a Medical Device ALM  Founded in 2006 in Zürich, Switzerland  Team highly experienced in Medical Device Development  Experts in Medical Device Documentation Management
  • 3. Aligned AG Medical Devices and Documentation  Up to 30% of development effort  The documents are interdependent  Constant change in content  Changing regulatory landscape  Difficult to detect gaps and errors  Large potential penalties
  • 4. Aligned AG Trends and Observations  Curbs innovation velocity  “Everyone” is documenting  Continuously growing burden  People get bored and leave the company
  • 5. Aligned AG Not all documents are alike  Documentation is here to stay  A competitive dimension  Can we make it efficient?  Note: A document ALWAYS incur a cost!  Total Cost of Document  What are the drivers for increased documentation costs?
  • 6. Aligned AG Where is the work? Example I 4% 32% 19% 45% Requirements Specifications Risk Analysis V &V
  • 7. Aligned AG Where is the work? Example II 21% 25% 54% Other Design Output V &V
  • 8. Aligned AG Where is the work? Example III Type RQ Risk Spec Test Case Test Report Avg. # Changes 1.8 3.6 6.3 8.5 2.4 Total # Items 251 992 1652 2370 2045
  • 9. Aligned AG What causes work? Example I  Q manager 1: „Do not leave table cells empty, use dashes“  Q manager 2: “Do not use dashes in table cells, use N/A”  Q manager 3: “All N/A in table cells must be explicitly qualified”
  • 10. Aligned AG What causes work? Example II References Ref. # Document name Version 1 397884 Guideline test case template V1.1 2 01440_97555 Software tool validation plan trace matrix generator V1.3 3 01440_97556 TraceMatrixGenerator Specification Document V1.0
  • 11. Aligned AG Reasons  Reality changes  Templates/Process/People changes Many vs. Few modifications What can we do?  Understand the true cost of template/process changes  Reduce the risk for committing formal errors  Reduce / outsource dependencies between documents  Use automated tools to detect and correct inconsistencies  Correcting “formal” errors  Document interdependencies
  • 12. Aligned AG The more the merrier Write Dry run Peer review Q review Tester Releases Update TC Overview Dry run by other Tester Update TC overview Ready for real test run
  • 13. Aligned AG Three is a crowd  Signatures per Test Case: 3  Total Number of signatures: 18000  Avg. time to collect a signature: 0.5h  Total time: 5 man-years
  • 14. Aligned AG Reasons  Interdisciplinary documents  Many stakeholders Involves many vs. few people What can we do?  Ask yourself: “Does this make the product safer and better?”  Reduce number of people involved  Trim down Review – Release – Sign-off procedures  Assign deputy rights  “Enforce” responsibility  Extensive workflows
  • 15. Aligned AG The extensive master template
  • 16. Aligned AG “One size fits all”- template
  • 17. Aligned AG Reasons  Fear of non-compliance (“better safe than sorry”)  Extensive master templates  “One size fits all” - templates Content vs. Overhead in Document What can we do?  Challenge template growth  Identify and eliminate overhead sections and actions  Allow for variation in the template  Increase the content/overhead ratio by aggregation
  • 18. Aligned AG Rigid Workflows  “I can’t sign this document before the author has signed it.”  “The review cannot start until the draft is official.”  “She can’t write the test case because she only has testing authorization, not test case writing authorization.”  “This test iteration does not start until all bugs have been assigned to a tester.”  „We cannot start until Q-manager has signed off the reqs.“
  • 19. Aligned AG Changing specifications  Common knowledge says: “Start with testing early”  The specifications are going to change  Changing specifications => Test changes + Additional test cycles  What shall we do? Write tests early or wait until the end?
  • 20. Aligned AG Reasons  Reality changes  Complex collaborations Long time vs. Short time to completion What can we do?  Wait for stabilization, “Document late” / J.I.T when you need them  Prepare for writing – set the table  Separate stable data from unstable data  Allow for variations in workflows  Allow parallel workflows  Data has not stabilized  Rigid, sequential workflows
  • 21. Aligned AG Repetitive tasks I 21% 25% 54% Other Design Output V &V
  • 22. Aligned AG Repetitive tasks II  Monday morning: Hi Bob, The milestone is coming up Friday. Here is the 240 page document to review!
  • 23. Aligned AG Reasons  Reoccurring tasks (e.g. reviews)  Design control item (e.g. Test Cases)  Unwarranted division of content Many instance vs. few instances What can we do?  Analyze the creation and modification process  Relentlessly eliminate unnecessary process steps  Use minimalistic templates  Focus Reviews on changes  Aggregate content where applicable
  • 24. Aligned AG The “ideal” document  Easy to write  Fast to complete  High content vs. overhead ratio  Involves few people  Does not get sent around  Few modifications  Few dependencies
  • 25. Aligned AG  Administrative overhead in creation and modification of documents  Template Designers  Documentation Executer  Extensive Templates (capture all info needed for any situation)  Templates that do not fit the task (“one size fits all”)  Workflows involving lots of people (tends to create bottlenecks)  Workflows with rigid order (“this can’t start until that is finished”)  “Good intentions” can have unexpected effects Common Culprits
  • 26. Aligned AG  Optimize process and templates for reoccurring doc types  Trim down the master templates  Allow for variations in templates  Allow for variation in workflows  Trim down the review-release-sign-off process  Keep interdependencies in separate documents  Use automated tools for version, change and trace management Proposed solutions
  • 27. Aligned AG Aligned Elements – a medical device ALM  Manages the Technical Documentation  Version Control + Traceability + Documents  Integrated Risk Management  Integrated DHF Index  Reviews + Workflows + E-signatures  Automatically finds formal gaps and errors  Ensures completeness and consistency
  • 28. Thank You!Aligned AG Binzmühlstrasse 210 CH-8050 Zürich Switzerland t +41 (0)44 312 50 20 f +41 (0)44 312 50 20 m info@aligned.ch w www.aligned.ch