10. @chapo
App A App B App C App D
End-User
Apps
Service Oriented Architecture
Core
Services
Service
A
Service
B
Service
D
Service
C
Service
E
A/B
Testing
Service
11. @chapo
Develop an A/B Testing Service
(the product)
The Challenge
For Developers Across the Enterprise
(the users)
To Fuel Insight-Driven Development
(the payoff)
16. @chapo
A/B Testing
Platform
Success
Experiments
per week
New End-User
features
# Users vs target
Time to consumption
Lagging Indicators Leading Indicators
Ease of use of
platform
Awareness of
platform across
dev community
Quality of
platform
Ease of
implementing
change
Visits to services directory
Enhancements requested
Uptime
Time to insight
Test results reflect reality?
Enhancement backlog
17. Data shifts the conversation
from “I think” to “I know”
1
@chapo
19. @chapo
Develop a Real-Time Reporting Dashboard
(the product)
The Challenge
For Store Managers while on the shop floor
(the users)
To improve Customer Experience and Sales
(the payoff)
20. @chapo
137“core” metrics
Gross sales
Transactions
Returns
Wait time
NetPromoter Score
Traffic
Conversion
Product category sales
Managers on staff
Employees on staff
Manager tenure
Store size
Store layout
In-stock percent
Shrink
Employee engagement
Customer segments
Number of cashiers
Net sales
Employee knowledge
Illustrative example
29. @chapo
What?
Why?
What is Likely?
What If?
Key Questions Methods
SAP Hana
Data Cleansing
Time-series
Decision trees
http://www.sap.com/customer-testimonials/high-tech/ebay.html