Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1Rz8Uys. Sangeeta Narayanan looks at the role of containers in simplifying and increasing the reliability of the process of releasing and operating the Netflix software. Filmed at qconsf.com. Sangeeta Narayanan leads the Edge Infrastructure & Delivery team at Netflix. Among other things, her team develops the infrastructure that enables the Netflix API service to be updated on-demand, without adversely impacting the user experience for millions of customers worldwide. Sangeeta has held different roles at various software companies, large and small.

1. Containers at Netflix - An
Evolving Story
Sangeeta Narayanan
Engineering Manager @Netflix
@sangeetan

2. InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month
Watch the video with slide
synchronization on InfoQ.com!
http://www.infoq.com/presentations
/netflix-containers

3. Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
Presented at QCon San Francisco
www.qconsf.com

5. Going Global
Recent Launches: Italy, Spain, Portugal
Early 2016: Korea, Hong Kong, Taiwan, Singapore

6. Growing BIGGER

7. Winning Moments of Truth

9. Getting BETTER

10. Jan
Apr
Jul
O
ct
2015

11. Jan
Apr
Jul
O
ct
2015

12. Jan
Apr
Jul
O
ct
2015
A/B Tests
New features

13. Jan
Apr
Jul
O
ct
2015
A/B Tests
New features
Device Launches

14. Going FASTER

18. Cloud Native Architecture

19. Automation & Tooling

20. Culture

21. New Considerations
Diversity - Users, Tech stacks, Workloads
Dev Ex - Dev iterations, Debugging, Packaging
Rapid Delivery
Resource Sharing

26. Dev-centric packaging &
reproducibility
Infrastructure abstraction
Faster dev iterations
Resource sharing
Why Docker?

28. Docker @Netflix - Use Cases
Algorithms Engineering
Data Pipeline
Edge Engineering

29. Docker @Netflix - Use Cases
Algorithms Engineering
Data Pipeline
Edge Engineering

30. Algorithms Engineering
R&D of algorithmic components for product

32. Precompute
Online
Services
Model Trainer
New data available

33. Infrastructure abstraction
Polyglot support & Local Dev Ex
Dynamic resource allocation &
distributed job scheduling
Requirements

34. Model Trainer Online
Services
Precompute
New data available
Distributed scheduler
+

35. Distributed Scheduling & Task Management
Model Trainer Spinnaker Other Apps
Fenzo

36. Infrastructure abstraction
Polyglot + Local Dev
Distributed Scheduling
Num of Containers

37. Docker @Netflix - Use Cases
Algorithms Engineering
Data Pipeline
Edge Engineering

38. Data Pipeline
Publish, Collect, Process, Move Data

41. Local Dev Ex
Infrastructure abstraction
Fine-grained resource management
Requirements

42. Job

43. Infrastructure abstraction
Local Dev Ex
Fine grained resource Management
Num of Containers

44. Docker @Netflix - Use Cases
Algorithms Engineering
Data Pipeline
Edge Engineering

45. Edge Engineering
Entry point to Netflix for all device traffic

46. Automation & Tools

47. Automation & Tools
Node.js
Html,
JS

48. Infrastructure abstraction
Local dev, Polyglot - Java, Groovy,
Node.js
Fine-grained resource
management
Requirements

49. Ops Tooling
Networking, IPC
Security
Insights
Failure Testing
Performance
And more…
Requirements++
Long running Services
vs.
Batch Jobs

50. Ops Tooling
Networking, IPC
Security
Insights
Failure Testing
Performance
And more…
Requirements++
Long running Services
vs.
Batch Jobs

52. Local Dev
Test/
Debug
Open PR
CI
Build/Test
AMI
Bakery
Deploy
Spinnaker
Dist Job
Sched

56. Gradle docker plugin to generate Dockerfile
Spinnaker CloudProvider provides abstraction
Bakery support for image generation
Docker registry for internal images
libnetwork plugin for addressable IP
Building out the pieces

57. Dev Ex Wins
Faster dev iterations
Run prod image locally; attach debugger
Multiple branch/config variations
Hot reloading of files
‘Roman Riding’ with AMIs

58. ONNot There Yet!

59. ‘PaaS-like' Dev Experience
Production scale/Operational readiness
Optimized resource utilization

60. Infrastructure Abstraction
Dev Ex
Production ready Online Services
Polyglot env, Packaging

62. Thank You
@sangeetan

63. The Netflix Algorithms Engineering & Data Pipeline
teams
Acknowledgements
Photo Creditshttps://goo.gl/sP5T4X
https://goo.gl/JaNlyf
https://goo.gl/rZXws1
http://goo.gl/V4UFmR
https://goo.gl/R08GPQ
http://tastyk.deviantart.com/art/Evolution-149719618
https://goo.gl/W2UKv0
https://goo.gl/fRcpPN
https://goo.gl/tF199H
https://goo.gl/K1OH9T wildflowers
https://goo.gl/KSaL5s roadmap
https://goo.gl/8JCDQy odometer
https://goo.gl/c4RuSR takeaway box

64. Watch the video with slide synchronization on
InfoQ.com!
http://www.infoq.com/presentations/netflix-
containers