ARC330_How the BBC Built a Massive Media Pipeline Using Microservices

•

4 gefällt mir•610 views

The BBC iPlayer is the biggest audio and video-on-demand service in the UK. Over one-third of the country submits 10 million video playback requests every day, and the service publishes over 10,000 hours of media every week. Moving iPlayer to the cloud has enabled the BBC to shorten the time-to-market of content from 10 hours to 15 minutes. In this session, the BBC’s lead architect describes the approach behind creating iPlayer architecture, which uses Amazon SQS and Amazon SNS in several ways to improve elasticity, reliability, and maintainability. You see how BBC uses AWS messaging to choreograph the 200 microservices in the iPlayer pipeline, maintain data consistency as media traverses the pipeline, and refresh caches to ensure timely delivery of media to users. This is a rare opportunity to see the internal workings and best practices of one of the largest on-demand content delivery systems operating today.

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
How the BBC Built a Massive Media
Pipeline Using Microservices
S t e p h e n G o d w i n , L e a d A r c h i t e c t , B r i t i s h B r o a d c a s t i n g C o r p o r a t i o n ( B B C )
R o b e r t C h o w , P r i n c i p a l P r o d u c t M a n a g e r , A W S ( S Q S a n d S N S )
A R C 3 3 0
N o v e m b e r 2 8 , 2 0 1 7

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Where we’re going
Messaging overview
BBC iPlayer
• Background
• Challenges
• Transformation to microservices
• The role of messaging
• Results
• Pitfalls and best practices
Wrap-up
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
System building blocks for modern
applications
DatabaseCompute Storage Messaging

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Simple Queue Service (SQS)
• Asynchronous
• Each message processed by
one consumer
Simple Notification Service
(SNS)
• Pub/sub
• Broadcast or filtered
• High fan-out of messages
Amazon SQS & SNS: Decouple applications

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Stephen Godwin
• Lead technical architect at the BBC
• Designed the systems that provides audio and video
to BBC iPlayer and iPlayer Radio
• Led the migration of the systems that power iPlayer
to a cloud-based microservice architecture
• Worked for nearly 10 years as one of the developers
of IBM WebSphere@SteveGodwin

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
03
PERCENT
OF THE UK
POPULATION
WATCHED BY

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
01 THOUSAND HOURS
OF MEDIA PUBLISHED
EVERY WEEK

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A NEW PROGRAM
IS AVAILABLE
ON iPLAYER 51
EVERY
MINUTES

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Increasing
demand and
instability

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A perfect pattern for an elastic
architecture
Fri Oct 18 Sun Oct 20 Tue Oct 22 Thu Oct 24
transcode_requests

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Broadcast
video feed x
24
Video
chunker
Time
addressable
media store
FFmpeg
Pre-delivered
content
Media
distribution
service
PaaS
Transcode
service
Playout
event feed
Live Ingest
Logic
We are
here
Inside iPlayer: Video factoryInside iPlayer: Live Ingest Logic

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Playout
event feed
Rights
checker
Inside the Live Ingest Logic service
Live Ingest Logic
Live Ingest
Logic
Broadcast
event notifier
Interactive
TV services
Other
TV services

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Broadcast
event notifier
Playout
event feed
Rights
checker
Live Ingest Logic
Using messaging to wire the system
Time
addressable
media store
Media
distribution
service
Pre-delivered
content
Broadcast
video feed x
24
Video
chunker
FFmpeg PaaS
Transcode
service

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Message-oriented microservices pattern
Service
SQS
In Q
SQS
Out Q

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Message-oriented microservices pattern
EC2 instance
Service
SQS
In Q
SQS
Out Q

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Scaling to handle peaks
Service
Service
Service
SQS
In Q
Auto Scaling group

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Service
Resiliency and durability
Service
Service
Auto Scaling group
SQS
In Q
SQS
Out Q

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Error handling
EC2 instance
Service
SQS
In Q
SQS
Out Q
SQS
dead letter Q

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Playout
event feed
Broadcast
video feed x
24
Video
chunker
FFmpeg
Pre-delivered
content
PaaS
Transcode
service
Live Ingest
Logic
Media
distribution
service
Time
addressable
media store
We are
here
Inside iPlayer: Time addressable media store

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Event-driven trace and analysis
Request
received
Found all
chunks
Created
new file
File
complete
Time
addressable
media store

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Inside iPlayer: Media distribution service
Playout
event feed
Broadcast
video feed x
24
Video
chunker
Time
addressable
media store
FFmpeg
Pre-delivered
content
PaaS
Transcode
service
Live Ingest
Logic
We are all the
way over here
Media
distribution
service

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Refreshing caches for data consistency
Synchronous call
Asynchronous call
Availability
database
Media distribution
service
Audience
Read Update

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Where we ended up
Happier audience
Faster time to deployment
Easy extensibility and reuse
Massive scalability
Improved resilience
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Designing for idempotency
Elastic scaling is great—linear scaling is better
Reliable pipelines of microservices
Think about how you will debug your system

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
aws.amazon.com/sqs/getting-started
aws.amazon.com/sns/getting-started
L E A R N M O R E

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!

Weitere ähnliche Inhalte

Was ist angesagt?

POOQ - Content Alliance Platform is the primary OTT service provider in Korea. In this session, we discuss how Content Alliance Platform migrated its workloads to AWS this year using AWS Elemental Cloud, Amazon CloudFront, and other AWS services. After their initial migration, Content Alliance Platform has continuously optimized video transcoding for better quality and cost-effective delivery using CloudFront. To achieve this, they developed various video profiles using AWS Elemental Live, according to the content, by using various CloudFront features, such as geo-blocking, signed cookies and URLs, and HTTPS with ACM, and by adopting various new media technologies, such as H.265, UHD, VBR, and HFR. Finally, we discuss how Content Alliance Platform is developing its next generation of OTT services using microservice architecture with Docker.

CTD303_Korea’s Largest OTT provider

Amazon Web Services

Increasingly, organizations are turning to microservices to help them empower autonomous teams, letting them innovate and ship software faster than ever before. But implementing a microservices architecture comes with a number of new challenges that need to be dealt with. Chief among these finding an appropriate platform to help manage a growing number of independently deployable services. In this session, Sam Newman, author of Building Microservices and a renowned expert in microservices strategy, will discuss strategies for building scalable and robust microservices architectures, how to choose the right platform for building microservices, and common challenges and mistakes organizations make when they move to microservices architectures."

CON208_Building Microservices on AWS

Amazon Web Services

Find out how Citrix built a solution using Matillion ETL for Amazon Redshift from AWS Marketplace to load all data into an Amazon Redshift cluster, allowing them to do their analytics on the entire environment at a single time. We’ll discuss the transition made to consolidate multiple disparate databases in order to run analytic workloads, get a holistic view of all their data sources, and prevent inconsistent data from being captured.

MSC203_How Citrix Uses AWS Marketplace Solutions To Accelerate Analytic Workl...

Amazon Web Services

As enterprises move to the cloud, robust connectivity is often an early consideration. AWS Direct Connect provides a more consistent network experience for accessing your AWS resources, typically with greater bandwidth and reduced network costs. This session dives deep into the features of AWS Direct Connect and VPNs. We discuss deployment architectures and the process from start to finish. We show you how to configure public and private virtual interfaces, configure routers, use VPN backup, and provide secure communication between sites by using the AWS VPN CloudHub.

Deep Dive: AWS Direct Connect and VPNs - NET403 - re:Invent 2017

Amazon Web Services

This is your chance to learn directly from top CTOs and Cloud Architects from some of the most innovative AWS customers. In this lightning round session, we'll have an action-packed hour, jumping straight to the architecture and technical detail for some of the most innovative data storage solutions of 2017. Hear how Insitu collects and analyzes data from drone flights in the field with AWS Snowball Edge. See how iRobot collects and analyzes IoT data from their robotic vacuums, mops, and pool cleaners. Learn how Viber maintains a petabyte-scale data lake on Amazon S3. Understand how Alert Logic scales their massive SaaS cloud security solution on Amazon S3 & Amazon Glacier.

STG401_This Is My Architecture

Amazon Web Services

Get a deep-dive planning and implementation analysis of Asurion’s “All in AWS Edge” migration. Jabez Abraham, Cloud Architect of Asurion, discusses their AWS edge location strategy including: Amazon CloudFront, AWS WAF, AWS Shield Advanced, and AWS Lambda@Edge, and engagement of partners. Jabez shares premigration strategy, architectural reviews, A/B testing requirements, caching, and shielding of endpoints within the VPC, and partner engagements.

CTD307_Case Study How Mobile Device Service Company Asurion Architected Its A...

Amazon Web Services

In this session, we cover an integration of Amazon Lex with a contact center solution. We demonstrate how an Amazon Lex chatbot can be inserted into an interactive voice response (IVR) workflow in a contact center, enabling users to interact with the chatbot using natural language. We walk through a ready-to-deploy integration that includes building the bot, setting up the IVR, and managing the call routing. We also describe the best practices for selective routing based on user intent, exchange of information between the chatbot/IVR, and handover to a human agent.

MCL207_Amazon Lex Integration with IVR

Amazon Web Services

Deep Dive on Amazon Glacier - STG303 - re:Invent 2017

Amazon Web Services

by Rich Cowper, Solutions Architect Manager & Itzik Paz, Solutions Architect, AWS Calling all serverless developers! Wild Rydes (www.wildrydes.com), the world’s leading unicorn transportation startup, needs your help! The company's rydesharing network of unicorns has grown to thousands, fulfilling hundreds of thousands of passenger rydes each day. Your mission is to collect, store, process, and analyze data to track the real-time location and health of our unicorns. In this workshop, learn how to build infrastructure to process data streams in real time using Amazon Kinesis. Build serverless applications using Amazon Kinesis Analytics to aggregate and summarize data, and use AWS Lambda to store aggregated data in Amazon DynamoDB. Finally, use Amazon Kinesis Firehose to build a data lake in Amazon S3, and use Amazon Athena to run ad-hoc queries against it. Requirements: laptop, text editor, AWS account, and AWS Command Line Interface (CLI) installed and configured.

Building Serverless Real-time Data Processing (workshop)

Amazon Web Services

Do you have on-premises tape backups or expensive VTL hardware? Worried about moving cases of tapes off site? Not sure about the integrity of your data on tape? Learn how to use AWS services, including AWS Storage Gateway, to replace existing traditional approaches. Using Storage Gateway and standard backup software, you can back up to Amazon S3 and Amazon Glacier or tier snapshots to AWS. This enables both long-term data retention for compliance, and also recovery into Amazon EC2, locally, or to another site in case of a disaster. Southern Oregon University shares how they replaced tape backups with AWS, and the lessons learned in the process.

STG203_Get Rid of Tape and Modernize Backup with AWS

Amazon Web Services

Customers often have disparate datasets within their data centers and on AWS. As a result, they find it challenging to replicate and analyze the data and drive positive business outcomes. In this workshop, we use AWS managed database services and serverless technologies to help replicate, analyze, and visualize data. We replicate an on-premises database to Amazon RDS and Amazon S3 using AWS Database Migration Service and the AWS Schema Conversion Tool. Then, we use Amazon Athena to interactively analyze data using SQL. Finally, we use Amazon QuickSight to visualize the data and enable better business decisions.

DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...

Amazon Web Services

In this session, we introduce you to the best practices for migrating databases, such as traditional RDBMS or other NoSQL databases to Amazon DynamoDB. We discuss DynamoDB key concepts, evaluation criteria, data modeling in DynamoDB, how to move data into DynamoDB, and data migration key considerations. We share a case study of Samsung Electronics, which migrated their Cassandra cluster to DynamoDB for their Samsung Cloud workload.

DAT320_Moving a Galaxy into Cloud

Amazon Web Services

We have recently seen some convergence of different database technologies. Many customers are evaluating heterogeneous migrations as their database needs have evolved or changed. Evaluating the best database to use for a job isn’t as clear as it was ten years ago. In this session, we discuss the ideal use cases for relational and nonrelational data services, including Amazon ElastiCache for Redis, Amazon DynamoDB, Amazon Aurora, and Amazon Redshift. This session digs into how to evaluate a new workload for the best managed database option.

DAT310_Which Database to Use When

Amazon Web Services

Cisco’s video solutions were historically designed for on-premises dedicated hardware deployments. Typically, major releases occurred annually or bi-annually. The release process lacked the ability to absorb frequent changes and adapt to rapid market trends. This session looks into how Cisco’s IVP Solution team evolved a production system from its monolithic design into a microservices platform, leveraging cloud services, automated deployments, and delivery pipelines. Through this transition the team adopted a biweekly deployment cadence. This ultimately enabled a fast-paced migration to an AWS environment, using AWS services such as Amazon EC2, Amazon RDS, and Amazon Elasticsearch Service.

DEV329_Cisco’s Journey from Monolith to Microservices

Amazon Web Services

In this session, Shawn Bice, VP of NoSQL and QuickSight, will cover what's new in AWS non-relational data services, such as Amazon DynamoDB, Amazon ElastiCache, and Amazon Elastisearch. We will discuss how developers might select different data services to solve different aspects of an application and demo scenarios on which application use cases lend themselves well to which data services. If you’re a developer building massively scaled applications, requiring flexibility, consistent millisecond performance, and trying to understand what non-relational data service you might use, this is a great introductory session.

What's New for AWS Purpose Built, Non-relational Databases - DAT204 - re:Inve...

Amazon Web Services

Successful mobile applications rely on a broad spectrum of backend services that support the features and functionality of the front-end mobile application. The success of the mobile application depends on those backend services being built so that they can scale as the application’s audience grows, sometimes explosively when an app takes off. They must also protect the security and privacy of the data used in the application.

MBL204_Architecting Cost-Effective Mobile Backends for Scale, Security, and P...

Amazon Web Services

Today, small software teams have the ability to disrupt big markets as more and more businesses start to deliver their products as-a-service. The ability for teams to respond to customers and innovate quickly is their key differentiator. In this session, we will cover how you can begin your DevOps journey by sharing best practices used by the "two pizza" engineering teams at Amazon. We will showcase how you can accelerate developer productivity by implementing continuous Integration and delivery workflows using AWS Developer tools including AWS CodeStar, AWS CodeCommit, AWS CodeBuild, AWS CodePipeline and AWS CodeDeploy. Finally, we will demonstrate how to build an end-to-end CICD pipeline with CodeStar in minutes.

DEV203_Launch Applications the Amazon Way

Amazon Web Services

In this workshop, attendees get hands-on experience using Kubernetes and Kops (Kubernetes Operations), as described in our recent blog. Attendees learn how to provision a cluster, assign role-based permissions and security, and launch a container. If you're interested in learning best practices for running Kubernetes on AWS, don’t miss this workshop. We have a packed 2.5 hrs worth of self-guided hands-on tutorials to get you started with Kubernetes using AWS best practices. This workshop provides instructions to create, manage, and scale a Kubernetes cluster on AWS, as well as how to deploy applications, scale them, run stateless and stateful containers, perform service discovery between different microservices, and other similar concepts. One of the prerequisites is to create an AWS Account beforehand so that you can get started quickly. We recommend to create an Account at least few days before reInvent. Here is the info on creating and activating your AWS Account: https://aws.amazon.com/premiumsupport/knowledge-center/create-and-activate-aws-account/ Also, try launching an EC2 instance (t2.micro) and terminate it after you see successful launch. We will be handing out AWS credits after you complete the workshop and exit the room. We are excited to see you at reInvent and are looking forward to diving deep into Kubernetes and its ecosystem of products on AWS.

CON213_Hands-on Kubernetes on AWS

Amazon Web Services

In this workshop, we explore the AWS methodology for migrating Microsoft applications to AWS. We walk through the concerns and considerations to take into account while planning a migration. Learn how to develop and implement a migration plan to move applications from on-premises (or traditional hosting) to AWS. This session uses a case study format to dive deep into the details of how to successfully plan a Microsoft application migration.

GPSWKS406-Migrating a Microsoft ASP.NET Application to AWS

Amazon Web Services

GPSWKS404-GPS Game Changing C2S Services To Transform Your Customers Speed To...

Amazon Web Services

Was ist angesagt? (20)

CTD303_Korea’s Largest OTT provider

CON208_Building Microservices on AWS

MSC203_How Citrix Uses AWS Marketplace Solutions To Accelerate Analytic Workl...

Deep Dive: AWS Direct Connect and VPNs - NET403 - re:Invent 2017

STG401_This Is My Architecture

CTD307_Case Study How Mobile Device Service Company Asurion Architected Its A...

MCL207_Amazon Lex Integration with IVR

Deep Dive on Amazon Glacier - STG303 - re:Invent 2017

Building Serverless Real-time Data Processing (workshop)

STG203_Get Rid of Tape and Modernize Backup with AWS

DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...

DAT320_Moving a Galaxy into Cloud

DAT310_Which Database to Use When

DEV329_Cisco’s Journey from Monolith to Microservices

What's New for AWS Purpose Built, Non-relational Databases - DAT204 - re:Inve...

MBL204_Architecting Cost-Effective Mobile Backends for Scale, Security, and P...

DEV203_Launch Applications the Amazon Way

CON213_Hands-on Kubernetes on AWS

GPSWKS406-Migrating a Microsoft ASP.NET Application to AWS

GPSWKS404-GPS Game Changing C2S Services To Transform Your Customers Speed To...

Ähnlich wie ARC330_How the BBC Built a Massive Media Pipeline Using Microservices

A shift is taking place in how live events are broadcast to audiences. Although there will always be a place for on-premises video infrastructure, cloud-based services for live broadcast now match the capabilities of on-premises hardware, are easy to use, and save time and money. This session highlights AWS services for live broadcast workflows and the components required for successful delivery of live events to video consumers. Topics include: • Video delivery • Workflow resiliency in the cloud • Customer applications and use cases • Live broadcast of periodic events and 24/7 channels

NEW LAUNCH! Hear how the Pac-12 is using AWS Elemental MediaStore and explore...

Amazon Web Services

NEW LAUNCH! Build your own live streaming and on-demand video service with AW...

Amazon Web Services

With more companies entering the OTT market, AWS sees customer demand for ways to decrease the time it takes to get content into their users’ hands, while increasing operational efficiency and lowering IT infrastructure costs. Using deep learning-based image analysis can provide users actionable feedback about the content they view. When combining a new serverless architecture approach using Amazon Elastic Transcoder with AWS’ deep learning technology Amazon Rekognition, companies can provide near real-time, on-demand encoding of assets and content moderation. This session covers serverless versus virtualized infrastructure, handling encoding jobs with AWS Lambda, encoding dynamic media assets with Elastic Transcoder (or Elemental), moderating content with Amazon Rekognition, and storing metadata with Amazon DynamoDB. We also provide a demo to test a production-ready serverless encoding architecture.

ARC311_Serverless Encoding at Scale with Content Moderation via Deep Learning...

Amazon Web Services

The Netflix encoding team is responsible for transcoding different types of media sources to a large number of media formats to support all Netflix devices. Transcoding these media sources has compute needs ranging from running compute-intensive video encodes to low-latency, high-volume image and text processing. The encoding service may require hundreds of thousands of compute hours to be distributed at moment's notice where they are needed most. In this session, we explore the various strategies employed by the encoding service to automate management of a heterogenous collection of Amazon EC2 Reserved Instances, resolve compute contention, and distribute them based on priority and workload.

How Netflix Encodes at Scale - CMP309 - re:Invent 2017

Amazon Web Services

Amazon is a global company with over 300,000 employees worldwide. Easy and efficient communication is critical, so earlier this year, we made Amazon Chime available company-wide. Amazon Chime is a modern communications service that runs securely on AWS. It simplifies online meetings, video conferencing, and chats in one straightforward application. In this session, we provide an overview of Amazon Chime and follow with a discussion on how Amazon is rolling out this service.

How Amazon Is Moving to Amazon Chime - BAP204 - re:Invent 2017

Amazon Web Services

A Culture Of Innovation powered by AWS

Amazon Web Services

A Culture Of Innovation powered by AWS

Amazon Web Services

Every evening video streaming consumes over 70% of the internet’s bandwidth, with demand only expected to increase as young households forego traditional pay TV for OTT services (whether live, on-demand, ad-supported, transactional, subscription, or a combination thereof). In this session senior tech architects from Netflix, Hulu, and Amazon Video discuss lessons and best practices around hosting largest scale video distribution workloads to enable high traffic consumption at demanding reliability requirements. You will also hear from AWS experts on the latest developments in cloud-based video processing, distribution, and personalization for both live and on-demand streaming.

MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...

Amazon Web Services

In this workshop, participants will learn how to build and deploy a solution capable of ingest and delivery of live 360 degree immersive video. We will build infrastructure using Amazon EC2 Spot Instances, Amazon S3, and Amazon CloudFront, and learn how video can be transcoded for adaptive bitrate-based OTT streaming. We will also record the live video and transcode it using Amazon Elastic Transcoder along with Amazon S3 event notifications. Finally, we will host and deploy an HTML5 web player capable of displaying and panning the 360 degree content. Bring a laptop, and have an AWS account with IAM admin privileges that includes full access to Amazon EC2, EC2 Spot Instances, AWS CloudFormation, Amazon S3 and Amazon CloudFront. An Android or iOS tablet is optional.

MAE405_Build a 360° Immersive Media Video Solution on AWS

Amazon Web Services

Build a 360° Immersive Media Video Solution on AWS - MAE405 - re:Invent 2017

Amazon Web Services

Reaching a large podcast audience can present some significant infrastructure scaling challenges. In this session, startup company Whooshkaa walks you through the podcasting landscape. During this session, you will learn about the new audiences you can reach through podcasts. We will explore technical solutions such as Amazon Lightsail, S3 and CloudFront which can facilitate experimentation and help you reach a global audience at low cost. We will dive into Whooshkaa’s podcasting platform and explore advanced architectures, leveraging AWS services, allowing you to curate and customize content for each listener. We will also explore tools and solutions for measuring engagement and connecting with your audience through podcasting.

Podcasting on AWS – A Discussion on Everything from Production to Distributio...

Amazon Web Services

Amazon Kinesis Video Streams is a video ingestion and storage service for analytics, machine learning, and video processing use cases. In this workshop, you will learn how to stream video from devices to Kinesis Video Streams for playback, storage and subsequent processing. For the workshop, we will provide you a Raspberry Pi 3 with camera module and pre-loaded with the Kinesis Video Streams producer SDK. First, you will create and configure a Kinesis video stream in the AWS management console. Next, you will stream videos from the Raspberry Pis to Kinesis Video Streams, view the live video feed in the console, and retrieve stored videos. Lastly, you will pull key operating metrics to understand the performance characteristics of your video stream. For this workshop, you need to create an AWS account and bring your own development laptop.

NEW LAUNCH! Stream video from edge devices to AWS for playback, storage and p...

Amazon Web Services

Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...

Amazon Web Services

Keynote - AWSome Day Copenhagen

Amazon Web Services

AWSome Day - Opening Keynote

Adrian Hornsby

Learn about the new services and features we have and that we are launching across AWS Networking this year. Learn also about our vision for continued innovation in this space and the ongoing evolution of networking capabilities and performance. Gain insight into how these new capabilities help everyone—from developers to enterprises to startups—drive greater security and reliability, improved flexibility, and higher performance. Join Dave Brown, director of Amazon EC2 Networking, and learn more about Amazon Virtual Private Cloud (VPC), Elastic Load Balancing, AWS PrivateLink, VPN, AWS Direct Connect, and more. In addition, we cover new releases and show how easy it is to get started. You leave armed with details of how everything fits together in real-world customer scenarios.

Networking State of the Union - NET205 - re:Invent 2017

Amazon Web Services

Deep Dive - Amazon Kinesis Video Streams - AWS Online Tech Talks

Amazon Web Services

Capture and Stream Live and On-Demand Video for the Public Sector

Amazon Web Services

Turner Broadcasting is using the AWS Cloud to provide storage and content processing required to enable mission-critical video libraries. Turner is creating a copy of CNN's 37-year news video library in AWS to take advantage of the cost and architectural benefits of cloud storage. This project has unique requirements around retrieval times, and Turner partnered with AWS to drive specific capabilities such as those Amazon Glacier expedited and bulk retrieval options. These cloud-based archives can enable Turner to use other cloud-based value-add services, such as AI/ML/search, and media supply chains efficiently. Turner's global content exploitation strategies call for extensive versioning of content assets required for distribution to different platforms, products, and regions. Today, this involves complex workflows to derive multiple downstream versions. Adopting the SMPTE Interoperable Mastering Format (IMF) and cloud-based object storage, Turner will dramatically simplify these workflows by enabling cloud-based automation and elastic scalability. Hear Turner’s strategy, implementation around these media workloads, and lessons learned.

MAE304-Turners Cloud Archive for CNN's Video Library and Global Multiplatform...

Amazon Web Services

To win in the marketplace and provide differentiated customer experiences, businesses need to be able to use live data in real time to facilitate fast decision making. In this session, you learn common streaming data processing use cases and architectures. First, we give an overview of streaming data and AWS streaming data capabilities. Next, we look at a few customer examples and their real-time streaming applications. Finally, we walk through common architectures and design patterns of top streaming data use cases.

ABD203_Real-Time Streaming Applications on AWS

Amazon Web Services

Ähnlich wie ARC330_How the BBC Built a Massive Media Pipeline Using Microservices (20)

NEW LAUNCH! Hear how the Pac-12 is using AWS Elemental MediaStore and explore...

NEW LAUNCH! Build your own live streaming and on-demand video service with AW...

ARC311_Serverless Encoding at Scale with Content Moderation via Deep Learning...

How Netflix Encodes at Scale - CMP309 - re:Invent 2017

How Amazon Is Moving to Amazon Chime - BAP204 - re:Invent 2017

A Culture Of Innovation powered by AWS

MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...

MAE405_Build a 360° Immersive Media Video Solution on AWS

Build a 360° Immersive Media Video Solution on AWS - MAE405 - re:Invent 2017

Podcasting on AWS – A Discussion on Everything from Production to Distributio...

NEW LAUNCH! Stream video from edge devices to AWS for playback, storage and p...

Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...

Keynote - AWSome Day Copenhagen

AWSome Day - Opening Keynote

Networking State of the Union - NET205 - re:Invent 2017

Deep Dive - Amazon Kinesis Video Streams - AWS Online Tech Talks

Capture and Stream Live and On-Demand Video for the Public Sector

MAE304-Turners Cloud Archive for CNN's Video Library and Global Multiplatform...

ABD203_Real-Time Streaming Applications on AWS

Mehr von Amazon Web Services

Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS. In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...

Amazon Web Services

La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup. Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti. Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...

Amazon Web Services

Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi

Esegui pod serverless con Amazon EKS e AWS Fargate

Amazon Web Services

Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.

Costruire Applicazioni Moderne con AWS

Amazon Web Services

L’utilizzo dei container è in continua crescita. Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili. I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!

Come spendere fino al 90% in meno con i container e le istanze spot

Amazon Web Services

In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th. Event Agenda : Open banking so far (short recap) • PSD2, OB UK, OB Australia, OB LATAM, OB Israel Intro to Open Finance marketplace • Scope • Features • Tech overview and Demo The role of the Cloud The Future of APIs • Complying with regulation • Monetizing data / APIs • Business models • Time to market One platform for all: a Strategic approach Q&A

Open banking as a service

Amazon Web Services

Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc. AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta. Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.

Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...

Amazon Web Services

Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity. AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet. Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.

OpsWorks Configuration Management: automatizza la gestione e i deployment del...

Amazon Web Services

Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.

Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads

Amazon Web Services

Computer Vision con AWS

Amazon Web Services

Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti. Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi. La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.

Database Oracle e VMware Cloud on AWS i miti da sfatare

Amazon Web Services

Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti. Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire. Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito. In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.

Crea la tua prima serverless ledger-based app con QLDB e NodeJS

Amazon Web Services

Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline. Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.

API moderne real-time per applicazioni mobili e web

Amazon Web Services

Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi. La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali. In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.

Database Oracle e VMware Cloud™ on AWS: i miti da sfatare

Amazon Web Services

Tools for building your MVP on AWS

Amazon Web Services

How to Build a Winning Pitch Deck

Amazon Web Services

Building a web application without servers

Amazon Web Services

Fundraising Essentials

Amazon Web Services

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...

Amazon Web Services

Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.

Introduzione a Amazon Elastic Container Service

Amazon Web Services

Mehr von Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...

Esegui pod serverless con Amazon EKS e AWS Fargate

Costruire Applicazioni Moderne con AWS

Come spendere fino al 90% in meno con i container e le istanze spot

Open banking as a service

Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...

OpsWorks Configuration Management: automatizza la gestione e i deployment del...

Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads

Computer Vision con AWS

Database Oracle e VMware Cloud on AWS i miti da sfatare

Crea la tua prima serverless ledger-based app con QLDB e NodeJS

API moderne real-time per applicazioni mobili e web

Database Oracle e VMware Cloud™ on AWS: i miti da sfatare

Tools for building your MVP on AWS

How to Build a Winning Pitch Deck

Building a web application without servers

Fundraising Essentials

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...

Introduzione a Amazon Elastic Container Service

ARC330_How the BBC Built a Massive Media Pipeline Using Microservices

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS re:INVENT How the BBC Built a Massive Media Pipeline Using Microservices S t e p h e n G o d w i n , L e a d A r c h i t e c t , B r i t i s h B r o a d c a s t i n g C o r p o r a t i o n ( B B C ) R o b e r t C h o w , P r i n c i p a l P r o d u c t M a n a g e r , A W S ( S Q S a n d S N S ) A R C 3 3 0 N o v e m b e r 2 8 , 2 0 1 7

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Where we’re going Messaging overview BBC iPlayer • Background • Challenges • Transformation to microservices • The role of messaging • Results • Pitfalls and best practices Wrap-up © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Simple Queue Service (SQS) • Asynchronous • Each message processed by one consumer Simple Notification Service (SNS) • Pub/sub • Broadcast or filtered • High fan-out of messages Amazon SQS & SNS: Decouple applications

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Stephen Godwin • Lead technical architect at the BBC • Designed the systems that provides audio and video to BBC iPlayer and iPlayer Radio • Led the migration of the systems that power iPlayer to a cloud-based microservice architecture • Worked for nearly 10 years as one of the developers of IBM WebSphere@SteveGodwin

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Broadcast video feed x 24 Video chunker Time addressable media store FFmpeg Pre-delivered content Media distribution service PaaS Transcode service Playout event feed Live Ingest Logic We are here Inside iPlayer: Video factoryInside iPlayer: Live Ingest Logic

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Playout event feed Rights checker Inside the Live Ingest Logic service Live Ingest Logic Live Ingest Logic Broadcast event notifier Interactive TV services Other TV services

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Broadcast event notifier Playout event feed Rights checker Live Ingest Logic Using messaging to wire the system Time addressable media store Media distribution service Pre-delivered content Broadcast video feed x 24 Video chunker FFmpeg PaaS Transcode service

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Playout event feed Broadcast video feed x 24 Video chunker FFmpeg Pre-delivered content PaaS Transcode service Live Ingest Logic Media distribution service Time addressable media store We are here Inside iPlayer: Time addressable media store

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Event-driven trace and analysis Request received Found all chunks Created new file File complete Time addressable media store

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Inside iPlayer: Media distribution service Playout event feed Broadcast video feed x 24 Video chunker Time addressable media store FFmpeg Pre-delivered content PaaS Transcode service Live Ingest Logic We are all the way over here Media distribution service

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Refreshing caches for data consistency Synchronous call Asynchronous call Availability database Media distribution service Audience Read Update

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Where we ended up Happier audience Faster time to deployment Easy extensibility and reuse Massive scalability Improved resilience © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Designing for idempotency Elastic scaling is great—linear scaling is better Reliable pipelines of microservices Think about how you will debug your system

ARC330_How the BBC Built a Massive Media Pipeline Using Microservices

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie ARC330_How the BBC Built a Massive Media Pipeline Using Microservices

Ähnlich wie ARC330_How the BBC Built a Massive Media Pipeline Using Microservices (20)

Mehr von Amazon Web Services

Mehr von Amazon Web Services (20)

ARC330_How the BBC Built a Massive Media Pipeline Using Microservices