KubeCon 2019 - Scaling your cluster (both ways)

•Als PPTX, PDF herunterladen•

0 gefällt mir•704 views

Kubernetes has many ways to scale your workloads, most of what we hear about is scaling our cluster up with either with vm sets or autoscaling groups. There is another way, in this talk we will look at virtual kubelet. Virual Kubelet will allow us to talk to a cloud providers container as a service platform like ACI, fargate or ECI. We will deep dive into how you can scale your applications across virtual kubelet. One issue is the kubernetes service type has is scaling to zero due to the way routing to the pod happens if there is no pod for the service to route too. Scaling our applications to zero is just as important and scaling up. We will look at projects that integrate with the horizontal pod autoscaler that fix this issue. Allowing us to not only scale our applications up but as easily down to make our cluster truly elastic.

Software

@scottcoulton
scotty-c
Scott Coulton
Developer Advocate
Spent the last 4 years on
container related
development
Golang fan
CNCF Ambassador
Docker Captain

What is the horizontal pod autoscaler ?
@scottcoulton

Does everyone understand what the HPA is?
@scottcoulton

We have two options
• Virtual machines (traditional compute nodes)
• Virtual Kubelet
Scaling your compute
@scottcoulton

No matter your cloud of choice there are similar
implementations to scale compute.
Scaling your compute – Virtual machines
@scottcoulton

Scaling your compute – Virtual machines
@scottcoulton

Most clouds allow you to
• Scale machines up under load
• Scale machines back down to a specified number
Scaling your compute – Virtual machines
@scottcoulton

What is different about virtual kubelet to traditional compute
 Remove dependencies on servers for worker nodes
 Allow burstable workloads
 Save consumers money on hosting
Scaling compute - Virtual kubelet
@scottcoulton

Scaling compute - Virtual kubelet
@scottcoulton

 Alibaba ECI
 AWS Fargate
 Azure ACI
 Service mesh
 Hashicorp nomad
 Openstack
 HTTP
Scaling compute - Virtual kubelet
@scottcoulton

 Linux
 Windows
 GPU's
Scaling compute - Virtual kubelet
@scottcoulton

nodeSelector:
kubernetes.io/role: agent
beta.kubernetes.io/os: linux
type: virtual-kubelet
tolerations:
- key: virtual-kubelet.io/provider
operator: Exists
- key: azure.com/aci
effect: NoSchedule
Deploying an application on to virtual kubelet
@scottcoulton

https://kedacore.azureedge.net/helm
@scottcoulton

https://github.com/scotty-c/kubecon
@scottcoulton

Further learnings on virtual kubelet
@scottcoulton
https://www.youtube.com/watch?v=v9cwYvuzROs&list=PLj6h78yzYM2P
pmMAnvpvsnR4c27wJePh3&index=169

KubeCon 2019 - Scaling your cluster (both ways)

Weitere ähnliche Inhalte

Was ist angesagt?

When you build a serverless app, you either tie yourself to a cloud provider, or you end up building your own serverless stack. Knative provides a better choice. Knative extends Kubernetes to provide a set of middleware components (build, serving, events) for modern, source-centric, and container-based apps that can run anywhere. In this talk, we’ll see how we can use Knative primitives to build a serverless app that utilizes the Machine Learning magic of the cloud.

Serverless with Knative - Mete Atamel (Google)

Shift Conference

Building Resilient Cloud Native Apps in GKE

Jerry Jalava

If your organization is preparing to move toward a cloud-native computing architecture, this cookbook shows you how to successfully use Kubernetes, the de-facto standard for automating the deployment, scaling, and management of containerized applications. With more than 80 proven recipes, developers, system administrators, and architects will quickly learn how to get started with Kubernetes and understand its powerful API.Through the course of the book, authors Sebastien Goasguen and Michael Hausenblas provide several detailed solutions for installing, interacting with, and using Kubernetes in development and production. You'll learn how to adapt the system to your particular needs and become familiar with the wider Kubernetes ecosystem. Each standalone chapter features recipes written in O'Reilly's popular problem-solution-discussion format.Recipes in this cookbook focus on:Creating a Kubernetes clusterUsing the Kubernetes command-line interfaceManaging fundamental workload .

Read ebook Kubernetes Cookbook: Building Cloud Native Applications Full Access

illingstabilityb

What is the right balance between moving fast, innovating, experimenting with new technology, and protecting the personal data of our customers and interests of our stakeholders? How can we safely try new ideas in production without risking costly downtime? Does the utopia where developers are free from lock-in and operators enjoy the calm of a steadily running system exist in the real world? Is it possible to have open platforms with better security? At Kroger Digital we are still working through these questions every day but are redesigning our systems with the goals of true operational maturity and security. Discover how we are building capabilities for monitoring, A/B testing, and continuous delivery with Docker Datacenter, plugins, and open source building blocks such as NGiNX, ElasticSearch, and more.

Learning the Alphabet: A/B, CD and [E-Z] in the Docker Datacenter by Brett Ti...

Docker, Inc.

Jenkins X intro (from google app dev conference)

Michael Neale

Kubernetes Native Serverless solution: Kubeless

Sebastien Goasguen

Why kubernetes

Jorge Arteiro

"Scale" happens along 3 different aspects: (1) applications and their services scale up and down leading to (2) the infrastructure scaling up to meet the needs of the applications, and finally (3) sites scale across multiple locations, including movement to public cloud. In this session, we will talk about how Docker EE scales along all three of these dimensions to give you a consistent platform for running your applications: 1. At the application level: how do you manage application state & health along with resource and security constraints to scale containers up and down up in a controlled fashion? 2. The infrastructure level: as your application estate grows on the Docker EE platform you will need to scale across more nodes. How do automate the provisioning of these new nodes and how do you integrate the Docker EE platform layer with your existing infrastructure systems and tools. 3. Finally, we'll talk about distributed scale: how do you take what works for applications in one data center and spread it across multiple sites, in an integrated fashion so you can operate seamlessly?

Considerations for operating docker at scale

Docker, Inc.

One cluster to serve them all

loodse

GitOps - Operation By Pull Request

Kasper Nissen

Presentation at the OpenStack Summit in Barcelona, Spain on October 25, 2016. http://bit.ly/os-kub-oci-cncf Containers along with next generation topics such as orchestration and serverless computing continue to draw interest across the application developer and data center operator communities because of the enormous potential of the technology and the rapid pace of change. As the potential of Docker continues to evolve, Kubernetes emerges as the leading orchestration technology, and the OpenStack Magnum project has matured, many want to see shared governance over the baseline container specification and associated runtime and format/image to protect investments and enable confident adoption of this emerging technology. Join this session to learn the latest about the Open Container Initiative (www.opencontainers.org) and the Cloud Native Computing Foundation (cncf.io) - both collaborative projects of the Linux Foundation - that drive the latest cloud native technologies and projects and see how they relate to Magnum and Kuryr. Daniel Krook, Senior Software Engineer, IBM Jeffrey Borek, Program Director, Open Tech, IBM Sarah Novotny, Senior Kubernetes Community Manger, Google

Open Container Technologies and OpenStack - Sorting Through Kubernetes, the O...

Daniel Krook

Kubernetes is a very successful project today, based on stars analysis it is in top 0.01% of all github projects. Why is it successful? The technology is part of it. But we think that what makes Kubernetes special and successful is it’s community. In this talk we will describe the organization and evolution of the Kubernetes community. How we organize technical decision making and overall project roadmap. What makes it possible to have an open and growing community. What ensures the quality and timeliness of our releases. Most importantly, mistakes we made and what learnt from them in the 2.5 years of rapid growth.

How kubernetes works community, velocity, and contribution - osls 2017 (1)

Brian Grant

Knative And Pivotal Function As a Service

Jay Lee

Cloud Native CI/CD with GitOps

Kasper Nissen

Intro to Helm for Kubernetes

Carlos E. Salazar

Watch the full webinar here: https://codefresh.io/5-habits-lp/ Sign up for a FREE Codefresh account today: https://codefresh.io/codefresh-signup/ Connecting all the pieces to make zero downtime continuous delivery happen at scale is a challenge. In this webinar, you will see real teams bring all the components together to make high-velocity deployment to Kubernetes scale. Get a hands-on view of the critical steps that go into making container management a scalable process that not only allows teams to delivery faster but with more confidence in the final result

5 Habits of High-Velocity Teams Using Kubernetes

Codefresh

Looking for the fastest way to create Node.js development environments? Not sure if Node.js is right for you? With one-click solutions like AWS Lightsail and Bitnami's ready-to-run Node.js application, exploring the fastest growing development environment has never been easier. Node.js has become a preferred development stack for many developers internationally. Bitnami applications and AWS Lightsail make creating and managing your Node.js projects easy and cost-efficient. Join Bitnami and our featured speakers from The Node.js Foundation and AWS Lightsail as we showcase why developers continue to use Node.js, what projects they are using Node.js for, and how Bitnami's Node.js application on AWS Lightsail can be the perfect end-to-end solution to easily and quickly bring your Node.js project to life. Watch and learn: - What Node.js is used for. - How organizations use Node.js. - Best practices and use cases for Node.js. - What Amazon Lightsail is. - The benefits of using Amazon Lightsail. - How Bitnami and Amazon Lightsail are the best way to jump-start your Node app development. - How to launch and manage your Node.js instance with Amazon Lightsail.

Take the Fastest Path to Node.Js Application Development with Bitnami & AWS L...

Bitnami

The Docker Enterprise Edition platform helps customers deploy and manage applications faster and it secures the application pipeline at a lower cost than traditional application delivery models. But it takes more than just great technology to achieve the desired results. The organization and culture of your enterprise directly impacts what you transform, how it’s done, and who does it. Success requires a strategy for how you will govern the Docker EE container platform, how to assess your application estate, what your delivery pipeline will look like, and how to ensure developers, operators, security teams and others play nicely together. In this talk I will cover topics such as different types of workloads (legacy, microservices, FaaS, big data, ...), how your org chart can influence whether you deploy a CaaS (Containers as a Service) vs CLaaS (Clusters as a Service), how "shifting left" can determine if you can outsource, centralized vs distributed CI/CD and how containers play a role, transforming your pets into cattle, how giant whale balloons are used for onboarding, and a prescriptive and comprehensive methodology for successfully deploying Docker in your enterprise.

How to build your containerization strategy

Docker, Inc.

Zero-downtime deployment of Micro-services with Kubernetes

Wojciech Barczyński

In a microservices world, applications consist of dozens, hundreds, or even thousands of components. Manually deploying and verifying deployment quality in production is virtually impossible. Kubernetes, which natively supports rolling updates, enables blue-green application deployments with Spinnaker. However, the gradual rollout is a feature that doesn’t come out-of-the-box but can be achieved by adding Istio and Prometheus to the equation. During this meetup, Slava will discuss canary release implementations on Kubernetes with Spinnaker, Istio, and Prometheus. He’ll examine the role of each tool in the process and how they are all connected. During a demo, he will demonstrate a successful and failed canary release, and how these tools enable IT teams, to properly roll out changes to their customer base without any downtime.

Canary Releases on Kubernetes with Spinnaker, Istio, & Prometheus (2020)

Kublr

Was ist angesagt? (20)

Serverless with Knative - Mete Atamel (Google)

Building Resilient Cloud Native Apps in GKE

Read ebook Kubernetes Cookbook: Building Cloud Native Applications Full Access

Learning the Alphabet: A/B, CD and [E-Z] in the Docker Datacenter by Brett Ti...

Jenkins X intro (from google app dev conference)

Kubernetes Native Serverless solution: Kubeless

Why kubernetes

Considerations for operating docker at scale

One cluster to serve them all

GitOps - Operation By Pull Request

Open Container Technologies and OpenStack - Sorting Through Kubernetes, the O...

How kubernetes works community, velocity, and contribution - osls 2017 (1)

Knative And Pivotal Function As a Service

Cloud Native CI/CD with GitOps

Intro to Helm for Kubernetes

5 Habits of High-Velocity Teams Using Kubernetes

Take the Fastest Path to Node.Js Application Development with Bitnami & AWS L...

How to build your containerization strategy

Zero-downtime deployment of Micro-services with Kubernetes

Canary Releases on Kubernetes with Spinnaker, Istio, & Prometheus (2020)

Ähnlich wie KubeCon 2019 - Scaling your cluster (both ways)

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2UgQ3BU. Christie Wilson describes what to expect from CI/CD in 2019, and how Tekton is helping bring that to as many tools as possible, such as Jenkins X and Prow. Wilson talks about Tekton itself and performs a live demo that shows how cloud native CI/CD can help debug, surface and fix mistakes faster. Filmed at qconsf.com. Christie Wilson is a software engineer at Google, currently leading the Tekton project. Over the past decade, she has worked in the mobile, financial and video game industries. Prior to working at Google she led a team of software developers to build load testing tools for AAA video game titles, and founded the Vancouver chapter of PyLadies.

Shifting Left with Cloud Native CI/CD

C4Media

Cloud Native Night June 2019, Munich: Talk by Josef Fuchshuber (@fuchshuber, Principal Software Architect at QAware) Join our Meetup: www.meetup.com/cloud-native-muc Abstract: Kubernetes ist komplex geworden. Eigentlich so komplex, dass man sich als App Developer mit diesem Komplexitätsgrad auf Platform-Level nur selten befassen will. Was aber ist die richtige Abstraktionsebene für App Developer? In diesem Talk werden zwei mögliche Lösungen vorgestellt: - Crossplane: Ein Multicloud Control Plane um Workload und Ressourcen unabhängig von Cloud Providern ausrollen zu können - Knative: Plattform um Serverless Workloads zu Bauen, Deployen und zu Managen Beide Tools definieren eine abstrahierte Sicht auf K8s, haben aber jeweils einen eigenen Lösungsansatz und unterschiedliche Einsatzszenarien. Diese werden in der Präsentation vorgestellt und mit Demos detaillierter erläutert.

K8s is not for App Developers

QAware GmbH

Looking into 2020 and beyond, we are certainly going to continue this trend of strategic technology investment and architecture evolution. This session’s aim is to highlight Splunk platform evolutionary approach to address key technology trends. Additionally, many customers are adopting Serverless cloud services to deliver their cloud solutions. This session will include a live demo of a new library of functions which provides Google Cloud Platform (GCP) serverless “push” capability to send data into Splunk, via HTTP Event Collector (HEC).

Splunk Platform 2020 & Beyond

Splunk

OmnibusCloud.short

Dmitry Ratner

How to build streaming data pipelines with Akka Streams, Flink, and Spark usi...

Lightbend

Serverless is one of the hottest design patterns in the cloud today, i’ll cover how the Serverless paradigms are changing the way we develop applications and the cloud infrastructures and how to implement Serveless-kind workloads with Kubernetes. We’ll go through the latest Kubernetes-based serverless technologies, covering the most important aspects including pricing, scalability, observability and best practices

stackconf 2020 | The path to a Serverless-native era with Kubernetes by Paolo...

NETWAYS

KubeCon + CloudNativeCon Barcelona and Shanghai 2019 - Highlights

Krishna-Kumar

Denver Cloud Foundry Meetup - February 2016

Josh Ghiloni

Serverless Data Architecture at scale on Google Cloud Platform

MeetupDataScienceRoma

Kubernetes Operability Tooling (GOTO Chicago 2019)

bridgetkromhout

Cloud Native Islamabad - Getting Closer to Continuous Delivery with Knative

Mauricio (Salaboy) Salatino

Speaker: Scott Nichols We will take a look at Knative Serving and Eventing through an escalating demo that will let us tour the capabilities of Knative. Serving provides a container based scale to zero, scale real big functionality; as well as rainbow deploys, auto-TLS, domain mappings, and various knobs to control concurrency and scale traits. Eventing provides a thin abstraction on top of traditional message brokers (think Kafka or AMQP) that lets you compose your application without considering the message persistence choices in the moment.

Knative Intro

Joe Searcy

Say Goodbye To Java: Getting Started With Kotlin For Android Development

Adam Magaña

Webinar: Quantum Revolution Is Here (2022)

Immo Salo

kitsune impact on Enterprises (August 2019)

Ronak Samantray

Apache Beam and Google Cloud Dataflow - IDG - final

Sub Szabolcs Feczak

Kubernetes 101

Stanislav Pogrebnyak

Google Cloud Fundamentals by CloudZone

Idan Tohami

It can be easy to come up with a TCO analysis that would challenge any public cloud and make you think, "let's go in-house!" What are the challenges and is it really worth it? The TubeMogul Operation team went thru the technical challenges at building a private cloud. In this presentation you will learn how the team went from a R&D to an automated deployment of a bare-metal servers to finally migrate a large workload from a Public Cloud to its own Private Cloud infrastructure. We will detail how the team dealt with unexpected issues and also how we chose the hardware, estimated capacity, stay cost effective, improve overall performance of the system, and bring better control and visibility. This talk will cover the technical detail of: * Evaluating OpenStack, Building and automating a CI environment for a mix of bare metal and cloud servers. * What are the network limitations of OpenStack and how we creatively leverage VLANs to handle large packet per seconds. * How to efficiently monitor your cloud infrastructure Find quickly your bottlenecks * What we missed and should be consider before moving in house Lesson Learned and Post Cost Analysis

SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...

Nicolas Brousse

When compute workflow needs spike well in excess of the capacity of a local compute resource, capacity should be temporarily provisioned from somewhere else to both meet deadlines and to increase scientific output. Public Clouds have become an attractive option due to their ability to be provisioned with minimal advance notice. I have recently helped IceCube expand their resource pool by a few orders of magnitude, first to 380 PFLOP32s for a few hours and later to 170 PFLOP32s for a whole workday. In the process we moved O(50 TB) of data to and from the clouds, showing that networking is not a limiting factor, either. While there was a non-negligible dollar cost involved with each, the effort involved was quite modest. In this session I will explain what was done and how, alongside an overview of why IceCube needs so much compute.

Bursting into the public Cloud - Sharing my experience doing it at large scal...

Igor Sfiligoi

Ähnlich wie KubeCon 2019 - Scaling your cluster (both ways) (20)

Shifting Left with Cloud Native CI/CD

K8s is not for App Developers

Splunk Platform 2020 & Beyond

OmnibusCloud.short

How to build streaming data pipelines with Akka Streams, Flink, and Spark usi...

stackconf 2020 | The path to a Serverless-native era with Kubernetes by Paolo...

KubeCon + CloudNativeCon Barcelona and Shanghai 2019 - Highlights

Denver Cloud Foundry Meetup - February 2016

Serverless Data Architecture at scale on Google Cloud Platform

Kubernetes Operability Tooling (GOTO Chicago 2019)

Cloud Native Islamabad - Getting Closer to Continuous Delivery with Knative

Knative Intro

Say Goodbye To Java: Getting Started With Kotlin For Android Development

Webinar: Quantum Revolution Is Here (2022)

kitsune impact on Enterprises (August 2019)

Apache Beam and Google Cloud Dataflow - IDG - final

Kubernetes 101

Google Cloud Fundamentals by CloudZone

SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...

Bursting into the public Cloud - Sharing my experience doing it at large scal...

Mehr von Patrick Chanezon

Cloud native applications are increasingly composed of containers, serverless functions responding to events and managed cloud services. What is the best workflow and set of tools to provide a rapid, iterative development experience and to package applications using these three components? This hand-on talk will compare and contrast several sets of tools and their associated workflows: Using Docker Desktop, with its local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, or the Gloo hybrid app gateway, to build the most productive development inner-loop for these type of applications OpenFaaS, Fn, or Nuclio open source serverless framework to run functions in containers locally Telepresence to run a container locally, connected to a remote cluster Helm and Draft Knative The talk will also cover how you can use the Cloud Native Application Bundle (CNAB) format and tools to package your applications and share them using a container registry.

GIDS 2019: Developing Apps with Containers, Functions and Cloud Services

KubeCon 2019 - Scaling your cluster (both ways)

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie KubeCon 2019 - Scaling your cluster (both ways)

Ähnlich wie KubeCon 2019 - Scaling your cluster (both ways) (20)

Mehr von Patrick Chanezon

Mehr von Patrick Chanezon (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

KubeCon 2019 - Scaling your cluster (both ways)