How to move your ML system from local to production - 2024-03-15

DevOps & MLOps - IDI 2024
Come portare in
produzione un sistema di
ML che ora gira solo nel
locale del nostro data
scientist ?

Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
alessandra.bilardi@corley.it
corley.it

SUMMARY
DevOps methods & actors
MLOps methods & actors
Use case
AWS services
What we take home

reference

DevOps methods & actors

MLOps methods & actors

ML system & actors

Use case

AWS services

AWS Step Functions

AWS Step Functions
https://github.com/aws/aws-step-functions-data-science-sdk-python

Amazon SageMaker Pipeline

Amazon SageMaker Pipeline
https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-parameterization

What we take home

Data Scientist & Cloud Engineer
1
How to survive with colleagues with different skills, without hindering the table football
game during the lunch break.
2 Versioning of configuration,
training and inference data
statistics, models, ..
3
Define tools and services:
libraries, images, storages, ..
4 Define guidelines for who does
what: review, support,
deploying the model, ..
Promoting resources
awareness to be used

Step Functions vs SageMaker Pipeline

AWS services
Which AWS services for which role, when we want to automate a solution from local to
production: depends on the life cycle of the model but above all by the actors involved.
Data Scientists (DS) Cloud Engineer (CE) DS AWS Services CE AWS Services
many one AWS Step Functions AWS CloudFormation
one many Amazon SageMaker
Pipeline
AWS CloudFormation
& Step Functions

AWS services
Which AWS services for which model, when we have a small model, we can also use
something like AWS Lambda, but when we need GPU, we must to use an Endpoint.
AWS Service Provisioning type Resources Cost per hour
Endpoint Provisioned 2 CPU + 4GB RAM $0.056
Endpoint Serverless 4096MB $0.288
AWS Lambda Serverless 4096MB $0.00024012 +GBsec

Thanks
for listening!

How to move your ML system from local to production - 2024-03-15

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie How to move your ML system from local to production - 2024-03-15

Ähnlich wie How to move your ML system from local to production - 2024-03-15 (20)

Mehr von Alessandra Bilardi

Mehr von Alessandra Bilardi (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

How to move your ML system from local to production - 2024-03-15