The age of artificial intelligence, deep dives on machine learning and deep learning. Machine perception and applications. How company use AI in their businesses. Case study: Netflix. Basic tools for data manipulation and data visualization.

1. data & content design
Frieda Brioschi - frieda.brioschi@gmail.com
Emma Tracanella - emma.tracanella@gmail.com
AI, ML & TOOLS
LESSON 12 - 2020

2. ARTIFICIAL
INTELLIGENCE
THE AGE OF

3. data & content design
LESSON 12
3
https://hai.stanford.edu/news/infographic-age-artificial-intelligence

4. data & content design
4
LESSON 12

5. data & content design
5
LESSON 12

6. data & content design
CLASSIFYING AI
6
▸ Machine Learning
▸ Deep Learning
▸ Reinforcement Learning: the use of rewarding systems that achieve objectives in order
to strengthen (or weaken) specific outcomes. This is frequently used with agent systems.
▸ Agent Systems: systems in which autonomous agents interact within a given
environment in order to simulate emergent or crowd based behavior. Used more and
more frequently with games in particular, but is also used with other forms of
simulations.
▸ https://www.forbes.com/sites/cognitiveworld/2019/08/20/what-is-artificial-intelligence/#66ebdad9306f
LESSON 12

7. data & content design
CLASSIFYING AI
7
▸ Non-Linear Grid Systems: a variation of agented systems in which cells in n-
dimensional grids maintain internal state but also receive stimulae from
adjacent cells and generate output to those cells. The distant ancestor of
most of these is Conway's Game of Life, but the idea is used to a much
higher degree of complexity with most weather and stock modeling systems
that are fundamentally recursive.
▸ Self-Modifying Graph Systems: these include knowledge bases and so forth
in which the state of the system changes due to system contingent
heuristics.
LESSON 12

8. data & content design
CLASSIFYING AI
8
▸ Knowledge Bases, Business Intelligence Systems and Expert Systems: these often form a
spectrum from traditional data systems to aggregate semantic knowledge graphs. To a
certain extent they are human curated, but some of this curation is increasingly switching
over to machine learning for both classification, categorization and abstraction.
▸ Chatbots and Intelligent Agents: this differs from agent systems. Agents in general are
computer systems that are able to parse written or spoken text, use it to retrieve certain
content or perform certain actions, and the respond using appropriately constructed
content. The earliest such system, Eliza, dates back to the mid-1960s, but was very
primitive. Today's agents and chatbots, on the other hand, use a combination of
semantics, Bayesian analysis and machine learning to both build up the appropriate
information and learn about the user.
LESSON 12

9. data & content design
CLASSIFYING AI
9
▸ Visual/Audio Recognition Systems: in most cases V/A systems work by converting the
media in question to an encoded compressed form, then algorithms look via either
indexes or machine learning systems for the closest matches. This is often enhanced
with Bayesian Analysis, where specific patterns are analysed based upon their
frequency of occurrence relative to one another, and are also often tied in with
semantic systems that provide relationship information.
▸ Fractal Visualization: the connection between fractals and AI runs deep, and not
surprisingly one of the biggest areas for AI is in the development of parameterized
natural rendering - the movement of water, the roar of fire, the coarseness of rock, the
effects of smoke in the air, all of which have become standard fare in big Hollywood
blockbusters.
LESSON 12

10. data & content design
NOT PROPERLY AI
10
▸ Autonomous Vehicles: these make use of visual recognition systems and real time modeling in
order to both anticipate obstacles (static and moving) and to determine actions based upon
objectives.
▸ Drones: a drone is an autonomous vehicle without a passenger, and can be as small as a
dragonfly or as large as a jet. Drones can also act in a coordinated fashion, either by following
swarm behavior (an agent system) or by following preprogrammed instructions.
▸ Data Science / Data Analytics: this is the use of data to identify patterns or predict behavior.
This uses a combination of machine learning techniques and numeric statistical analysis, along
with an increasingly large roll for non-linear differential equations. The primary distinction is
that most data scientist does not make heavy use of higher order functions or recursion,
though again, this is changing.
LESSON 12

11. data & content design
NOT PROPERLY AI
11
▸ Blockchain and Distributed Ledgers: distributed ledger technology underlies electronic coinage, but
it is also playing a bigger and bigger role in tracking resources and transactions. One aspect of such
systems is that they make it possible to bind virtual objects as if they were unique physical objects, in
effect making intellectual property exchangeable. This has application throughout the AI space,
especially in the realm of agented systems, even if it is not AI per se.i
▸ Internet of Things / Robotics: internet of things is intended to provide network connectivity to devices
so that they can communicate with other devices. Robotics involves creating autonomous physical
agents capable of movement. In that both of these may end up managing their own state, relies upon
AI-based systems for identifying signals and determining response, they use AI, but aren't directly AI.
▸ GPUs: the Central Processing Unit is so last century. Artificial intelligence is taking advantage of Graph
Processing Units in a big way, as their structure makes them ideal for both semantic analysis and
recursive filter applications.
LESSON 12

12. MACHINE LEARNING -
DEEP LEARNING
ARTIFICIAL INTELLIGENCE

13. data & content design
ARTIFICIAL INTELLIGENCE
13
On a lower level, an AI can be only a programmed rule that determines the
machine to behave in a certain way in certain situations.
So basically Artificial Intelligence can be nothing more than just a bunch of if-
else statements. An if-else statement is a simple rule explicitly programmed by a
human.
LESSON 12

14. data & content design
14https://www.bbc.com/news/technology-50779761
LESSON 12

15. data & content design
MACHINE LEARNING
15
Algorithms that analyze data, learn from it and make informed decisions based on
the learned insights.
Machine Learning algorithms must be trained on data. The more data you provide
to your algorithm, the better it gets.
The “training” part of a Machine Learning model means that this model tries to
optimize along a certain dimension. The Machine Learning models try to minimize the
error between their predictions and the actual ground truth values.
In short machine learning models are optimization algorithms. If you tune them right,
they minimize their error by guessing and guessing and guessing again.
LESSON 12

16. data & content design
DEEP LEARNING
16
Deep Learning uses a multi-layered structure of algorithms called the neural
network.
LESSON 12

17. data & content design
FEATURE EXTRACTION
17
The models of deep learning require little to no manual effort to perform and
optimize the feature extraction process.
LESSON 12

18. data & content design
EXAMPLE
18
If you want to use a machine learning model to determine whether a particular
image shows a car or not, we humans first need to identify the unique features of
a car (shape, size, windows, wheels, etc.), extract these features and give them to
the algorithm as input data. This way, the machine learning algorithm would
perform a classification of the image. That is, in machine learning, a programmer
must intervene directly in the classification process.
In the case of a deep learning model, the feature extraction step is completely
unnecessary. The model would recognize these unique characteristics of a car
and make correct predictions- completely without the help of a human.
LESSON 12

19. data & content design
AND BIG DATA
19
Deep Learning models tend to increase their accuracy with the increasing
amount of training data, where’s traditional machine learning models stop
improving after a saturation point.
LESSON 12

20. PERCEPTION
MACHINE
PHOTO BY JAREDD CRAIG ON UNSPLASH

21. data & content design
MACHINE PERCEPTION
Machine perception is the capability of a computer system to interpret data in a manner that
is similar to the way humans use their senses to relate to the world around them.
The basic method that the computers take in and respond to their environment is through the
attached hardware. Until recently input was limited to a keyboard, or a mouse, but advances
in technology, both in hardware and software, have allowed computers to take in sensory
input in a way similar to humans.
Machine perception allows the computer to use this sensory input, as well as conventional
computational means of gathering information, to gather information with greater accuracy
and to present it in a way that is more comfortable for the user.
These include computer vision, machine hearing, and machine touch.
21
LESSON 12

22. data & content design
FACIAL RECOGNITION SYSTEM
A facial recognition system is a technology capable of identifying or verifying a
person from a digital image or a video frame from a video source.
There are multiple methods in which facial recognition systems work, but in general,
they work by comparing selected facial features from given image with faces within
a database.
Although the accuracy of facial recognition system as a biometric technology is
lower than iris recognition and fingerprint recognition, it is widely adopted due to its
contactless and non-invasive process.
22
LESSON 12

23. data & content design
THIS RECOGNITION PROBLEM IS MADE DIFFICULT BY THE GREAT VARIABILITY IN HEAD
ROTATION AND TILT, LIGHTING INTENSITY AND ANGLE, FACIAL EXPRESSION, AGING, ETC.
(…)
YET THE METHOD OF CORRELATION (OR PATTERN MATCHING) OF UNPROCESSED OPTICAL
DATA, WHICH IS OFTEN USED BY SOME RESEARCHERS, IS CERTAIN TO FAIL IN CASES
WHERE THE VARIABILITY IS GREAT. IN PARTICULAR, THE CORRELATION IS VERY LOW
BETWEEN TWO PICTURES OF THE SAME PERSON WITH TWO DIFFERENT HEAD ROTATIONS.
Woody Bledsoe, 1966
23
LESSON 12

24. data & content design
DEEPFACE
DeepFace is a deep learning facial recognition system created by a research group
at Facebook.
It identifies human faces in digital images. It employs a nine-layer neural net with over
120 million connection weights, and was trained on four million images uploaded by
Facebook users.
The system is said to be 97% accurate, compared to 85% for the FBI's Next
Generation Identification system.
24
LESSON 12

25. data & content design
FB FACE RECOGNITION
25
LESSON 12

26. data & content design
APPLE FACE ID
Apple introduced Face ID on the flagship iPhone X as a biometric authentication system.
Face ID has a facial recognition sensor: "Romeo" the module that projects more than 30,000 infrared
dots onto the user's face, and "Juliet" the module that reads the pattern. The pattern is sent to a local
"Secure Enclave" in the device's CPU to confirm a match with the phone owner's face.
The system will not work with eyes closed, in an effort to prevent unauthorized access.
The technology learns from changes in a user's appearance, and therefore works with hats, scarves,
glasses, and many sunglasses, beard and makeup.
It also works in the dark. This is done by using a "Flood Illuminator", which is a dedicated infrared
flash that throws out invisible infrared light onto the user's face to properly read the 30,000 facial
points.[34]
26
https://en.wikipedia.org/wiki/Facial_recognition_system
LESSON 12

27. data & content design
CHINESE AIRPORTS
27
As of late 2017, China has deployed
facial recognition and artificial
intelligence technology in Xinjiang.
Reporters visiting the region found
surveillance cameras installed every
hundred meters or so in several cities, as
well as facial recognition checkpoints at
areas like gas stations, shopping centers,
and mosque entrances.
https://www.youtube.com/watch?v=wcM5-E4Kze4
LESSON 12

28. data & content design
ANTI-FACIAL RECOGNITION SYSTEMS
28
LESSON 12

29. data & content design
ENOVIA SMART ROBOTS
29
Smart Robots has developed a
universal device that enables the
integration of cobots with human
activities.
The device can map the workspace in
real time, to recognize objects, to
command the robot to interact with
users and adapt to them, and to self-
learn new commands through
gestures.
LESSON 12

30. data & content design
277 PEOPLE IN 177 CARS
30
https://imgur.com/gallery/sCvRIEd
LESSON 12

31. HOW COMPANY USE
AI?
THE BEST EXAMPLES

32. data & content design
AI EXAMPLES
▸ Smart assistants (like Siri and Alexa)
▸ Disease mapping and prediction tools
▸ Manufacturing and drone robots
▸ Optimized, personalized healthcare treatment recommendations
▸ Conversational bots for marketing and customer service
▸ Robo-advisors for stock trading
▸ Spam filters on email
▸ Social media monitoring tools for dangerous content or false news
▸ Song or TV show recommendations from Spotify and Netflix
32
https://builtin.com/artificial-intelligence
LESSON 12

33. data & content design
ALIBABA
Chinese company Alibaba is the world's largest e-commerce platform that sells more than
Amazon and eBay combined.
AI is integral in Alibaba’s daily operations and is used to predict what customers might want to
buy. With natural language processing, the company automatically generates product
descriptions for the site.
Another way Alibaba uses artificial intelligence is in its City Brain project to create smart cities.
The project uses AI algorithms to help reduce traffic jams by monitoring every vehicle in the
city.
Additionally, Alibaba, through its cloud computing division called Alibaba Cloud, is
helping farmers monitor crops to improve yield and cuts costs with artificial intelligence.
33
LESSON 12

34. data & content design
ALPHABET – GOOGLE
Waymo, the company’s self-driving technology division, wants to bring self-driving
technology to the world to not only to move people around, but to reduce the number of
crashes. Its autonomous vehicles are currently shuttling riders around California in self-
driving taxis. Right now, the company can’t charge a fare and a human driver still sits
behind the wheel during the pilot programme.
Google acquired DeepMind. Not only did the system learn how to play 49 different Atari
games, the AlphaGo programme was the first to beat a professional player at the game of
Go.
Google Duplex - Using natural language processing, an AI voice interface can make
phone calls and schedule appointments on your behalf.
34
LESSON 12

35. data & content design
AMAZON
Not only is Amazon in the artificial intelligence game with its digital voice assistant, Alexa, but
artificial intelligence is also part of many aspects of its business.
Another innovative way Amazon uses artificial intelligence is to ship things to you before you even
think about buying it. They collect a lot of data about each person’s buying habits and have such
confidence in how the data they collect helps them recommend items to its customers and now
predict what they need even before they need it by using predictive analytics.
Amazon Go. Unlike other stores, there is no checkout required. The stores have artificial
intelligence technology that tracks what items you pick up and then automatically charges you for
those items through the Amazon Go app on your phone. Since there is no checkout, you bring your
own bags to fill up with items, and there are cameras watching your every move to identify every
item you put in your bag to ultimately charge you for it.
35
LESSON 12

36. NETFLIX
CASE

37. data & content design
WHAT IS NETFLIX?
37
Netflix's initial business model included DVD sales and rental by mail, but
Hastings abandoned the sales about a year after the company's founding to
focus on the initial DVD rental business. Netflix expanded its business in 2010
with the introduction of streaming media while retaining the DVD and Blu-ray
rental business. The company expanded internationally in 2010 with streaming
available in Canada, followed by Latin America and the Caribbean. Netflix
entered the content-production industry in 2012, debuting its first series
Lilyhammer.
▸ https://en.wikipedia.org/wiki/Netflix
LESSON 12

38. data & content design
A NEW COURSE
38
In 2006, Netflix launched an unusual, and highly successful, competition
designed to improve its recommendation system. It released a database of 100
million movie and TV show ratings from nearly 500,000 users and, in 2009,
awarded the $1 million jackpot the first team to increase the accuracy of its own
movie recommendation algorithm by more than 10 percent.
The rapid rise of streaming content has exploded the amount and types of data
available to the company’s data science team.
▸ https://www.technologyreview.com/s/428867/why-there-wont-be-a-netflix-prize-sequel/
LESSON 12

39. data & content design
HOUSE OF CARDS
39
Netflix decided to make its original programming bet on House of Cards,
specifically, based on what it knows about the viewing habits of its users—it knew
which and how many users watch movies starring Kevin Spacey and the director
David Fincher, and, through its tagging and recommendation system, how many
sat through other similar political dramas. It has shown different trailers to people
depending on their particular viewing habits, too.
▸ https://www.technologyreview.com/s/511771/house-of-cards-and-our-future-of-algorithmic-programming/
LESSON 12

40. data & content design
EVENTS TRACKED
40
▸ When you pause, rewind, or fast forward
▸ What day you watch content (Netflix has found people watch TV shows
during the week and movies during the weekend.)
▸ The date you watch
▸ What time you watch content
▸ Where you watch (zip code)
LESSON 12

41. data & content design
EVENTS TRACKED
41
▸ What device you use to watch (Do you like to use your tablet for TV shows and
your Roku for movies? Do people access the Just for Kids feature more on their
iPads, etc.?)
▸ When you pause and leave content (and if you ever come back)
▸ The ratings given (about 4 million per day)
▸ Searches (about 3 million per day)
▸ Browsing and scrolling behavior
▸ https://neilpatel.com/blog/how-netflix-uses-analytics/
LESSON 12

42. data & content design
5 USE CASES OF AI/DATA/MACHINE LEARNING AT NETFLIX
42
▸ Personalization of Movie Recommendations
▸ Auto-Generation and Personalization of Thumbnails / Artwork
▸ Location Scouting for Movie Production (Pre-Production)
▸ Movie Editing (Post-Production)
▸ Streaming Quality
▸ https://becominghuman.ai/how-netflix-uses-ai-and-machine-learning-a087614630fe
LESSON 12

43. data & content design
PERSONALIZED IMAGE THUMBNAIL / ARTWORK
43
▸ Problem: How (and when) do we best present that movie recommendation to the user in a way that
maximizes viewership and monthly subscriber loyalty?
▸ Users spent an average of 1.8 seconds considering each title they were presented with while on Netflix
▸
LESSON 12

44. data & content design
LESSON 11
44https://www.bbc.com/news/technology-50779761

45. data & content design
LESSON 11
45

46. data & content design
LESSON 11
46

47. data & content design
LESSON 11
..AND MORE
47
https://www.nytimes.com/2019/02/05/business/media/artificial-intelligence-journalism-robots.html

48. WE ARE
WHERE

49. data & content design
LESSON 12
L1
49

50. data & content design
LESSON 12
L2
50

51. data & content design
LESSON 12
L3
51

52. data & content design
LESSON 12
L4
52

53. data & content design
LESSON 12
L5
53

54. data & content design
LESSON 12
L6
54

55. data & content design
LESSON 12
L7
55

56. data & content design
LESSON 12
L8
56

57. data & content design
LESSON 12
L9
57

58. data & content design
LESSON 12
L10
58

59. data & content design
LESSON 12
L11
59

60. TOOLS
BASIC

61. data & content design
LESSON 12
EXCEL
61https://medium.com/@fmoe/excel-for-data-science-a82247670d7a

62. data & content design
LESSON 12
GOOGLE ANALYTICS
62https://www.linkedin.com/pulse/5-steps-get-google-analytics-ready-data-science-papageorgiou

63. data & content design
LESSON 12
GOOGLE DATA STUDIO
63https://towardsdatascience.com/create-a-dashboard-with-google-data-studio-and-make-automatic-reports-with-it-db42088ad879

64. data & content design
LESSON 12
GOOGLE TRENDS
64

65. TOOLS
VISUAL

66. data & content design
LESSON 12
GOOGLE TRENDS
Blàblàblà
66

67. data & content design
LESSON 12
GOOGLE TRENDS
Blàblàblà
67

68. data & content design
LESSON 12
68

69. data & content design
LESSON 12
69

70. TOOLS
DATA SCIENCE

71. data & content design
LESSON 12
GARTNER
71

72. data & content design
LESSON 12
GOOGLE TRENDS
72

73. data & content design
LESSON 12
73

74. data & content design
LESSON 12
74

75. data & content design
LESSON 12
75

76. data & content design
LESSON 12
76

77. data & content design
LESSON 12
CUSTOMER SATISFACTION
77
https://forms.gle/7s8w5XaV63QNVori9