SlideShare ist ein Scribd-Unternehmen logo
1 von 67
Downloaden Sie, um offline zu lesen
Designing An Enterprise
Data Fabric
Alan McSweeney
http://ie.linkedin.com/in/alanmcsweeney
What Is An Enterprise Data Fabric?
• Set of hardware and software infrastructure, tools and facilities to
implement, administer, manage and operate data operations across the
entire span of the data within the enterprise across all data activities
including data acquisition, transformation, storage, distribution,
integration, replication, availability, security, protection, disaster recovery,
presentation, analytics, preservation, retention, backup, retrieval, archival,
recall, deletion, monitoring, capacity planning across all data storage
platforms enabling use by applications to meet the data needs of the
enterprise
• Mesh enabling the movement of data around the enterprise
• Provides access to all data assets
• Supports the flow, processing, distribution, management and exchange of
data throughout the enterprise
• Provide coherent data framework for use by custom and acquired
applications
• Independent of specific applications
• Independent of specific data platforms
18 February 2018 2
Building An Enterprise Data Fabric
18 February 2018 3
Core Data Fabric Conceptual Model
18 February 2018 4
Data Fabric Conceptual Model – Components - 1 of
2
18 February 2018 5
Component Description
External Interacting Parties These are the range of external parties that supply data to and access data from the enterprise
External Party Interaction
Zones, Applications, Channels
and Facilities
These are the set of applications and data interface and exchange points provided specifically to
External Interacting Parties to allow them supply data to and access data from the enterprise
These can be hosted internally or externally or a mix of both
External Third Party
Applications
These are third-party applications (such as social media platforms) that contain information
about the enterprise or that are used by the enterprise to present information to or interact with
External Interacting Parties or where the enterprise is referred to, affecting the perception or
brand of the enterprise
External Data Sensors Sources of remote data measurements
External Party Interaction Zones
Data Stores
These are applications and sets of data created by the enterprise to be externally facing where
external parties can access information and interact with the enterprise
External Devices These are devices connected with services offered by the enterprise (such as ATMs and Kiosks)
Date Intake/Gateway This is the set of facilities for handling data supplied to the enterprise including validation and
transformation including a possible integration or service bus
This can be hosted internally or externally or a mix of both
Line of Business Applications This represents the set of line of business applications deployed on enterprise owned and
managed infrastructure used by business functions to operate their business processes
Organisation Operational Data
Stores
These are the various operational data stores used by the Line of Business Applications
Data Fabric Conceptual Model – Components - 2 of
2
18 February 2018 6
Component Description
Line of Business Applications
Hosted Outside the Organisation
This represents the set of line of business applications deployed on external infrastructure used
by business functions to operate their business processes This includes cloud facilities such as
external data storage and XaaS facilities and an integration service to connect external data to
internal data
External Application Operational
Data Stores
These are the various operational data stores used by the Line of Business Applications used by
Line of Business Applications Hosted Outside the Organisation
Data Mastering These are facilities to create and manage master data and data extracted from operational data
to create a data warehouse and data extracts for reporting and analysis. This includes an extract,
transformation and load facility
These can be hosted internally or externally or a mix of both
Data Reporting and Analysis
Facilities
This represents the range of tools and facilities to report on, analyse, mine and model data
These can be hosted internally or externally or a mix of both
Document Sharing and
Collaboration
These are tools used within the enterprise to share and collaborate on the authoring of
documents
Document Management Systems These are systems used to manage transactional and ad hoc structured and unstructured
documents in a formal and controlled manner, including the metadata assigned to documents
Desktop Applications These are applications used by individual users to view and author documents
Document and Information
Portal
This provides structured access to documents and information including externally hosted
applications providing these facilities
Unstructured Data Stores These are storage locations for enterprise documentation
Zones Within Data Fabric Conceptual Model
• Sets of components of conceptual data fabric model can
be grouped into zones:
− Internal – within the enterprise’s boundary
− Cloud Extension – extensions to enterprise applications and data
held in external cloud platforms
− Interface – set of components responsible for getting data into
and out of the enterprise and presenting data and applications
externally
− Externally Located Extension – infrastructure and applications
that are connected to the wider enterprise network
− External Controlled – components outside the enterprise but
under the control of the enterprise
− External Uncontrolled – components outside the enterprise and
not under the direct control of the enterprise
18 February 2018 7
Why Create A Conceptual Data Fabric Model?
• Conceptual data fabric model represents a rich picture of the enterprise’s data
context
− Embodies an idealised and target data view
• Detailed visualisations represent information more effectively than lengthy
narrative text
− More easily understood and engaged with
• Show relationships, interactions
• Capture complexity easily
• Provides a more concise illustration of state
• Better tool to elicit information
• Gaps, errors and omissions more easily identified
• Assists informed discussions
• Evolve and refine rich picture representations of as-in and to-be situations
• Cannot expect to capture every piece of information – focus on the important
elements
• A rich picture is not a data management process map (yet)
18 February 2018 8
Differences Between Current And Target Conceptual
Data Model
• Use the conceptual data fabric model to identify gaps
between the current and desired target
18 February 2018 9
Core Data Fabric Conceptual Model
• Conceptual level is one representation of data related components
and their interactions within, across and outside the enterprise
• Not all components apply to all enterprises
• Useful as a basis for understanding the enterprise’s ideal data
architecture
− Creating an inventory of components in each conceptual area
− Defining an idealised target data fabric
• Just one dimension of defining, detailing and describing data
infrastructure
• Other dimensions include:
− Data types
− Data volumes
− Individual data flows
− Individual applications
− Individual data platforms and applications
18 February 2018 10
Responding To Interrelated Data Trends
18 February 2018 11
Data
Trends
Cloud Offerings
and Services
Analytics
Capabilities
Data Regulations
Internal and
External Digital
Expectations,
Responding To Interrelated Data Trends
• Designing a data fabric enables the enterprise respond to and take
advantage of key related data trends
− Internal and External Digital Expectations
• External actors expect to be able to interact digitally
• Within the enterprise there is an imperative to offer digital interactions and extensions
• Gives rise to large amounts of direct and indirect data that may or may not be processed
− Cloud Offerings and Services
• There are multiple providers of cloud-based services that enable the enterprise invest in
and avail of application and data capabilities with low cost and time of entry
• Data location changes and data must be integrated across platforms
− Data Regulations
• The data regulation landscape is changing - GDPR, ePrivacy Regulation Digital Single
Market, eIDAS, NIS Directive
• This requires greater data compliance and governance effort
• Uncontrolled data platforms and storage represent a significant and real risk to the
enterprise
− Analytics Capabilities
• New analytics capabilities across dimensions of data volumes and complexity enables
more complex analysis
18 February 2018 12
IT Function Data Leadership
• Enables the IT function demonstrate positive data
leadership
• Shows the IT function is able and willing to respond to
business data needs
18 February 2018 13
What Are The Data Challenges?
• More and more data of many different types
• Increasingly distributed platform landscape with data
movement, integration and management across multiple
service providers and cloud-based services
• Compliance and regulation requiring greater control of
personal data
• Newer data technologies and facilities outside the core
competence of the enterprise
• Shadow IT occurs when the IT function cannot deliver IT
change and new data facilities quickly
18 February 2018 14
Data Fabric Is Much More Than A Move To The
Cloud
• Enterprise data fabric should enables appropriate and seamless
move to multiple cloud/XaaS platforms - public, private and
hybrid - across the entire data infrastructure
− Storage
− Business applications
− Data management
− Reporting and analytics tools
• Cloud impacts the enterprise’s approach to data
− Enterprises cannot ignore cloud and XaaS options
• Enterprise data fabric needs to encompass the diversity of data
storage infrastructures
• Design an open and flexible data fabric that improves the
responsiveness of the IT function and reduces shadow IT
18 February 2018 15
Why Have An Enterprise Data Fabric?
• Enables adoption of new data technologies, platforms, systems and
infrastructures within an overall data context
• Enables move to simplification of data infrastructure
• Enables scalability of data infrastructure
• Enables industrialisation and automation of data operations,
administration, management, governance and common security
model
• Reduce the effort and cost of management and administration
• Focus on extracting data value
• Improve the reliability of data operations
• Manage risk of mixed data platforms, uncontrolled data on
uncontrolled platforms
• Allows benefits of scalable data infrastructures that are located
anywhere to be achieved
18 February 2018 16
Why Have An Enterprise Data Fabric?
• Focus on achieving benefits from data rather than on data
operations
− Reduce time to manage, find, combine and curate data
− Reduce wasted time, capacity, resources, cost
• Abstract data infrastructure from data usage
• Enable use of data in currently unanticipated ways through
flexible and adaptable facilities
• Reduce time to achieve insights
18 February 2018 17
Creating A Data Vision
• Data fabric is concerned with creating a data vision for the
enterprise
− Data capabilities, competencies
− Where the enterprise is and where it wants to be
• Define the future target landscape and define the required
journey to achieve it
• Ensures the vision can be executed
• Allows the delivery effort and resources to be quantified
• Permits the enterprise to move away traditional
approaches to managing data
18 February 2018 18
Creating A Data Vision – Making The Enterprise Data
Focussed
• Enable value to be derived from data
− Shorten the distance between business and analytics
• Facilitate data initiatives by removing the barriers to data
enablement
• IT needs to understand the data needs and associated data
business processes of the business and deliver results
− IT showing data leadership
• Top-down visualisation that is then implemented by
appropriate components are different layers
18 February 2018 19
Current Data Fabric State
18 February 2018 20
Target Data Fabric Future State
18 February 2018 21
Achieving The Target Data Fabric State
• Identify the steps needed to
achieve the vision
• Data fabric is linked to the
applications that generate and
use data
• Use the data fabric as a model
to describe the target future
state
• Articulate the future state
vision
18 February 2018 22
Data Fabric And Digital Enablement
• One element of digital business transformation is being
able to handle and process large amounts of data and
numbers of data sources
• The data environment changes very quickly while at the
same time becoming more distributed
• Traditional data management approaches, toolsets and
infrastructures fail to scale
• Analytics tools tend to be linked to individual business
function and data silos
18 February 2018 23
Key Design Principles Of A Data Fabric
18 February 2018 24
Administration, Management and Control – Keep control of and be able to
manage and administer data irrespective of where it is located
Security – Common security standards across entire fabric, automate
governance and compliance and manage risk
Automation – Management and housekeeping activities automated
Integration – All components interoperate together across all layers
Stability, Reliability and Consistency – Common tools and facilities used to
delivery stable and reliable fabric across all layers
Openness, Flexibility and Choice – Ability to choose and change data
storage, data access, data location
Performance, Retrieval, Access and Usage – Applications and users can get
access to data when it is needed, as soon as it is needed and in a format in
which it is usable
Business And IT Drivers For Data Fabric
18 February 2018 25
Reduce Cost of
Change and
Reaction
React and Move
Quickly
React and Move
Substantially
Business IT
Enable Growth
Opportunities
Balance Cost of
Maintenance and
Cost of Change
Have A Choice Of
And Be Able To
Adopt New
Technologies
Offer Innovative
Facilities and
Functions
React Quickly To
New
Requirements
Data Fabric Is A Basic Building Block Of An Enterprise
Data Strategy
18 February 2018 26
Data Operations Management
Data Quality Management
Data Development
Metadata Management
Document and Content Management
Reference and Master Data Management
Data Security Management
Data Warehousing and Business Intelligence
Management
Data Governance
Data Architecture
Management
Reporting
Insight/
Forecast
Monitoring Analysis
Solid
Data
Management
Foundation
and
Framework
} You Cannot
Have This ...
... Without
This
Why It Happened?
Why Is Likely To
Happen In The Future?
What Is Currently
Happening?
What Happened?
Every Enterprise Aspires To Data Driven Insights ...
February 18, 2018 27
Reporting
Insight/
Forecast
Monitoring Analysis
Data Driven Trailing And Leading Indicators
Reporting
• Report on Gathered Information On What Happened
To Understand Pinch Points, Quantify Effectiveness,
Measure Resource Usage And Success
Monitoring
• Gather Information In Realtime To Understand
Activities, Respond And Make Reallocation Decisions
Analysis
• Understand Reasons For Outcomes and Modify
Operation To Embed Improvements
Insight and Forecast
• Quantify Propensities, Forecast Likely Outcomes,
Identify Leading Indicators, Create Actionable
Intelligence
February 18, 2018 28
Trailing
Indicators
Leading
Indicators
Objective Of Designing An Enterprise Data Fabric
• Understanding all the data flows throughout the
enterprise
• Understanding yields insight into what is needed and what
will generate a benefit
18 February 2018 29
Administration,
Management
Monitoring,
Alerting, Event
Management
Archival,
Recall
Logging
Extended Data Fabric Conceptual Model
18 February 2018 30
Extended Data Fabric Conceptual Model
• Extended data fabric considers operating principles across core
fabric components and their interactions
18 February 2018 31
Administration, Management • Ability to manage and administer the entire data fabric
• Have a single view of the data fabric
Utility, Usability • Be usable and be able to be used
Operations • Support the automation of data fabric operations, perform capacity planning and
management
Monitoring, Alerting, Event
Management
• Provide monitoring of data fabric and support event management and alerting of problems
Governance, Compliance, Risk
Management
• Support data governance principles and enforcement of regulatory compliance
• Manage data risks
Security, Protection • Enforce data security and ensure protection of data
Archival, Recall • Support necessary and appropriate data archival and recall if required
Preservation, Retention,
Deletion
• Provide facilities to enforce and automate data preservation, retention and deletion policies
Capacity Planning • Manage capacity across all dimensions of data storage and I/O volumes and throughput
Logging • Log and maintain details on data activities for reporting and analysis
Installation, Upgrade.
Reconfiguration
• Support the seamless installation, upgrade and reconfiguration of new hardware and
software components
Backup, Recovery, Replication,
Continuity, Availability
• Implement backup and recovery, including business continuity, availability and replication
across infrastructure components
Data Fabric Needs To Support Entire Data Lifecycle
18 February 2018 32
Data Lifecycle View
• The stages in this generalised lifecycle are:
− Architect, Budget, Plan, Design and Specify - This relates to the design and specification of the data
storage and management and their supporting processes. This establishes the data management
framework
− Implement Underlying Technology- This is concerned with implementing the data-related hardware and
software technology components. This relates to database components, data storage hardware, backup
and recovery software, monitoring and control software and other items
− Enter, Create, Acquire, Derive, Update, Integrate, Capture- This stage is where data originated, such as
data entry or data capture and acquired from other systems or sources
− Secure, Store, Replicate and Distribute - In this stage, data is stored with appropriate security and access
controls including data access and update audit. It may be replicated to other applications and distributed
− Present, Report, Analyse, Model - This stage is concerned with the presentation of information, the
generation of reports and analysis and the created of derived information
− Preserve, Protect and Recover- This stage relates to the management of data in terms of backup,
recovery and retention/preservation
− Archive and Recall - This stage is where information that is no longer active but still required in archived
to secondary data storage platforms and from which the information can be recovered if required
− Delete/Remove - The stage is concerned with the deletion of data that cannot or does not need to be
retained any longer
− Define, Design, Implement, Measure, Manage, Monitor, Control, Staff, Train and Administer, Standards,
Governance, Fund - This is not a single stage but a set of processes and procedures that cross all stages
and is concerned with ensuring that the processes associated with each of the lifestyle stages are
operated correctly and that data assurance, quality and governance procedures exist and are operated
February 18, 2018 33
Using The Core Conceptual Model
• Understand the true complexity of data requirements
within and across the enterprise
• Use this complexity to derive a simplified an integrated
data fabric
18 February 2018 34
Data As A Realisable Asset
• Raw data must be refined into a format that can be used in order to
be viewed as an asset with realisable value
• For data to be an asset it must be:
− Have its underlying value extracted
− Accessible
− Usable
• Data has physical and tangible characteristics:
− Mass – it has bulk and requires resources to store, process and move
− Heat – it gets cold over time with different levels of dissipation
− Energy – data has different levels of energy based on its movement and value
− Volatility – the underlying value of the data can be lost at differing rates
− Complexity – the content and structure of the data is variable
− Motion – data moves from location to location as it is generated, stored,
process
− Structure – data may be structured, semi-structured or high-structured
− Size to Value Ratio – the usable value with the data may be large or small
relative to the volume of the raw data
18 February 2018 35
External Interacting Parties
18 February 2018 36
External Interacting Parties
• Enterprises typically operate in
a complex environment with
multiple interactions with
different communication with
many parties of many different
types over different channels
• Many types of external party
the enterprise interacts with
• There will be multiple
interactions with different
communications with many
parties of many different type
over different channels
• Every interaction will involve
data being accessed, presented,
transferred and processed
• Business Customer
• Client
• Collaborator
• Competitor
• Contractor
• Counterparty
• Dealer
• Distributor
• Franchisee
• Intermediary
• Licensee
• Licensor
• Outsourcer
• Partner
• Provider
• Public
• Regulator
• Regulated Entity
• Representative
• Retail Customer
• Service
• Shareholder
• Sub-Contractor
• Supplier
18 February 2018 37
External Party Interaction Zones, Applications,
Channels and Facilities
18 February 2018 38
External Party Interaction Zones, Applications,
Channels and Facilities
• This is the range of application-based modes and methods
of interaction between the enterprise and the External
Interacting Parties (rather than pure email)
18 February 2018 39
External Party Interaction Zones Data Stores
18 February 2018 40
External Party Interaction Zones Data Stores
• The data belonging to and data about the interactions with
External Interacting Parties using External Party Interaction
Zones, Applications, Channels and Facilities will be stored
and managed
18 February 2018 41
Date Intake/Gateway
18 February 2018 42
Date Intake/Gateway
• Generalised representation of the set of facilities for enabling and
managing all communications between the enterprise (and its systems)
and external parties
− Broker and integration facilities for centralising all external communications –
messaging, file transfer, web services
− Allows two-way communications – send/receive and to/from internal and external
− Supports multiple external channels and protocols
− Supports multiple authentication schemes and standards
− Provides asynchronous messaging
− Includes application programming interface
− Allows the exposure of endpoints which external parties can access such as SFTP
− Provides management and administration facilities to define how communications
should operate and for support and problem identification and resolution
− Delivers facilities for orchestration, transformation, development and deployment
management, traffic management
− Ensure data quality
− Provides workflow definition, implementation and operation
− Maintains an audit trail of all messages and communications
− Delivers high performance, resilience and availability
18 February 2018 43
External Third Party Applications
18 February 2018 44
External Third Party Applications
• The enterprise may use external applications (such as
social media platforms) as sources of external party data,
as routes to advertise or direct a message to external
parties or as channels to interact with external parties
− Information and content stored directly on applications
− Information about usage and interactions available from
applications
• The enterprise may also use external applications for
collaboration and information sharing either within the
enterprise or with external parties
18 February 2018 45
External Data Sensors
18 February 2018 46
External Data Sensors
• These represent measurement infrastructure and
applications owned by the enterprise, located externally
on some wide area network or other communications
facility that generate data that is transmitted to the
enterprise
− Telemetry units
18 February 2018 47
External Devices
18 February 2018 48
External Devices
• These represent infrastructure and applications owned by
the enterprise, located externally on some wide area
network or other communications facility that are
accessed and used by external parties to interact with the
enterprise
− ATMs
− Kiosks
− Point of sale devices
18 February 2018 49
Line of Business Applications
18 February 2018 50
Line of Business Applications
• This represent the applications used by individual business
functions or across the enterprise that are hosted on
internal enterprise infrastructure or are hosted externally
by application or platform service providers
18 February 2018 51
Data Storage Platforms
18 February 2018 52
Data Storage Platforms
• These represent the various structure data stores and
associated database management software used by
applications that are hosted on internal enterprise
infrastructure or are hosted externally by application or
platform service providers
18 February 2018 53
Data Reporting and Analysis Facilities
18 February 2018 54
Data Reporting and Analysis Facilities
• This represents the set of facilities to extract operational
data from business applications, create, store and manage
reference and master data, create and store enduring data
and analyse the data including reporting, visualisation,
mining and modelling
18 February 2018 55
Document Management Systems And Document
Sharing and Collaboration
18 February 2018 56
Document Management Systems And Document
Sharing and Collaboration
• This represents the facilities to store structure and
unstructured document-oriented data including document
metadata, extract information from documents and
support ad hoc and formal workflows related to these
documents
18 February 2018 57
Desktop Applications
18 February 2018 58
Desktop Applications
• These are the suite of desktop applications including email
to create, update, distribute and collaborate on
documents
18 February 2018 59
Many Data Types
18 February 2018 60
Transactions and
Application Data
Unstructured
Data
Documents
Document
Images
Videos Sound Usage Logs
Third-Party Data Files Messages Reports
Derived Data Data Models Web Content Telemetry Data
Data Warehouse
and Data Marts
Emails
Reference and
Master Data
Metadata
Data Fabric As Data Plumbing And A Data Refinery
• Data fabric should enable the flow of data throughout the
enterprise and the refinement of data to create appropriate
refined and derived data products from raw data
18 February 2018 61
18 February 2018 62
Data Layers Across Data Fabric
Layer Components Data Scope
Layer 8+ Data Operations, Usage,
Management, Control,
Governance, Analysis, Modelling
Unified management across all environments and all
layers and ensure performance, availability,
reliability, scalability, maintainability and
supportability
Layer 7 Data Presentation, Platforms,
Applications, Systems and Business
Processes
Set of data accessing and data using business
applications
Layer 6 Data Security and Governance Implement common data security policies across all
environments and platforms
Layer 5 Data Logical Access and Integration Insulate and abstract access from knowledge of
environments and platforms and integrate data
systems and data management
Layer 4 Data Transportation Provide a common data transport that connects all
environments
Layer 3 Data Network and Connectivity Connections to storage and physical access
irrespective of location across entire network
Layer 2 Data Physical Access Provide physical access to data on storage layer
Layer 1 Data Storage and Transmission
Infrastructure
Store data transparently on multiple environments
and move data between environments
Building A Comprehensive Data Vision
18 February 2018 63
Comprehensive Data Vision
Enterprise Data Strategy
Strategy Area
…
Strategy Area
Core Data Fabric Conceptual
Model Components
Component Type
Component
…
Component
…
Component Type
Component
…
Component
Extended Data Fabric
Conceptual Model
Data Management and
Operations Facility
…
Data Management and
Operations Facility
Data Lifecycle
Stage
…
Stage
Data Types
Type
…
Type
Extending Conceptual Model To Additional Levels Of
Detail To Build A Comprehensive Data Vision
• Individual data views can be combined to articulate a
comprehensive data vision
− Enterprise Data Strategy
• Individual strategy areas
− Core Data Fabric Conceptual Model Components
• Individual elements within each component
− Extended Data Fabric Conceptual Model
• Operating principles and interactions
− Data Lifecycle
• Individual stages within lifecycle
− Data Types
• Individual data types
• Builds an understanding of how the enterprise wants and
needs to handle and use data
18 February 2018 64
Extending Conceptual Model To Additional Levels Of
Detail To Build A Comprehensive Data Vision
18 February 2018 65
Data Fabric Landscape
Additional
Data
Dimensions
and Views
Summary
• Data fabric is concerned with creating a data vision for the enterprise
• The conceptual data fabric model represents a rich picture of the enterprise’s data
context
− Detailed visualisations represent information more effectively than lengthy narrative text
• Use the conceptual data fabric model to identify gaps between the current and
desired target
• Data fabric provides a basis for understanding the enterprise’s ideal data
architecture
• Designing a data fabric enables the enterprise respond to and take advantage of
key related data trends
− Shadow IT occurs when the IT function cannot deliver IT change and new data facilities
quickly
− Uncontrolled data platforms and storage represent a significant and real risk to the
enterprise
• Enterprise data fabric should enables appropriate and seamless move to multiple
cloud/XaaS platforms - public, private and hybrid - across the entire data
infrastructure
• Enables the enterprise focus on achieving benefits from data rather than on data
operations
18 February 2018 66
More Information
Alan McSweeney
http://ie.linkedin.com/in/alanmcsweeney
18 February 2018 67

Weitere ähnliche Inhalte

Was ist angesagt?

Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureDatabricks
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake OverviewJames Serra
 
Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)James Serra
 
Improving Data Literacy Around Data Architecture
Improving Data Literacy Around Data ArchitectureImproving Data Literacy Around Data Architecture
Improving Data Literacy Around Data ArchitectureDATAVERSITY
 
DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDatabricks
 
Data Mesh for Dinner
Data Mesh for DinnerData Mesh for Dinner
Data Mesh for DinnerKent Graziano
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture DesignKujambu Murugesan
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationDATAVERSITY
 
Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)Denodo
 
Data Architecture Brief Overview
Data Architecture Brief OverviewData Architecture Brief Overview
Data Architecture Brief OverviewHal Kalechofsky
 
Databricks Platform.pptx
Databricks Platform.pptxDatabricks Platform.pptx
Databricks Platform.pptxAlex Ivy
 
Time to Talk about Data Mesh
Time to Talk about Data MeshTime to Talk about Data Mesh
Time to Talk about Data MeshLibbySchulze
 
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...HostedbyConfluent
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Databricks
 
The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as ProductDATAVERSITY
 
Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...
Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...
Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...Alan McSweeney
 
Data Lakehouse, Data Mesh, and Data Fabric (r2)
Data Lakehouse, Data Mesh, and Data Fabric (r2)Data Lakehouse, Data Mesh, and Data Fabric (r2)
Data Lakehouse, Data Mesh, and Data Fabric (r2)James Serra
 
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data FabricUsing a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data FabricCambridge Semantics
 

Was ist angesagt? (20)

Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data Architecture
 
Webinar Data Mesh - Part 3
Webinar Data Mesh - Part 3Webinar Data Mesh - Part 3
Webinar Data Mesh - Part 3
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake Overview
 
Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)
 
Improving Data Literacy Around Data Architecture
Improving Data Literacy Around Data ArchitectureImproving Data Literacy Around Data Architecture
Improving Data Literacy Around Data Architecture
 
DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Mesh for Dinner
Data Mesh for DinnerData Mesh for Dinner
Data Mesh for Dinner
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture Design
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital Transformation
 
Snowflake Overview
Snowflake OverviewSnowflake Overview
Snowflake Overview
 
Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)
 
Data Architecture Brief Overview
Data Architecture Brief OverviewData Architecture Brief Overview
Data Architecture Brief Overview
 
Databricks Platform.pptx
Databricks Platform.pptxDatabricks Platform.pptx
Databricks Platform.pptx
 
Time to Talk about Data Mesh
Time to Talk about Data MeshTime to Talk about Data Mesh
Time to Talk about Data Mesh
 
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as Product
 
Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...
Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...
Data Integration, Access, Flow, Exchange, Transfer, Load And Extract Architec...
 
Data Lakehouse, Data Mesh, and Data Fabric (r2)
Data Lakehouse, Data Mesh, and Data Fabric (r2)Data Lakehouse, Data Mesh, and Data Fabric (r2)
Data Lakehouse, Data Mesh, and Data Fabric (r2)
 
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data FabricUsing a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
 

Ähnlich wie Designing An Enterprise Data Fabric

GDPR Noncompliance: Avoid the Risk with Data Virtualization
GDPR Noncompliance: Avoid the Risk with Data VirtualizationGDPR Noncompliance: Avoid the Risk with Data Virtualization
GDPR Noncompliance: Avoid the Risk with Data VirtualizationDenodo
 
SG Data Mgt - Findings and Recommendations.pptx
SG Data Mgt - Findings and Recommendations.pptxSG Data Mgt - Findings and Recommendations.pptx
SG Data Mgt - Findings and Recommendations.pptxssuser57f752
 
Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...
Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...
Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...Denodo
 
A Logical Architecture is Always a Flexible Architecture (ASEAN)
A Logical Architecture is Always a Flexible Architecture (ASEAN)A Logical Architecture is Always a Flexible Architecture (ASEAN)
A Logical Architecture is Always a Flexible Architecture (ASEAN)Denodo
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Nathan Bijnens
 
data collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptxdata collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptxSourabhkumar729579
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsightsWilfried Hoge
 
ETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxParnalSatle
 
Information Systems in Global Business Today.pptx
Information Systems in Global Business Today.pptxInformation Systems in Global Business Today.pptx
Information Systems in Global Business Today.pptxRoshni814224
 
Accelerate Cloud Migrations and Architecture with Data Virtualization
Accelerate Cloud Migrations and Architecture with Data VirtualizationAccelerate Cloud Migrations and Architecture with Data Virtualization
Accelerate Cloud Migrations and Architecture with Data VirtualizationDenodo
 
Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?
Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?
Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?Denodo
 
Modern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph TechnologyModern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph TechnologyNeo4j
 
data_blending
data_blendingdata_blending
data_blendingsubit1615
 
Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...
Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...
Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...Matt Stubbs
 
Enterprise information infrastructure
Enterprise information infrastructureEnterprise information infrastructure
Enterprise information infrastructureJunaid Muzaffar
 
Fast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationDenodo
 
Hadoop: Making it work for the Business Unit
Hadoop: Making it work for the Business UnitHadoop: Making it work for the Business Unit
Hadoop: Making it work for the Business UnitDataWorks Summit
 
Big data – A Review
Big data – A ReviewBig data – A Review
Big data – A ReviewIRJET Journal
 

Ähnlich wie Designing An Enterprise Data Fabric (20)

GDPR Noncompliance: Avoid the Risk with Data Virtualization
GDPR Noncompliance: Avoid the Risk with Data VirtualizationGDPR Noncompliance: Avoid the Risk with Data Virtualization
GDPR Noncompliance: Avoid the Risk with Data Virtualization
 
SG Data Mgt - Findings and Recommendations.pptx
SG Data Mgt - Findings and Recommendations.pptxSG Data Mgt - Findings and Recommendations.pptx
SG Data Mgt - Findings and Recommendations.pptx
 
Sgcp14dunlea
Sgcp14dunleaSgcp14dunlea
Sgcp14dunlea
 
Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...
Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...
Data Fabric - Why Should Organizations Implement a Logical and Not a Physical...
 
A Logical Architecture is Always a Flexible Architecture (ASEAN)
A Logical Architecture is Always a Flexible Architecture (ASEAN)A Logical Architecture is Always a Flexible Architecture (ASEAN)
A Logical Architecture is Always a Flexible Architecture (ASEAN)
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)
 
data collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptxdata collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptx
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsights
 
Big data
Big dataBig data
Big data
 
ETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptx
 
Information Systems in Global Business Today.pptx
Information Systems in Global Business Today.pptxInformation Systems in Global Business Today.pptx
Information Systems in Global Business Today.pptx
 
Accelerate Cloud Migrations and Architecture with Data Virtualization
Accelerate Cloud Migrations and Architecture with Data VirtualizationAccelerate Cloud Migrations and Architecture with Data Virtualization
Accelerate Cloud Migrations and Architecture with Data Virtualization
 
Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?
Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?
Finding Your Ideal Data Architecture: Data Fabric, Data Mesh or Both?
 
Modern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph TechnologyModern Data Challenges require Modern Graph Technology
Modern Data Challenges require Modern Graph Technology
 
data_blending
data_blendingdata_blending
data_blending
 
Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...
Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...
Big Data LDN 2018: REALISING THE PROMISE OF SELF-SERVICE ANALYTICS WITH DATA ...
 
Enterprise information infrastructure
Enterprise information infrastructureEnterprise information infrastructure
Enterprise information infrastructure
 
Fast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow Presentation
 
Hadoop: Making it work for the Business Unit
Hadoop: Making it work for the Business UnitHadoop: Making it work for the Business Unit
Hadoop: Making it work for the Business Unit
 
Big data – A Review
Big data – A ReviewBig data – A Review
Big data – A Review
 

Mehr von Alan McSweeney

Data Architecture for Solutions.pdf
Data Architecture for Solutions.pdfData Architecture for Solutions.pdf
Data Architecture for Solutions.pdfAlan McSweeney
 
Solution Architecture and Solution Estimation.pdf
Solution Architecture and Solution Estimation.pdfSolution Architecture and Solution Estimation.pdf
Solution Architecture and Solution Estimation.pdfAlan McSweeney
 
Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...
Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...
Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...Alan McSweeney
 
Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...
Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...
Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...Alan McSweeney
 
IT Architecture’s Role In Solving Technical Debt.pdf
IT Architecture’s Role In Solving Technical Debt.pdfIT Architecture’s Role In Solving Technical Debt.pdf
IT Architecture’s Role In Solving Technical Debt.pdfAlan McSweeney
 
Solution Architecture And Solution Security
Solution Architecture And Solution SecuritySolution Architecture And Solution Security
Solution Architecture And Solution SecurityAlan McSweeney
 
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Alan McSweeney
 
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Alan McSweeney
 
Solution Security Architecture
Solution Security ArchitectureSolution Security Architecture
Solution Security ArchitectureAlan McSweeney
 
Solution Architecture And (Robotic) Process Automation Solutions
Solution Architecture And (Robotic) Process Automation SolutionsSolution Architecture And (Robotic) Process Automation Solutions
Solution Architecture And (Robotic) Process Automation SolutionsAlan McSweeney
 
Data Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata HarmonisationData Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata HarmonisationAlan McSweeney
 
Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...
Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...
Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...Alan McSweeney
 
Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...
Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...
Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...Alan McSweeney
 
Operational Risk Management Data Validation Architecture
Operational Risk Management Data Validation ArchitectureOperational Risk Management Data Validation Architecture
Operational Risk Management Data Validation ArchitectureAlan McSweeney
 
Ireland 2019 and 2020 Compared - Individual Charts
Ireland   2019 and 2020 Compared - Individual ChartsIreland   2019 and 2020 Compared - Individual Charts
Ireland 2019 and 2020 Compared - Individual ChartsAlan McSweeney
 
Analysis of Irish Mortality Using Public Data Sources 2014-2020
Analysis of Irish Mortality Using Public Data Sources 2014-2020Analysis of Irish Mortality Using Public Data Sources 2014-2020
Analysis of Irish Mortality Using Public Data Sources 2014-2020Alan McSweeney
 
Ireland – 2019 And 2020 Compared In Data
Ireland – 2019 And 2020 Compared In DataIreland – 2019 And 2020 Compared In Data
Ireland – 2019 And 2020 Compared In DataAlan McSweeney
 
Review of Information Technology Function Critical Capability Models
Review of Information Technology Function Critical Capability ModelsReview of Information Technology Function Critical Capability Models
Review of Information Technology Function Critical Capability ModelsAlan McSweeney
 
Critical Review of Open Group IT4IT Reference Architecture
Critical Review of Open Group IT4IT Reference ArchitectureCritical Review of Open Group IT4IT Reference Architecture
Critical Review of Open Group IT4IT Reference ArchitectureAlan McSweeney
 
Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020
Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020
Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020Alan McSweeney
 

Mehr von Alan McSweeney (20)

Data Architecture for Solutions.pdf
Data Architecture for Solutions.pdfData Architecture for Solutions.pdf
Data Architecture for Solutions.pdf
 
Solution Architecture and Solution Estimation.pdf
Solution Architecture and Solution Estimation.pdfSolution Architecture and Solution Estimation.pdf
Solution Architecture and Solution Estimation.pdf
 
Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...
Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...
Validating COVID-19 Mortality Data and Deaths for Ireland March 2020 – March ...
 
Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...
Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...
Analysis of the Numbers of Catholic Clergy and Members of Religious in Irelan...
 
IT Architecture’s Role In Solving Technical Debt.pdf
IT Architecture’s Role In Solving Technical Debt.pdfIT Architecture’s Role In Solving Technical Debt.pdf
IT Architecture’s Role In Solving Technical Debt.pdf
 
Solution Architecture And Solution Security
Solution Architecture And Solution SecuritySolution Architecture And Solution Security
Solution Architecture And Solution Security
 
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
 
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
 
Solution Security Architecture
Solution Security ArchitectureSolution Security Architecture
Solution Security Architecture
 
Solution Architecture And (Robotic) Process Automation Solutions
Solution Architecture And (Robotic) Process Automation SolutionsSolution Architecture And (Robotic) Process Automation Solutions
Solution Architecture And (Robotic) Process Automation Solutions
 
Data Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata HarmonisationData Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata Harmonisation
 
Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...
Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...
Comparison of COVID-19 Mortality Data and Deaths for Ireland March 2020 – Mar...
 
Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...
Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...
Analysis of Decentralised, Distributed Decision-Making For Optimising Domesti...
 
Operational Risk Management Data Validation Architecture
Operational Risk Management Data Validation ArchitectureOperational Risk Management Data Validation Architecture
Operational Risk Management Data Validation Architecture
 
Ireland 2019 and 2020 Compared - Individual Charts
Ireland   2019 and 2020 Compared - Individual ChartsIreland   2019 and 2020 Compared - Individual Charts
Ireland 2019 and 2020 Compared - Individual Charts
 
Analysis of Irish Mortality Using Public Data Sources 2014-2020
Analysis of Irish Mortality Using Public Data Sources 2014-2020Analysis of Irish Mortality Using Public Data Sources 2014-2020
Analysis of Irish Mortality Using Public Data Sources 2014-2020
 
Ireland – 2019 And 2020 Compared In Data
Ireland – 2019 And 2020 Compared In DataIreland – 2019 And 2020 Compared In Data
Ireland – 2019 And 2020 Compared In Data
 
Review of Information Technology Function Critical Capability Models
Review of Information Technology Function Critical Capability ModelsReview of Information Technology Function Critical Capability Models
Review of Information Technology Function Critical Capability Models
 
Critical Review of Open Group IT4IT Reference Architecture
Critical Review of Open Group IT4IT Reference ArchitectureCritical Review of Open Group IT4IT Reference Architecture
Critical Review of Open Group IT4IT Reference Architecture
 
Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020
Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020
Analysis of Possible Excess COVID-19 Deaths in Ireland From Jan 2020 to Jun 2020
 

Kürzlich hochgeladen

Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...Pooja Nehwal
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...dajasot375
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiSuhani Kapoor
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998YohFuh
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130Suhani Kapoor
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...Suhani Kapoor
 
Data Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health ClassificationData Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health ClassificationBoston Institute of Analytics
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfRachmat Ramadhan H
 

Kürzlich hochgeladen (20)

Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
 
{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
 
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in  KishangarhDelhi 99530 vip 56974 Genuine Escort Service Call Girls in  Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
 
Data Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health ClassificationData Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health Classification
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
 

Designing An Enterprise Data Fabric

  • 1. Designing An Enterprise Data Fabric Alan McSweeney http://ie.linkedin.com/in/alanmcsweeney
  • 2. What Is An Enterprise Data Fabric? • Set of hardware and software infrastructure, tools and facilities to implement, administer, manage and operate data operations across the entire span of the data within the enterprise across all data activities including data acquisition, transformation, storage, distribution, integration, replication, availability, security, protection, disaster recovery, presentation, analytics, preservation, retention, backup, retrieval, archival, recall, deletion, monitoring, capacity planning across all data storage platforms enabling use by applications to meet the data needs of the enterprise • Mesh enabling the movement of data around the enterprise • Provides access to all data assets • Supports the flow, processing, distribution, management and exchange of data throughout the enterprise • Provide coherent data framework for use by custom and acquired applications • Independent of specific applications • Independent of specific data platforms 18 February 2018 2
  • 3. Building An Enterprise Data Fabric 18 February 2018 3
  • 4. Core Data Fabric Conceptual Model 18 February 2018 4
  • 5. Data Fabric Conceptual Model – Components - 1 of 2 18 February 2018 5 Component Description External Interacting Parties These are the range of external parties that supply data to and access data from the enterprise External Party Interaction Zones, Applications, Channels and Facilities These are the set of applications and data interface and exchange points provided specifically to External Interacting Parties to allow them supply data to and access data from the enterprise These can be hosted internally or externally or a mix of both External Third Party Applications These are third-party applications (such as social media platforms) that contain information about the enterprise or that are used by the enterprise to present information to or interact with External Interacting Parties or where the enterprise is referred to, affecting the perception or brand of the enterprise External Data Sensors Sources of remote data measurements External Party Interaction Zones Data Stores These are applications and sets of data created by the enterprise to be externally facing where external parties can access information and interact with the enterprise External Devices These are devices connected with services offered by the enterprise (such as ATMs and Kiosks) Date Intake/Gateway This is the set of facilities for handling data supplied to the enterprise including validation and transformation including a possible integration or service bus This can be hosted internally or externally or a mix of both Line of Business Applications This represents the set of line of business applications deployed on enterprise owned and managed infrastructure used by business functions to operate their business processes Organisation Operational Data Stores These are the various operational data stores used by the Line of Business Applications
  • 6. Data Fabric Conceptual Model – Components - 2 of 2 18 February 2018 6 Component Description Line of Business Applications Hosted Outside the Organisation This represents the set of line of business applications deployed on external infrastructure used by business functions to operate their business processes This includes cloud facilities such as external data storage and XaaS facilities and an integration service to connect external data to internal data External Application Operational Data Stores These are the various operational data stores used by the Line of Business Applications used by Line of Business Applications Hosted Outside the Organisation Data Mastering These are facilities to create and manage master data and data extracted from operational data to create a data warehouse and data extracts for reporting and analysis. This includes an extract, transformation and load facility These can be hosted internally or externally or a mix of both Data Reporting and Analysis Facilities This represents the range of tools and facilities to report on, analyse, mine and model data These can be hosted internally or externally or a mix of both Document Sharing and Collaboration These are tools used within the enterprise to share and collaborate on the authoring of documents Document Management Systems These are systems used to manage transactional and ad hoc structured and unstructured documents in a formal and controlled manner, including the metadata assigned to documents Desktop Applications These are applications used by individual users to view and author documents Document and Information Portal This provides structured access to documents and information including externally hosted applications providing these facilities Unstructured Data Stores These are storage locations for enterprise documentation
  • 7. Zones Within Data Fabric Conceptual Model • Sets of components of conceptual data fabric model can be grouped into zones: − Internal – within the enterprise’s boundary − Cloud Extension – extensions to enterprise applications and data held in external cloud platforms − Interface – set of components responsible for getting data into and out of the enterprise and presenting data and applications externally − Externally Located Extension – infrastructure and applications that are connected to the wider enterprise network − External Controlled – components outside the enterprise but under the control of the enterprise − External Uncontrolled – components outside the enterprise and not under the direct control of the enterprise 18 February 2018 7
  • 8. Why Create A Conceptual Data Fabric Model? • Conceptual data fabric model represents a rich picture of the enterprise’s data context − Embodies an idealised and target data view • Detailed visualisations represent information more effectively than lengthy narrative text − More easily understood and engaged with • Show relationships, interactions • Capture complexity easily • Provides a more concise illustration of state • Better tool to elicit information • Gaps, errors and omissions more easily identified • Assists informed discussions • Evolve and refine rich picture representations of as-in and to-be situations • Cannot expect to capture every piece of information – focus on the important elements • A rich picture is not a data management process map (yet) 18 February 2018 8
  • 9. Differences Between Current And Target Conceptual Data Model • Use the conceptual data fabric model to identify gaps between the current and desired target 18 February 2018 9
  • 10. Core Data Fabric Conceptual Model • Conceptual level is one representation of data related components and their interactions within, across and outside the enterprise • Not all components apply to all enterprises • Useful as a basis for understanding the enterprise’s ideal data architecture − Creating an inventory of components in each conceptual area − Defining an idealised target data fabric • Just one dimension of defining, detailing and describing data infrastructure • Other dimensions include: − Data types − Data volumes − Individual data flows − Individual applications − Individual data platforms and applications 18 February 2018 10
  • 11. Responding To Interrelated Data Trends 18 February 2018 11 Data Trends Cloud Offerings and Services Analytics Capabilities Data Regulations Internal and External Digital Expectations,
  • 12. Responding To Interrelated Data Trends • Designing a data fabric enables the enterprise respond to and take advantage of key related data trends − Internal and External Digital Expectations • External actors expect to be able to interact digitally • Within the enterprise there is an imperative to offer digital interactions and extensions • Gives rise to large amounts of direct and indirect data that may or may not be processed − Cloud Offerings and Services • There are multiple providers of cloud-based services that enable the enterprise invest in and avail of application and data capabilities with low cost and time of entry • Data location changes and data must be integrated across platforms − Data Regulations • The data regulation landscape is changing - GDPR, ePrivacy Regulation Digital Single Market, eIDAS, NIS Directive • This requires greater data compliance and governance effort • Uncontrolled data platforms and storage represent a significant and real risk to the enterprise − Analytics Capabilities • New analytics capabilities across dimensions of data volumes and complexity enables more complex analysis 18 February 2018 12
  • 13. IT Function Data Leadership • Enables the IT function demonstrate positive data leadership • Shows the IT function is able and willing to respond to business data needs 18 February 2018 13
  • 14. What Are The Data Challenges? • More and more data of many different types • Increasingly distributed platform landscape with data movement, integration and management across multiple service providers and cloud-based services • Compliance and regulation requiring greater control of personal data • Newer data technologies and facilities outside the core competence of the enterprise • Shadow IT occurs when the IT function cannot deliver IT change and new data facilities quickly 18 February 2018 14
  • 15. Data Fabric Is Much More Than A Move To The Cloud • Enterprise data fabric should enables appropriate and seamless move to multiple cloud/XaaS platforms - public, private and hybrid - across the entire data infrastructure − Storage − Business applications − Data management − Reporting and analytics tools • Cloud impacts the enterprise’s approach to data − Enterprises cannot ignore cloud and XaaS options • Enterprise data fabric needs to encompass the diversity of data storage infrastructures • Design an open and flexible data fabric that improves the responsiveness of the IT function and reduces shadow IT 18 February 2018 15
  • 16. Why Have An Enterprise Data Fabric? • Enables adoption of new data technologies, platforms, systems and infrastructures within an overall data context • Enables move to simplification of data infrastructure • Enables scalability of data infrastructure • Enables industrialisation and automation of data operations, administration, management, governance and common security model • Reduce the effort and cost of management and administration • Focus on extracting data value • Improve the reliability of data operations • Manage risk of mixed data platforms, uncontrolled data on uncontrolled platforms • Allows benefits of scalable data infrastructures that are located anywhere to be achieved 18 February 2018 16
  • 17. Why Have An Enterprise Data Fabric? • Focus on achieving benefits from data rather than on data operations − Reduce time to manage, find, combine and curate data − Reduce wasted time, capacity, resources, cost • Abstract data infrastructure from data usage • Enable use of data in currently unanticipated ways through flexible and adaptable facilities • Reduce time to achieve insights 18 February 2018 17
  • 18. Creating A Data Vision • Data fabric is concerned with creating a data vision for the enterprise − Data capabilities, competencies − Where the enterprise is and where it wants to be • Define the future target landscape and define the required journey to achieve it • Ensures the vision can be executed • Allows the delivery effort and resources to be quantified • Permits the enterprise to move away traditional approaches to managing data 18 February 2018 18
  • 19. Creating A Data Vision – Making The Enterprise Data Focussed • Enable value to be derived from data − Shorten the distance between business and analytics • Facilitate data initiatives by removing the barriers to data enablement • IT needs to understand the data needs and associated data business processes of the business and deliver results − IT showing data leadership • Top-down visualisation that is then implemented by appropriate components are different layers 18 February 2018 19
  • 20. Current Data Fabric State 18 February 2018 20
  • 21. Target Data Fabric Future State 18 February 2018 21
  • 22. Achieving The Target Data Fabric State • Identify the steps needed to achieve the vision • Data fabric is linked to the applications that generate and use data • Use the data fabric as a model to describe the target future state • Articulate the future state vision 18 February 2018 22
  • 23. Data Fabric And Digital Enablement • One element of digital business transformation is being able to handle and process large amounts of data and numbers of data sources • The data environment changes very quickly while at the same time becoming more distributed • Traditional data management approaches, toolsets and infrastructures fail to scale • Analytics tools tend to be linked to individual business function and data silos 18 February 2018 23
  • 24. Key Design Principles Of A Data Fabric 18 February 2018 24 Administration, Management and Control – Keep control of and be able to manage and administer data irrespective of where it is located Security – Common security standards across entire fabric, automate governance and compliance and manage risk Automation – Management and housekeeping activities automated Integration – All components interoperate together across all layers Stability, Reliability and Consistency – Common tools and facilities used to delivery stable and reliable fabric across all layers Openness, Flexibility and Choice – Ability to choose and change data storage, data access, data location Performance, Retrieval, Access and Usage – Applications and users can get access to data when it is needed, as soon as it is needed and in a format in which it is usable
  • 25. Business And IT Drivers For Data Fabric 18 February 2018 25 Reduce Cost of Change and Reaction React and Move Quickly React and Move Substantially Business IT Enable Growth Opportunities Balance Cost of Maintenance and Cost of Change Have A Choice Of And Be Able To Adopt New Technologies Offer Innovative Facilities and Functions React Quickly To New Requirements
  • 26. Data Fabric Is A Basic Building Block Of An Enterprise Data Strategy 18 February 2018 26 Data Operations Management Data Quality Management Data Development Metadata Management Document and Content Management Reference and Master Data Management Data Security Management Data Warehousing and Business Intelligence Management Data Governance Data Architecture Management Reporting Insight/ Forecast Monitoring Analysis Solid Data Management Foundation and Framework } You Cannot Have This ... ... Without This
  • 27. Why It Happened? Why Is Likely To Happen In The Future? What Is Currently Happening? What Happened? Every Enterprise Aspires To Data Driven Insights ... February 18, 2018 27 Reporting Insight/ Forecast Monitoring Analysis
  • 28. Data Driven Trailing And Leading Indicators Reporting • Report on Gathered Information On What Happened To Understand Pinch Points, Quantify Effectiveness, Measure Resource Usage And Success Monitoring • Gather Information In Realtime To Understand Activities, Respond And Make Reallocation Decisions Analysis • Understand Reasons For Outcomes and Modify Operation To Embed Improvements Insight and Forecast • Quantify Propensities, Forecast Likely Outcomes, Identify Leading Indicators, Create Actionable Intelligence February 18, 2018 28 Trailing Indicators Leading Indicators
  • 29. Objective Of Designing An Enterprise Data Fabric • Understanding all the data flows throughout the enterprise • Understanding yields insight into what is needed and what will generate a benefit 18 February 2018 29
  • 31. Extended Data Fabric Conceptual Model • Extended data fabric considers operating principles across core fabric components and their interactions 18 February 2018 31 Administration, Management • Ability to manage and administer the entire data fabric • Have a single view of the data fabric Utility, Usability • Be usable and be able to be used Operations • Support the automation of data fabric operations, perform capacity planning and management Monitoring, Alerting, Event Management • Provide monitoring of data fabric and support event management and alerting of problems Governance, Compliance, Risk Management • Support data governance principles and enforcement of regulatory compliance • Manage data risks Security, Protection • Enforce data security and ensure protection of data Archival, Recall • Support necessary and appropriate data archival and recall if required Preservation, Retention, Deletion • Provide facilities to enforce and automate data preservation, retention and deletion policies Capacity Planning • Manage capacity across all dimensions of data storage and I/O volumes and throughput Logging • Log and maintain details on data activities for reporting and analysis Installation, Upgrade. Reconfiguration • Support the seamless installation, upgrade and reconfiguration of new hardware and software components Backup, Recovery, Replication, Continuity, Availability • Implement backup and recovery, including business continuity, availability and replication across infrastructure components
  • 32. Data Fabric Needs To Support Entire Data Lifecycle 18 February 2018 32
  • 33. Data Lifecycle View • The stages in this generalised lifecycle are: − Architect, Budget, Plan, Design and Specify - This relates to the design and specification of the data storage and management and their supporting processes. This establishes the data management framework − Implement Underlying Technology- This is concerned with implementing the data-related hardware and software technology components. This relates to database components, data storage hardware, backup and recovery software, monitoring and control software and other items − Enter, Create, Acquire, Derive, Update, Integrate, Capture- This stage is where data originated, such as data entry or data capture and acquired from other systems or sources − Secure, Store, Replicate and Distribute - In this stage, data is stored with appropriate security and access controls including data access and update audit. It may be replicated to other applications and distributed − Present, Report, Analyse, Model - This stage is concerned with the presentation of information, the generation of reports and analysis and the created of derived information − Preserve, Protect and Recover- This stage relates to the management of data in terms of backup, recovery and retention/preservation − Archive and Recall - This stage is where information that is no longer active but still required in archived to secondary data storage platforms and from which the information can be recovered if required − Delete/Remove - The stage is concerned with the deletion of data that cannot or does not need to be retained any longer − Define, Design, Implement, Measure, Manage, Monitor, Control, Staff, Train and Administer, Standards, Governance, Fund - This is not a single stage but a set of processes and procedures that cross all stages and is concerned with ensuring that the processes associated with each of the lifestyle stages are operated correctly and that data assurance, quality and governance procedures exist and are operated February 18, 2018 33
  • 34. Using The Core Conceptual Model • Understand the true complexity of data requirements within and across the enterprise • Use this complexity to derive a simplified an integrated data fabric 18 February 2018 34
  • 35. Data As A Realisable Asset • Raw data must be refined into a format that can be used in order to be viewed as an asset with realisable value • For data to be an asset it must be: − Have its underlying value extracted − Accessible − Usable • Data has physical and tangible characteristics: − Mass – it has bulk and requires resources to store, process and move − Heat – it gets cold over time with different levels of dissipation − Energy – data has different levels of energy based on its movement and value − Volatility – the underlying value of the data can be lost at differing rates − Complexity – the content and structure of the data is variable − Motion – data moves from location to location as it is generated, stored, process − Structure – data may be structured, semi-structured or high-structured − Size to Value Ratio – the usable value with the data may be large or small relative to the volume of the raw data 18 February 2018 35
  • 37. External Interacting Parties • Enterprises typically operate in a complex environment with multiple interactions with different communication with many parties of many different types over different channels • Many types of external party the enterprise interacts with • There will be multiple interactions with different communications with many parties of many different type over different channels • Every interaction will involve data being accessed, presented, transferred and processed • Business Customer • Client • Collaborator • Competitor • Contractor • Counterparty • Dealer • Distributor • Franchisee • Intermediary • Licensee • Licensor • Outsourcer • Partner • Provider • Public • Regulator • Regulated Entity • Representative • Retail Customer • Service • Shareholder • Sub-Contractor • Supplier 18 February 2018 37
  • 38. External Party Interaction Zones, Applications, Channels and Facilities 18 February 2018 38
  • 39. External Party Interaction Zones, Applications, Channels and Facilities • This is the range of application-based modes and methods of interaction between the enterprise and the External Interacting Parties (rather than pure email) 18 February 2018 39
  • 40. External Party Interaction Zones Data Stores 18 February 2018 40
  • 41. External Party Interaction Zones Data Stores • The data belonging to and data about the interactions with External Interacting Parties using External Party Interaction Zones, Applications, Channels and Facilities will be stored and managed 18 February 2018 41
  • 43. Date Intake/Gateway • Generalised representation of the set of facilities for enabling and managing all communications between the enterprise (and its systems) and external parties − Broker and integration facilities for centralising all external communications – messaging, file transfer, web services − Allows two-way communications – send/receive and to/from internal and external − Supports multiple external channels and protocols − Supports multiple authentication schemes and standards − Provides asynchronous messaging − Includes application programming interface − Allows the exposure of endpoints which external parties can access such as SFTP − Provides management and administration facilities to define how communications should operate and for support and problem identification and resolution − Delivers facilities for orchestration, transformation, development and deployment management, traffic management − Ensure data quality − Provides workflow definition, implementation and operation − Maintains an audit trail of all messages and communications − Delivers high performance, resilience and availability 18 February 2018 43
  • 44. External Third Party Applications 18 February 2018 44
  • 45. External Third Party Applications • The enterprise may use external applications (such as social media platforms) as sources of external party data, as routes to advertise or direct a message to external parties or as channels to interact with external parties − Information and content stored directly on applications − Information about usage and interactions available from applications • The enterprise may also use external applications for collaboration and information sharing either within the enterprise or with external parties 18 February 2018 45
  • 46. External Data Sensors 18 February 2018 46
  • 47. External Data Sensors • These represent measurement infrastructure and applications owned by the enterprise, located externally on some wide area network or other communications facility that generate data that is transmitted to the enterprise − Telemetry units 18 February 2018 47
  • 49. External Devices • These represent infrastructure and applications owned by the enterprise, located externally on some wide area network or other communications facility that are accessed and used by external parties to interact with the enterprise − ATMs − Kiosks − Point of sale devices 18 February 2018 49
  • 50. Line of Business Applications 18 February 2018 50
  • 51. Line of Business Applications • This represent the applications used by individual business functions or across the enterprise that are hosted on internal enterprise infrastructure or are hosted externally by application or platform service providers 18 February 2018 51
  • 52. Data Storage Platforms 18 February 2018 52
  • 53. Data Storage Platforms • These represent the various structure data stores and associated database management software used by applications that are hosted on internal enterprise infrastructure or are hosted externally by application or platform service providers 18 February 2018 53
  • 54. Data Reporting and Analysis Facilities 18 February 2018 54
  • 55. Data Reporting and Analysis Facilities • This represents the set of facilities to extract operational data from business applications, create, store and manage reference and master data, create and store enduring data and analyse the data including reporting, visualisation, mining and modelling 18 February 2018 55
  • 56. Document Management Systems And Document Sharing and Collaboration 18 February 2018 56
  • 57. Document Management Systems And Document Sharing and Collaboration • This represents the facilities to store structure and unstructured document-oriented data including document metadata, extract information from documents and support ad hoc and formal workflows related to these documents 18 February 2018 57
  • 59. Desktop Applications • These are the suite of desktop applications including email to create, update, distribute and collaborate on documents 18 February 2018 59
  • 60. Many Data Types 18 February 2018 60 Transactions and Application Data Unstructured Data Documents Document Images Videos Sound Usage Logs Third-Party Data Files Messages Reports Derived Data Data Models Web Content Telemetry Data Data Warehouse and Data Marts Emails Reference and Master Data Metadata
  • 61. Data Fabric As Data Plumbing And A Data Refinery • Data fabric should enable the flow of data throughout the enterprise and the refinement of data to create appropriate refined and derived data products from raw data 18 February 2018 61
  • 62. 18 February 2018 62 Data Layers Across Data Fabric Layer Components Data Scope Layer 8+ Data Operations, Usage, Management, Control, Governance, Analysis, Modelling Unified management across all environments and all layers and ensure performance, availability, reliability, scalability, maintainability and supportability Layer 7 Data Presentation, Platforms, Applications, Systems and Business Processes Set of data accessing and data using business applications Layer 6 Data Security and Governance Implement common data security policies across all environments and platforms Layer 5 Data Logical Access and Integration Insulate and abstract access from knowledge of environments and platforms and integrate data systems and data management Layer 4 Data Transportation Provide a common data transport that connects all environments Layer 3 Data Network and Connectivity Connections to storage and physical access irrespective of location across entire network Layer 2 Data Physical Access Provide physical access to data on storage layer Layer 1 Data Storage and Transmission Infrastructure Store data transparently on multiple environments and move data between environments
  • 63. Building A Comprehensive Data Vision 18 February 2018 63 Comprehensive Data Vision Enterprise Data Strategy Strategy Area … Strategy Area Core Data Fabric Conceptual Model Components Component Type Component … Component … Component Type Component … Component Extended Data Fabric Conceptual Model Data Management and Operations Facility … Data Management and Operations Facility Data Lifecycle Stage … Stage Data Types Type … Type
  • 64. Extending Conceptual Model To Additional Levels Of Detail To Build A Comprehensive Data Vision • Individual data views can be combined to articulate a comprehensive data vision − Enterprise Data Strategy • Individual strategy areas − Core Data Fabric Conceptual Model Components • Individual elements within each component − Extended Data Fabric Conceptual Model • Operating principles and interactions − Data Lifecycle • Individual stages within lifecycle − Data Types • Individual data types • Builds an understanding of how the enterprise wants and needs to handle and use data 18 February 2018 64
  • 65. Extending Conceptual Model To Additional Levels Of Detail To Build A Comprehensive Data Vision 18 February 2018 65 Data Fabric Landscape Additional Data Dimensions and Views
  • 66. Summary • Data fabric is concerned with creating a data vision for the enterprise • The conceptual data fabric model represents a rich picture of the enterprise’s data context − Detailed visualisations represent information more effectively than lengthy narrative text • Use the conceptual data fabric model to identify gaps between the current and desired target • Data fabric provides a basis for understanding the enterprise’s ideal data architecture • Designing a data fabric enables the enterprise respond to and take advantage of key related data trends − Shadow IT occurs when the IT function cannot deliver IT change and new data facilities quickly − Uncontrolled data platforms and storage represent a significant and real risk to the enterprise • Enterprise data fabric should enables appropriate and seamless move to multiple cloud/XaaS platforms - public, private and hybrid - across the entire data infrastructure • Enables the enterprise focus on achieving benefits from data rather than on data operations 18 February 2018 66