SlideShare ist ein Scribd-Unternehmen logo
1 von 33
Downloaden Sie, um offline zu lesen
Role of Metadata
Why Metadata
 Before touches the keyboard by the
prominent(superlative) users.
 Several questions come to their mind.
What are various data in the data
warehouse?
Is there information about unit sale and
costs by product?
How old is the data in the warehouse.
When was the last time fresh data was
brought in?
Are there any summaries by month and
product?
Why Meta data contd.,
 These questions and several more
information are very valid and pertinent.
 What are answers? Where are the
answers? Can ur user see the answers?
How easy to get the answers?
What is Meta data?
 Metadata in a data warehouse contains
the answer to questions about the data
in the data warehouse.
 Keep the answer in a place called the
metadata repository.
Different definitions for
metadata
 Data about the data.
 Table of contents for the data.
 Catalog for the data.
 Data warehouse roadmap.
 Data warehouse directory.
 Tongs to handle the data.
 The nerve center.
So, what exactly is metadata
 It tells u more.
 It gives more than the explanation of the
semantics and the syntax.
 Describes all the pertinent(relevant)
aspect of the data in the data
warehouse.
 Pertinent to whom?
 The answer is – primarily to the user
and also developer and even project
team.
Meta data
Why it is important?
 Metadata is necessary for using,
building and administering your data
warehouse.
For using the data warehouse
 Without the metadata support, user
cannot get an information every time
they needed(user create their own ad
hoc report).
 Today data warehouses are much larger
in size, wide in scope.
 User critically need metadata.
For building the data
warehouse(extraction team)
 Need to know the structure and data
content in the data warehouse.
 Mapping and data transformations.
 Logical structure of data warehouse
database.
For administering the data
warehouse
 Impossible to administer the data
warehouse(size)
 Large no of questions and queries.
 Cannot administer without answers for
these questions.
 Metadata must address these issues.
List of questions relating to
data warehouse
Who needs metadata?
 Without metadata, Datawarehouse is
like such a filling cabinet without
information.
 Go through the image column(it address
the our question)
Metadata in data warehouse
Like a nerve center
 Metadata placed in a key position and
enables communication among various
processes.
Metadata in data warehouse
Why metadata is essential for
IT
 Development and deployment of data
warehouse is joint effort between users
and IT staff.
 Technical issue-IT primarily responsible
design and ongoing administration.
 Metadata essential for IT
 beginning with the data extraction and
ending with information delivery.
 It drives and record the each processes.
Metadata in data warehouse
Summary list of process in which
metadata is significant for IT
 Data extraction
 Data transformation
 Data scrubbing
 Data staging
 Data refreshment
 Database design
 Query report and design
Automation of DWH tasks
Types by Functional Area
 Classify and group in various way-some
by usage and who use it
 Administrative/End-user/Optimization
 Technical/Business
 Development/usage
 In the data mart/At the workstation
 Bank room/front room
 Internal/External
Functional Areas
 Data Acquisition
 Data stroage
 Information delivery
Data Acquisition
 DWH process related to following
functions.
Data extraction
Data transformation
Data cleaning
Data integration
Data staging
Data aquisition
Data stroage
 Data loading
 Data archiving
 Data management
 Use metadata in this area for full data
refresh and load.
Metadata in data warehouse
Information Delivery
 Report generating
 Query processing
 Complex analysis
Mostly this are meant for end-user.
Metadata recorded in processes of other
two areas.
It also record OLAP-the developer and
administrators are involved in this
processes.
Metadata in data warehouse
Business METADATA
 It connect business with DWH.
 Business users need more than other
users.
 Business metadata is like a roadmap.
 Tout guide-managers and analysis.
 Must describe the contents in plain
language giving information in business
teerms.
 Example
The name of data tables (or) individual
element must not be cryptic.
The data item name-calc_pr_sle.
You need to rename this as calculated-prior-
month-sale
Business metadata Contd.,
 Much less structured than technical
metadata.
 Textual documents, spreadsheets, and
even business rules and policies not
written down completely.
Examples of Business
Metadata who Benefits?
 Primarily benefits end-users.
Managers
Business analysis
Power users
Regular users
Casual users
Senior managers/ junior managers
Technical Metadata
 IT staff- Development and
Administration of the data warehouse.
 Who Benefits?
Project manager
Data warehouse administrator
Metadata manager
Database administrator
Business analyst
Data quality analyst

Weitere ähnliche Inhalte

Was ist angesagt?

OLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSEOLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSEZalpa Rathod
 
OLAP OnLine Analytical Processing
OLAP OnLine Analytical ProcessingOLAP OnLine Analytical Processing
OLAP OnLine Analytical ProcessingWalid Elbadawy
 
Data Modeling PPT
Data Modeling PPTData Modeling PPT
Data Modeling PPTTrinath
 
Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architectureuncleRhyme
 
Data Warehousing Trends, Best Practices, and Future Outlook
Data Warehousing Trends, Best Practices, and Future OutlookData Warehousing Trends, Best Practices, and Future Outlook
Data Warehousing Trends, Best Practices, and Future OutlookJames Serra
 
OLAP operations
OLAP operationsOLAP operations
OLAP operationskunj desai
 
Big Data: Its Characteristics And Architecture Capabilities
Big Data: Its Characteristics And Architecture CapabilitiesBig Data: Its Characteristics And Architecture Capabilities
Big Data: Its Characteristics And Architecture CapabilitiesAshraf Uddin
 
Introduction to Data Warehouse
Introduction to Data WarehouseIntroduction to Data Warehouse
Introduction to Data WarehouseShanthi Mukkavilli
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSINGKing Julian
 
Big data by Mithlesh sadh
Big data by Mithlesh sadhBig data by Mithlesh sadh
Big data by Mithlesh sadhMithlesh Sadh
 
Centralised and distributed databases
Centralised and distributed databasesCentralised and distributed databases
Centralised and distributed databasesForrester High School
 

Was ist angesagt? (20)

OLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSEOLAP & DATA WAREHOUSE
OLAP & DATA WAREHOUSE
 
OLAP OnLine Analytical Processing
OLAP OnLine Analytical ProcessingOLAP OnLine Analytical Processing
OLAP OnLine Analytical Processing
 
Metadata in Business Intelligence
Metadata in Business IntelligenceMetadata in Business Intelligence
Metadata in Business Intelligence
 
Metadata
MetadataMetadata
Metadata
 
Chapter 1 big data
Chapter 1 big dataChapter 1 big data
Chapter 1 big data
 
Data Modeling PPT
Data Modeling PPTData Modeling PPT
Data Modeling PPT
 
Data preprocessing
Data preprocessingData preprocessing
Data preprocessing
 
Data integration
Data integrationData integration
Data integration
 
Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architecture
 
ETL Process
ETL ProcessETL Process
ETL Process
 
Data Warehousing Trends, Best Practices, and Future Outlook
Data Warehousing Trends, Best Practices, and Future OutlookData Warehousing Trends, Best Practices, and Future Outlook
Data Warehousing Trends, Best Practices, and Future Outlook
 
OLAP operations
OLAP operationsOLAP operations
OLAP operations
 
Big Data Analytics
Big Data AnalyticsBig Data Analytics
Big Data Analytics
 
Big Data: Its Characteristics And Architecture Capabilities
Big Data: Its Characteristics And Architecture CapabilitiesBig Data: Its Characteristics And Architecture Capabilities
Big Data: Its Characteristics And Architecture Capabilities
 
Introduction to Data Warehouse
Introduction to Data WarehouseIntroduction to Data Warehouse
Introduction to Data Warehouse
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 
Big data by Mithlesh sadh
Big data by Mithlesh sadhBig data by Mithlesh sadh
Big data by Mithlesh sadh
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Fraud and Risk in Big Data
Fraud and Risk in Big DataFraud and Risk in Big Data
Fraud and Risk in Big Data
 
Centralised and distributed databases
Centralised and distributed databasesCentralised and distributed databases
Centralised and distributed databases
 

Ähnlich wie Metadata in data warehouse

Dataware housing
Dataware housingDataware housing
Dataware housingwork
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptDougSchoemaker
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptSumathiG8
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptPalaniKumarR2
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingwork
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingsumit621
 
Optimization Of Existing Data Warehouse Using Hadoop Essay
Optimization Of Existing Data Warehouse Using Hadoop EssayOptimization Of Existing Data Warehouse Using Hadoop Essay
Optimization Of Existing Data Warehouse Using Hadoop EssayAmelia Richardson
 
The Development Of Data Warehouse Essay
The Development Of Data Warehouse EssayThe Development Of Data Warehouse Essay
The Development Of Data Warehouse EssayKaren Gilchrist
 
Report for internship
Report for internshipReport for internship
Report for internshipSalman Khan
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptSamPrem3
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingJason S
 
Data warehouse
Data warehouseData warehouse
Data warehouseMR Z
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSSDeepali Raut
 
Data Warehousing And Data Mining
Data Warehousing And Data MiningData Warehousing And Data Mining
Data Warehousing And Data MiningMichelle Anderson
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
Data warehousing
Data warehousingData warehousing
Data warehousingkeeyre
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Health Informatics New Zealand
 

Ähnlich wie Metadata in data warehouse (20)

Dataware housing
Dataware housingDataware housing
Dataware housing
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
E05WAREH1.PPT
E05WAREH1.PPTE05WAREH1.PPT
E05WAREH1.PPT
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
Optimization Of Existing Data Warehouse Using Hadoop Essay
Optimization Of Existing Data Warehouse Using Hadoop EssayOptimization Of Existing Data Warehouse Using Hadoop Essay
Optimization Of Existing Data Warehouse Using Hadoop Essay
 
The Development Of Data Warehouse Essay
The Development Of Data Warehouse EssayThe Development Of Data Warehouse Essay
The Development Of Data Warehouse Essay
 
Report for internship
Report for internshipReport for internship
Report for internship
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Presentation
PresentationPresentation
Presentation
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
 
Data Warehousing And Data Mining
Data Warehousing And Data MiningData Warehousing And Data Mining
Data Warehousing And Data Mining
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...
 

Mehr von Siddique Ibrahim (20)

List in Python
List in PythonList in Python
List in Python
 
Python Control structures
Python Control structuresPython Control structures
Python Control structures
 
Python programming introduction
Python programming introductionPython programming introduction
Python programming introduction
 
Data mining basic fundamentals
Data mining basic fundamentalsData mining basic fundamentals
Data mining basic fundamentals
 
Basic networking
Basic networkingBasic networking
Basic networking
 
Virtualization Concepts
Virtualization ConceptsVirtualization Concepts
Virtualization Concepts
 
Networking devices(siddique)
Networking devices(siddique)Networking devices(siddique)
Networking devices(siddique)
 
Osi model 7 Layers
Osi model 7 LayersOsi model 7 Layers
Osi model 7 Layers
 
Mysql grand
Mysql grandMysql grand
Mysql grand
 
Getting started into mySQL
Getting started into mySQLGetting started into mySQL
Getting started into mySQL
 
pipelining
pipeliningpipelining
pipelining
 
Micro programmed control
Micro programmed controlMicro programmed control
Micro programmed control
 
Hardwired control
Hardwired controlHardwired control
Hardwired control
 
interface
interfaceinterface
interface
 
Interrupt
InterruptInterrupt
Interrupt
 
Interrupt
InterruptInterrupt
Interrupt
 
DMA
DMADMA
DMA
 
Io devies
Io deviesIo devies
Io devies
 
Stack & queue
Stack & queueStack & queue
Stack & queue
 
Data extraction, transformation, and loading
Data extraction, transformation, and loadingData extraction, transformation, and loading
Data extraction, transformation, and loading
 

Kürzlich hochgeladen

Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 

Kürzlich hochgeladen (20)

Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 

Metadata in data warehouse

  • 2. Why Metadata  Before touches the keyboard by the prominent(superlative) users.  Several questions come to their mind. What are various data in the data warehouse? Is there information about unit sale and costs by product? How old is the data in the warehouse. When was the last time fresh data was brought in? Are there any summaries by month and product?
  • 3. Why Meta data contd.,  These questions and several more information are very valid and pertinent.  What are answers? Where are the answers? Can ur user see the answers? How easy to get the answers?
  • 4. What is Meta data?  Metadata in a data warehouse contains the answer to questions about the data in the data warehouse.  Keep the answer in a place called the metadata repository.
  • 5. Different definitions for metadata  Data about the data.  Table of contents for the data.  Catalog for the data.  Data warehouse roadmap.  Data warehouse directory.  Tongs to handle the data.  The nerve center.
  • 6. So, what exactly is metadata  It tells u more.  It gives more than the explanation of the semantics and the syntax.  Describes all the pertinent(relevant) aspect of the data in the data warehouse.  Pertinent to whom?  The answer is – primarily to the user and also developer and even project team.
  • 8. Why it is important?  Metadata is necessary for using, building and administering your data warehouse.
  • 9. For using the data warehouse  Without the metadata support, user cannot get an information every time they needed(user create their own ad hoc report).  Today data warehouses are much larger in size, wide in scope.  User critically need metadata.
  • 10. For building the data warehouse(extraction team)  Need to know the structure and data content in the data warehouse.  Mapping and data transformations.  Logical structure of data warehouse database.
  • 11. For administering the data warehouse  Impossible to administer the data warehouse(size)  Large no of questions and queries.  Cannot administer without answers for these questions.  Metadata must address these issues.
  • 12. List of questions relating to data warehouse
  • 13. Who needs metadata?  Without metadata, Datawarehouse is like such a filling cabinet without information.  Go through the image column(it address the our question)
  • 15. Like a nerve center  Metadata placed in a key position and enables communication among various processes.
  • 17. Why metadata is essential for IT  Development and deployment of data warehouse is joint effort between users and IT staff.  Technical issue-IT primarily responsible design and ongoing administration.  Metadata essential for IT  beginning with the data extraction and ending with information delivery.  It drives and record the each processes.
  • 19. Summary list of process in which metadata is significant for IT  Data extraction  Data transformation  Data scrubbing  Data staging  Data refreshment  Database design  Query report and design
  • 21. Types by Functional Area  Classify and group in various way-some by usage and who use it  Administrative/End-user/Optimization  Technical/Business  Development/usage  In the data mart/At the workstation  Bank room/front room  Internal/External
  • 22. Functional Areas  Data Acquisition  Data stroage  Information delivery
  • 23. Data Acquisition  DWH process related to following functions. Data extraction Data transformation Data cleaning Data integration Data staging
  • 25. Data stroage  Data loading  Data archiving  Data management  Use metadata in this area for full data refresh and load.
  • 27. Information Delivery  Report generating  Query processing  Complex analysis Mostly this are meant for end-user. Metadata recorded in processes of other two areas. It also record OLAP-the developer and administrators are involved in this processes.
  • 29. Business METADATA  It connect business with DWH.  Business users need more than other users.  Business metadata is like a roadmap.  Tout guide-managers and analysis.
  • 30.  Must describe the contents in plain language giving information in business teerms.  Example The name of data tables (or) individual element must not be cryptic. The data item name-calc_pr_sle. You need to rename this as calculated-prior- month-sale
  • 31. Business metadata Contd.,  Much less structured than technical metadata.  Textual documents, spreadsheets, and even business rules and policies not written down completely.
  • 32. Examples of Business Metadata who Benefits?  Primarily benefits end-users. Managers Business analysis Power users Regular users Casual users Senior managers/ junior managers
  • 33. Technical Metadata  IT staff- Development and Administration of the data warehouse.  Who Benefits? Project manager Data warehouse administrator Metadata manager Database administrator Business analyst Data quality analyst