SlideShare ist ein Scribd-Unternehmen logo

A Data-Driven Question Generation Model for Educational Content - by Jack Wang

•
•
Yan Xu
Yan Xu

Deep learning workshop at Houston machine learning meetup. Video at: https://youtu.be/8fmcn7ull8M?t=3

Wissenschaft
1 von 101
Downloaden Sie, um offline zu lesen
QG-Net: Data-Driven Question Generation Model for Educational Content Jack Wang June 25, 2018
[ J. D. Karpicke et. al., 2012 ] [ R. J. Hift. 2014 ] [ D. Rohrer et. al., 2010 ]
?
Input text QG-Net
… one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
… one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
… one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question
… one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question ✓ Fluent ✓ relevant
Input text QG-Net Generated question ✓ Generates fluent and relevant questions
Input text QG-Net Generated question ✓ Generates fluent and relevant questions
Input text QG-Net Generated question ✓ Generates fluent and relevant questions
Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
QG-Net
QG-Net
QG-Net Reader
QG-Net Reader Generator
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation 1. D. Bahdanau et. al., 2014 2. A. See et. al., 2017 1 2
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism ✓ Fluent and relevant questions ✓ Adaptive to texts from various subjects 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, …
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American What is Tesla’s nationality?
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD ○ Compared to 2 of the best existing models (baseline11, baseline 22) 1. M. Heilman, 2010 2. X. Du et. al., 2017
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people’s reactions to inequality were moderated by class differences and rates of social mobility, ...
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ...
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale? Chapter 12.1 Chapter 1.3
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson.
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? QG-Net: ✓ Generates fluent and relevant questions ✓ Is adaptive to text from various subjects
Human evaluation experiment ● We sample 150 sentences from each textbook ● We use the three models to generate questions ● Human evaluators evaluate the quality of generated questions ○ Fluency ○ relevance ● Human evaluators pick which question(s) could have been generated by human ○ Can choose none of them
Human evaluation results Baseline 1 Baseline 2 OS = OpenStax
Human evaluation results Baseline 1 Baseline 2
Human evaluation results Baseline 1 Baseline 2 QG-Net: ✓ Generates superior questions in terms of both fluency and relevance ✓ Works well for inputs from various subjects
Human evaluation results Baseline 1 Baseline 2
Human evaluation results Baseline 1 Baseline 2 Perceptually, QG-Net generates questions of superior quality than those generated by baseline models.
Input text QG-Net Generated question
Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
Or
Acknowledgements Rich Baraniuk Andrew Lan Phil Grimaldi Drew Waters Weili Nie John and Ann Doerr Arthur & Carlyse Ciocca Charitable Foundation
Questions? QG-Net is on Github! https://github.com/moonlightlane/QG-Net jzwang@rice.edu Input text QG-Net Generated question
Appendix
Appendix
Appendix

Empfohlen

Shared Rationales in Group Activities
Shared Rationales in Group ActivitiesShared Rationales in Group Activities
Shared Rationales in Group ActivitiesLu Xiao
 
Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Jindra Cekan, PhD
 
Encouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetEncouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetSean Munson
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010guest1d1e7b
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010Marc Maxson / GlobalGiving
 
Drupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityDrupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityAll Things Open
 
Cls8 decarbonet
Cls8 decarbonetCls8 decarbonet
Cls8 decarbonetDiana Maynard
 
People's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksPeople's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksMSL
 

Empfohlen

Shared Rationales in Group Activities
Shared Rationales in Group ActivitiesShared Rationales in Group Activities
Shared Rationales in Group ActivitiesLu Xiao
 
Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Jindra Cekan, PhD
 
Encouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetEncouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetSean Munson
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010guest1d1e7b
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010Marc Maxson / GlobalGiving
 
Drupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityDrupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityAll Things Open
 
Cls8 decarbonet
Cls8 decarbonetCls8 decarbonet
Cls8 decarbonetDiana Maynard
 
People's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksPeople's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksMSL
 
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020Shuman Ip
 
Are online communities the way forward?
Are online communities the way forward?Are online communities the way forward?
Are online communities the way forward?Questback UK
 
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISUSER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISRuth Garcia Gavilanes
 
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...Sustainable Brands
 
Policy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPolicy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPatricia Curmi
 
487816 959(1)
487816 959(1)487816 959(1)
487816 959(1)behrooz Kazemi
 
M&E workshop for riversee
M&E workshop for riverseeM&E workshop for riversee
M&E workshop for riverseeproMENTE social research
 
GlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCGlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCMarc Maxson / GlobalGiving
 
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSParagraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSDarian Pruitt
 
ProfessionalProjectProposal
ProfessionalProjectProposalProfessionalProjectProposal
ProfessionalProjectProposalPeggy Strickling
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz Group
 
Online Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarOnline Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarAliakbar Akbaritabar
 
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERA NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERIRJET Journal
 
Msu College Application Essay Questions
Msu College Application Essay QuestionsMsu College Application Essay Questions
Msu College Application Essay QuestionsCarolyn Smith
 
Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...IIIT Hyderabad
 
The State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USThe State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USmysociety
 
Digital Workplace Trends and Transformation
Digital Workplace Trends and TransformationDigital Workplace Trends and Transformation
Digital Workplace Trends and TransformationJane McConnell
 
Emerging power of big data 2014
Emerging power of big data 2014Emerging power of big data 2014
Emerging power of big data 2014haramaya university
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...John Mauremootoo
 
Vera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptVera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptSara Vera
 
Kaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingKaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingYan Xu
 
Basics of Dynamic programming
Basics of Dynamic programming Basics of Dynamic programming
Basics of Dynamic programming Yan Xu
 

Weitere ähnliche Inhalte

Ähnlich wie A Data-Driven Question Generation Model for Educational Content - by Jack Wang

AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020Shuman Ip
 
Are online communities the way forward?
Are online communities the way forward?Are online communities the way forward?
Are online communities the way forward?Questback UK
 
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISUSER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISRuth Garcia Gavilanes
 
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...Sustainable Brands
 
Policy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPolicy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPatricia Curmi
 
GlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCGlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCMarc Maxson / GlobalGiving
 
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSParagraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSDarian Pruitt
 
ProfessionalProjectProposal
ProfessionalProjectProposalProfessionalProjectProposal
ProfessionalProjectProposalPeggy Strickling
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz Group
 
Online Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarOnline Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarAliakbar Akbaritabar
 
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERA NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERIRJET Journal
 
Msu College Application Essay Questions
Msu College Application Essay QuestionsMsu College Application Essay Questions
Msu College Application Essay QuestionsCarolyn Smith
 
Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...IIIT Hyderabad
 
The State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USThe State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USmysociety
 
Digital Workplace Trends and Transformation
Digital Workplace Trends and TransformationDigital Workplace Trends and Transformation
Digital Workplace Trends and TransformationJane McConnell
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...John Mauremootoo
 
Vera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptVera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptSara Vera
 

Ähnlich wie A Data-Driven Question Generation Model for Educational Content - by Jack Wang (20)

AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
 
Are online communities the way forward?
Are online communities the way forward?Are online communities the way forward?
Are online communities the way forward?
 
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISUSER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
 
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
 
Policy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPolicy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for money
 
487816 959(1)
487816 959(1)487816 959(1)
487816 959(1)
 
M&E workshop for riversee
M&E workshop for riverseeM&E workshop for riversee
M&E workshop for riversee
 
GlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCGlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRC
 
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSParagraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
 
ProfessionalProjectProposal
ProfessionalProjectProposalProfessionalProjectProposal
ProfessionalProjectProposal
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems Change
 
Online Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarOnline Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabar
 
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERA NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
 
Msu College Application Essay Questions
Msu College Application Essay QuestionsMsu College Application Essay Questions
Msu College Application Essay Questions
 
Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...
 
The State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USThe State of Civic Tech Impact in the US
The State of Civic Tech Impact in the US
 
Digital Workplace Trends and Transformation
Digital Workplace Trends and TransformationDigital Workplace Trends and Transformation
Digital Workplace Trends and Transformation
 
Emerging power of big data 2014
Emerging power of big data 2014Emerging power of big data 2014
Emerging power of big data 2014
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
 
Vera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptVera Data 2.0 Slides and Script
Vera Data 2.0 Slides and Script
 

Mehr von Yan Xu

Kaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingKaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingYan Xu
 
Basics of Dynamic programming
Basics of Dynamic programming Basics of Dynamic programming
Basics of Dynamic programming Yan Xu
 
Walking through Tensorflow 2.0
Walking through Tensorflow 2.0Walking through Tensorflow 2.0
Walking through Tensorflow 2.0Yan Xu
 
Practical contextual bandits for business
Practical contextual bandits for businessPractical contextual bandits for business
Practical contextual bandits for businessYan Xu
 
Introduction to Multi-armed Bandits
Introduction to Multi-armed BanditsIntroduction to Multi-armed Bandits
Introduction to Multi-armed BanditsYan Xu
 
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...Yan Xu
 
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...Yan Xu
 
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...Yan Xu
 
Introduction to Autoencoders
Introduction to AutoencodersIntroduction to Autoencoders
Introduction to AutoencodersYan Xu
 
State of enterprise data science
State of enterprise data scienceState of enterprise data science
State of enterprise data scienceYan Xu
 
Long Short Term Memory
Long Short Term MemoryLong Short Term Memory
Long Short Term MemoryYan Xu
 
Deep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and RegularizationDeep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and RegularizationYan Xu
 
Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)Yan Xu
 
HML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep LearningHML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep LearningYan Xu
 
Secrets behind AlphaGo
Secrets behind AlphaGoSecrets behind AlphaGo
Secrets behind AlphaGoYan Xu
 
Optimization in Deep Learning
Optimization in Deep LearningOptimization in Deep Learning
Optimization in Deep LearningYan Xu
 
Introduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkIntroduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkYan Xu
 
Convolutional neural network
Convolutional neural network Convolutional neural network
Convolutional neural network Yan Xu
 
Introduction to Neural Network
Introduction to Neural NetworkIntroduction to Neural Network
Introduction to Neural NetworkYan Xu
 
Nonlinear dimension reduction
Nonlinear dimension reductionNonlinear dimension reduction
Nonlinear dimension reductionYan Xu
 

Mehr von Yan Xu (20)

Kaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingKaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales Forecasting
 
Basics of Dynamic programming
Basics of Dynamic programming Basics of Dynamic programming
Basics of Dynamic programming
 
Walking through Tensorflow 2.0
Walking through Tensorflow 2.0Walking through Tensorflow 2.0
Walking through Tensorflow 2.0
 
Practical contextual bandits for business
Practical contextual bandits for businessPractical contextual bandits for business
Practical contextual bandits for business
 
Introduction to Multi-armed Bandits
Introduction to Multi-armed BanditsIntroduction to Multi-armed Bandits
Introduction to Multi-armed Bandits
 
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
 
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
 
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
 
Introduction to Autoencoders
Introduction to AutoencodersIntroduction to Autoencoders
Introduction to Autoencoders
 
State of enterprise data science
State of enterprise data scienceState of enterprise data science
State of enterprise data science
 
Long Short Term Memory
Long Short Term MemoryLong Short Term Memory
Long Short Term Memory
 
Deep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and RegularizationDeep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and Regularization
 
Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)
 
HML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep LearningHML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep Learning
 
Secrets behind AlphaGo
Secrets behind AlphaGoSecrets behind AlphaGo
Secrets behind AlphaGo
 
Optimization in Deep Learning
Optimization in Deep LearningOptimization in Deep Learning
Optimization in Deep Learning
 
Introduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkIntroduction to Recurrent Neural Network
Introduction to Recurrent Neural Network
 
Convolutional neural network
Convolutional neural network Convolutional neural network
Convolutional neural network
 
Introduction to Neural Network
Introduction to Neural NetworkIntroduction to Neural Network
Introduction to Neural Network
 
Nonlinear dimension reduction
Nonlinear dimension reductionNonlinear dimension reduction
Nonlinear dimension reduction
 

Kürzlich hochgeladen

GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxGENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxRitchAndruAgustin
 
Observational constraints on mergers creating magnetism in massive stars
Observational constraints on mergers creating magnetism in massive starsObservational constraints on mergers creating magnetism in massive stars
Observational constraints on mergers creating magnetism in massive starsSérgio Sacani
 
Oxo-Acids of Halogens and their Salts.pptx
Oxo-Acids of Halogens and their Salts.pptxOxo-Acids of Halogens and their Salts.pptx
Oxo-Acids of Halogens and their Salts.pptxfarhanvvdk
 
linear Regression, multiple Regression and Annova
linear Regression, multiple Regression and Annovalinear Regression, multiple Regression and Annova
linear Regression, multiple Regression and AnnovaMansi Rastogi
 
The Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and FunctionThe Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and FunctionJadeNovelo1
 
WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11
WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11
WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11GelineAvendao
 
Unveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s PotentialUnveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s PotentialMarkus Roggen
 
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPRPirithiRaju
 
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxEnvironmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxpriyankatabhane
 
6.2 Pests of Sesame_Identification_Binomics_Dr.UPR
6.2 Pests of Sesame_Identification_Binomics_Dr.UPR6.2 Pests of Sesame_Identification_Binomics_Dr.UPR
6.2 Pests of Sesame_Identification_Binomics_Dr.UPRPirithiRaju
 
cybrids.pptx production_advanges_limitation
cybrids.pptx production_advanges_limitationcybrids.pptx production_advanges_limitation
cybrids.pptx production_advanges_limitationSanghamitraMohapatra5
 
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests GlycosidesGLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests GlycosidesNandakishor Bhaurao Deshmukh
 
FBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptxFBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptxPayal Shrivastava
 
GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024Jene van der Heide
 
Pests of Sunflower_Binomics_Identification_Dr.UPR
Pests of Sunflower_Binomics_Identification_Dr.UPRPests of Sunflower_Binomics_Identification_Dr.UPR
Pests of Sunflower_Binomics_Identification_Dr.UPRPirithiRaju
 
Environmental acoustics- noise criteria.pptx
Environmental acoustics- noise criteria.pptxEnvironmental acoustics- noise criteria.pptx
Environmental acoustics- noise criteria.pptxpriyankatabhane
 
CHROMATOGRAPHY PALLAVI RAWAT.pptx
CHROMATOGRAPHY PALLAVI RAWAT.pptxCHROMATOGRAPHY PALLAVI RAWAT.pptx
CHROMATOGRAPHY PALLAVI RAWAT.pptxpallavirawat456
 

Kürzlich hochgeladen (20)

GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxGENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx
 
Observational constraints on mergers creating magnetism in massive stars
Observational constraints on mergers creating magnetism in massive starsObservational constraints on mergers creating magnetism in massive stars
Observational constraints on mergers creating magnetism in massive stars
 
Oxo-Acids of Halogens and their Salts.pptx
Oxo-Acids of Halogens and their Salts.pptxOxo-Acids of Halogens and their Salts.pptx
Oxo-Acids of Halogens and their Salts.pptx
 
linear Regression, multiple Regression and Annova
linear Regression, multiple Regression and Annovalinear Regression, multiple Regression and Annova
linear Regression, multiple Regression and Annova
 
The Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and FunctionThe Sensory Organs, Anatomy and Function
The Sensory Organs, Anatomy and Function
 
PLASMODIUM. PPTX
PLASMODIUM. PPTXPLASMODIUM. PPTX
PLASMODIUM. PPTX
 
WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11
WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11
WEEK 4 PHYSICAL SCIENCE QUARTER 3 FOR G11
 
Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?Let’s Say Someone Did Drop the Bomb. Then What?
Let’s Say Someone Did Drop the Bomb. Then What?
 
Unveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s PotentialUnveiling the Cannabis Plant’s Potential
Unveiling the Cannabis Plant’s Potential
 
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
 
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxEnvironmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
 
6.2 Pests of Sesame_Identification_Binomics_Dr.UPR
6.2 Pests of Sesame_Identification_Binomics_Dr.UPR6.2 Pests of Sesame_Identification_Binomics_Dr.UPR
6.2 Pests of Sesame_Identification_Binomics_Dr.UPR
 
cybrids.pptx production_advanges_limitation
cybrids.pptx production_advanges_limitationcybrids.pptx production_advanges_limitation
cybrids.pptx production_advanges_limitation
 
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests GlycosidesGLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
GLYCOSIDES Classification Of GLYCOSIDES Chemical Tests Glycosides
 
Introduction Classification Of Alkaloids
Introduction Classification Of AlkaloidsIntroduction Classification Of Alkaloids
Introduction Classification Of Alkaloids
 
FBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptxFBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptx
 
GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024GenAI talk for Young at Wageningen University & Research (WUR) March 2024
GenAI talk for Young at Wageningen University & Research (WUR) March 2024
 
Pests of Sunflower_Binomics_Identification_Dr.UPR
Pests of Sunflower_Binomics_Identification_Dr.UPRPests of Sunflower_Binomics_Identification_Dr.UPR
Pests of Sunflower_Binomics_Identification_Dr.UPR
 
Environmental acoustics- noise criteria.pptx
Environmental acoustics- noise criteria.pptxEnvironmental acoustics- noise criteria.pptx
Environmental acoustics- noise criteria.pptx
 
CHROMATOGRAPHY PALLAVI RAWAT.pptx
CHROMATOGRAPHY PALLAVI RAWAT.pptxCHROMATOGRAPHY PALLAVI RAWAT.pptx
CHROMATOGRAPHY PALLAVI RAWAT.pptx
 

A Data-Driven Question Generation Model for Educational Content - by Jack Wang

  • 1. QG-Net: Data-Driven Question Generation Model for Educational Content Jack Wang June 25, 2018
  • 2.
  • 3.
  • 4.
  • 5.
  • 6. [ J. D. Karpicke et. al., 2012 ] [ R. J. Hift. 2014 ] [ D. Rohrer et. al., 2010 ]
  • 7.
  • 8.
  • 9. ?
  • 10.
  • 11.
  • 12.
  • 14. … one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
  • 15. … one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
  • 16. … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question
  • 17. … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question ✓ Fluent ✓ relevant
  • 18. Input text QG-Net Generated question ✓ Generates fluent and relevant questions
  • 19. Input text QG-Net Generated question ✓ Generates fluent and relevant questions
  • 20. Input text QG-Net Generated question ✓ Generates fluent and relevant questions
  • 21. Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
  • 26. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 27. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 28. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 29. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 30. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 31. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 32. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 33. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 34. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 35. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 36. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 37. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 38. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 39. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 40. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 41. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 42. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 43. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 44. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 45. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 46. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 47. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 48. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 49. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 50. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 51. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 52. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 53. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 54. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 55. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation 1. D. Bahdanau et. al., 2014 2. A. See et. al., 2017 1 2
  • 56. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism ✓ Fluent and relevant questions ✓ Adaptive to texts from various subjects 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 57. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD
  • 58. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, …
  • 59. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American
  • 60. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American What is Tesla’s nationality?
  • 61. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 62. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 63. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 64. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 65. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD
  • 66. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD ○ Compared to 2 of the best existing models (baseline11, baseline 22) 1. M. Heilman, 2010 2. X. Du et. al., 2017
  • 67. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people’s reactions to inequality were moderated by class differences and rates of social mobility, ...
  • 68. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ...
  • 69. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by?
  • 70. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
  • 71. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
  • 72. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
  • 73. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
  • 74. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
  • 75. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale? Chapter 12.1 Chapter 1.3
  • 76. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson.
  • 77. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
  • 78. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
  • 79. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Chapter 10.4
  • 80. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
  • 81. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
  • 82. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
  • 83. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
  • 84. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? QG-Net: ✓ Generates fluent and relevant questions ✓ Is adaptive to text from various subjects
  • 85. Human evaluation experiment ● We sample 150 sentences from each textbook ● We use the three models to generate questions ● Human evaluators evaluate the quality of generated questions ○ Fluency ○ relevance ● Human evaluators pick which question(s) could have been generated by human ○ Can choose none of them
  • 86. Human evaluation results Baseline 1 Baseline 2 OS = OpenStax
  • 88. Human evaluation results Baseline 1 Baseline 2 QG-Net: ✓ Generates superior questions in terms of both fluency and relevance ✓ Works well for inputs from various subjects
  • 90. Human evaluation results Baseline 1 Baseline 2 Perceptually, QG-Net generates questions of superior quality than those generated by baseline models.
  • 92. Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
  • 93.
  • 94.
  • 95.
  • 96. Or
  • 97. Acknowledgements Rich Baraniuk Andrew Lan Phil Grimaldi Drew Waters Weili Nie John and Ann Doerr Arthur & Carlyse Ciocca Charitable Foundation
  • 98. Questions? QG-Net is on Github! https://github.com/moonlightlane/QG-Net jzwang@rice.edu Input text QG-Net Generated question