SlideShare ist ein Scribd-Unternehmen logo
1 von 135
Downloaden Sie, um offline zu lesen
Deepak Khemani Conceptual Dependency Theory 1
Knowledge Representation
Conceptual Dependency
Based on the work done by Roger Schank
and his group at Yale University in the
1970s.
Deepak Khemani
Department of Computer Science & Engineering
IIT Madras
Deepak Khemani Conceptual Dependency Theory 2
Perception / Understanding
Making sense of some inputs.
Natural Language Understanding
Speech Understanding
Image Understanding
Understanding is like parsing.
Thesis : Understanding has a strong top down component.
It involves concept driven mapping into preconceived
notions, rather than data driven bottom up approach.
Deepak Khemani Conceptual Dependency Theory 3
A short story
John meets Fred on the road. Fred has a knife. John is angry because
his wife Mary has yelled at him…
Fred : Hi
John : What are you doing with the knife?
Fred : Thought I'd teach the kids to play mumbly-peg.
John : I could use a knife right now.
Fred : What's the matter?
John : Damn Mary, always on my back. She'll be sorry.
Fred : I don't think a knife will help you.
John : You're just on her side. I think I ought to . . .
From "Identification of Conceptualizations
underlying Natural Language" – Roger Schank
… at this point the listener has some expectations
Deepak Khemani Conceptual Dependency Theory 4
Expectations
Syntax a verb
Meaning a "conceptual structure" type and a filler for it
Context the conceptual structure predicts an "action".
Context delimits the range of possible actions,
for example end relationship
hurt someone
go to some place
emote
Conversational people talk for a reason. To arouse sympathy, or to
inform about intent, etcetra…
World view of listener
If John is known to be a convicted murderer the
expectation would be different from if he were
known to be an avowed pacifist.
Cultural norm what is accepted within a culture
What kind of knowledge structures in memory
would generate such expectations?
Deepak Khemani Conceptual Dependency Theory 5
A short story
John meets Fred on the road. Fred has a knife. John is angry because
his wife Mary has yelled at him…
Fred : Hi
John : What are you doing with the knife?
Fred : Thought I'd teach the kids to play mumbly-peg.
John : I could use a knife right now.
Fred : What's the matter?
John : Damn Mary, always on my back. She'll be sorry.
Fred : I don't think a knife will help you.
John : You're just on her side. I think I ought to . . .
One would be considerably surprised to hear
“I think I ought to go and eat some fish"
Jokes exploit such
violation of expectation.
Deepak Khemani Conceptual Dependency Theory 6
Courtesy: Richard Gregory
Vision..
Deepak Khemani Conceptual Dependency Theory 7
Deepak Khemani Conceptual Dependency Theory 8
Deepak Khemani Conceptual Dependency Theory 9
Conceptual Dependency Theory
• The CD theory defines a semantic base for knowledge representation.
• The objective was to understand natural language stories.
• The CD theory is designed for everyday actions.
• More specific domains would require a specific set of primitives.
Basic unit à CONCEPTUALIZATION
something like a Well Formed Formula
Main component à EVENT defined by an ACTOR
an ACTION
an OBJECT
a sense of DIRECTION
Deepak Khemani Conceptual Dependency Theory 10
Concepts
Conceptualization
Concepts + Relations
nominals
picture producers (PP)
actions
actions (ACT)
modifiers
action aiders (AA)
picture aiders (PA)
Inherently governing categories Inherently dependent categories
Deepak Khemani Conceptual Dependency Theory 11
Conceptualizations
• Nominals and actions can exist as independent notions.
– Nominals stand for objects and people.
– Actions are acts of nominals.
• Modifiers give additional information on the nominals or actions.
• A dependent concept predicts the existence of a governer.
• A conceptualization is a collection of concepts and relations in which
there is at least a two way dependency.
• A conceptualization tells you something about the world.
• Conceptual Dependency theory defines the set of actions that can be
done by people.
• Can be described in a logic like syntax
– For example in “Artificial Intelligence”, by Charniak and McDermott.
• Can be depicted graphically by C-diagrams.
Deepak Khemani Conceptual Dependency Theory 12
Example 1.
John hit his little dog.
PP – Can be
understood by
itself.
Act –
Conceptually an
action.
PP – a governor.
Related to act hit as
object of action. Is
dependent on hit :
cannot be
understood in the
conceptualization
without it.
Objective dependency.
A two way dependency
between the two concepts.
The core of the
conceptualization.
John hit dog
Deepak Khemani Conceptual Dependency Theory 13
Example 1 (continued)
John hit his little dog.
A PA dependent on the dog.
Attributive Dependency.
little
A little more complex - “his” is
dependent on “dog”. But it is
also a linguistic item – pronoun
– for “John”. One PP as
dependent on another PP :
Prepositional Dependency.
Label indicates type of
dependency.
Poss-by
John hit dog
John
Deepak Khemani Conceptual Dependency Theory 14
Time
Deepak Khemani Conceptual Dependency Theory 15
Conceptual Dependencies
1. PP ACT Certain PPs can ACT
2. PP PA PPs (and some Conceptualizations)
can be described by an attrtibute.
3. ACT PP ACTs have objects.
4. ACTs have direction.
D
LOC
LOC
ACT
5. ACTs have recipients..
R
PP
PP
ACT
6. ACT MTRANS requires conceptualizations
as objects, and MBUILD has its own
object type.
Deepak Khemani Conceptual Dependency Theory 16
Conceptual Dependencies
PP ACT
PP PA
ACT PP
D
LOC
LOC
ACT
R
PP
PP
ACT
ACT
Deepak Khemani Conceptual Dependency Theory 17
Conceptual Dependencies
8. PPs can be described by the conceptualizations
in which they occur.
PP
PP
9. Conceptualizations have times.
T
LOC
10. Conceptualizations have locations.
7. ACT ACTs have conceptualizations as instruments.
I
Deepak Khemani Conceptual Dependency Theory 18
Conceptual Dependencies
PP
PP
T LOC
ACT I
Deepak Khemani Conceptual Dependency Theory 19
Conceptual Dependencies
11. Conceptualizations can result in state changes for PPs.
r
12. Conceptualizations involving mental ACTs can server as
reasons for conceptualizations.
R
13. State or state changes can enable
conceptualizations to occur.
E
E
14. PP PP One PP is equivalent to or an instance of
another PP.
15. ACTs can be varied along certain dimensions
(e.g. speed for motions ACTS).
ACT
AA
Deepak Khemani Conceptual Dependency Theory 20
Conceptual Dependencies
r
R
E
E
PP PP
ACT
AA
huge
Rashmi ate Hot dog
Rashmi watch Movie
scary indefinite
definite
Deepak Khemani Conceptual Dependency Theory 21
Conceptual Dependencies
big
Piyush read book
Piyush
tf
yesterday
Deepak Khemani Conceptual Dependency Theory 22
State Variables
HEALTH: goes from –10 to +10
Examples: dead -10
gravely ill -9
sick -9 to -1
under the weather -2
all right 0
tip top +7
perfect health +10
PHYSICAL STATE: goes from -10 to +10
Examples: dead -10
harmed -9
injured -5
broken (for objects) -5
harmed -1 to -7
hurt -1 to -7
OK 10
Deepak Khemani Conceptual Dependency Theory 23
State Variables
ANGER : goes from -10 to 0
Examples: furious -9
enraged -8
angry -5
irked -3
upset -2
calm 0
MENTAL STATE: goes from -10 to +10.
Examples: catatonic -9
(same as JOY in MARGIE) depressed -5
upset -3
sad -2
OK 0
pleased +2
happy +5
ecstatic +10
Deepak Khemani Conceptual Dependency Theory 24
State Variables
CONSCIOUSNESS: goes from 0 to +10
Examples: unconscious 0
asleep 5
awake 10
“higher drug
consciousness” > 10
FEAR : goes from -10 to 0
Examples: terrified -9
scared -5
anxious -2
calm 0
SURPRISE : goes from 0 to 10
Examples: surprised 5
amazed 7
astounded 9
Deepak Khemani Conceptual Dependency Theory 25
State Variables
HUNGER: goes from -10 to +10.
Examples: Starving -8
ravenous -6
“could eat a horse” -5
hungry -3
no appetite 0
satisfied 3
full 5
stuffed 8
satiated 3 - 10
DISGUST : goes from -10 to 0
Examples: nauseated -8
revolted -7
disgusted -6
bothered -2
Deepak Khemani Conceptual Dependency Theory 26
Compound states
• shocked = SURPRISE (6)
DISGUST (-5)
• calm/cool = SURPRISE (0)
DISGUST (0)
FEAR (0)
ANGER (0)
CONSCIOUSNESS (>0)
Deepak Khemani Conceptual Dependency Theory 27
Margie : Inference mode
INPUT : John told Mary that Bill wants a book.
OUTPUT 1 : A book about what?
OUTPUT 2 : Mary knows that Bill wants a book.
OUTPUT 3 : Bill wants to come to have a book.
OUTPUT 4 : Bill wants someone to cease to have a book.
OUTPUT 5 : Bill wants to read a book.
INPUT : John gave Mary a beating with a stick.
OUTPUT 1 : A stick touched Mary.
OUTPUT 2 : Mary became hurt.
OUTPUT 3 : John wanted Mary to become hurt.
OUTPUT 4 : Why was John angry?
Deepak Khemani Conceptual Dependency Theory 28
Margie : Inference mode
INPUT : John gave Mary an aspirin.
OUTPUT 1 : John believes that Mary wants an aspirin.
OUTPUT 2 : Mary is sick.
OUTPUT 3 : Mary wants to feel better.
OUTPUT 4 : Mary will ingest the aspirin.
INPUT : John is going to go to the store.
OUTPUT 1 : John wants to be at the store.
OUTPUT 2 : What does John want to buy?
OUTPUT 3 : John will trade money to the store for something.
Deepak Khemani Conceptual Dependency Theory 29
Margie : Paraphrase mode
INPUT : John advised Mary to drink the wine.
OUTPUT : John told Mary that drinking the wine would
benefit her.
INPUT : John killed Mary by choking Mary.
OUTPUT 1 : John strangled Mary.
OUTPUT 2 : John choked Mary and she died because she
could not breathe.
Deepak Khemani Conceptual Dependency Theory 30
Margie : Paraphrase mode
INPUT : John prevented Bill from giving a banana to
Mary by selling a banana to Rita.
OUTPUT 1 : Bill was unable to give a banana to Mary
because Rita traded John some money for a
banana.
OUTPUT 2 : Mary could not get a banana from Bill
because Rita bought a banana from John.
INPUT : Reading the book reminded Rita to loan the
book to Bill.
OUTPUT : Rita remembered to give the book to Bill and
she expects him to return it to her because
someone read the book.
Deepak Khemani Conceptual Dependency Theory 31
Representation of the meaning of sentences. Basic axioms-
1. For two sentences with identical meaning, regardless of
language, there should be only one representation.
2. Any information that is implicit in the sentence must be made
explicit in the representation (via inferences).
3. The meaning propositions underlying language are called
conceptualizations – active or stative.
4. Active à Actor Action Object Direction (Instrument)
5. Stative à Object (is in) State (with Value).
Conceptual Dependency Theory
Deepak Khemani Conceptual Dependency Theory 32
Margie : Inferences
• Specification Inferences
John picked up a rock.
He hit Bill.
JOHN HIT BILL WITH THE ROCK.
John and Bill were alone on a desert island.
Bill was tapped on the shoulder.
JOHN TAPPED BILL.
• Causative Inferences
John hit Mary with a rock.
JOHN WAS PROBABLY MAD AT MARY.
• Resultative Inferences
Mary gave John a car.
JOHN HAS THE CAR.
Deepak Khemani Conceptual Dependency Theory 33
Inferences (continued)
• Motivational Inferences
John hit Mary.
JOHN PROBABLY WANTED MARY TO BE HURT.
• Enablement Inferences
Pete went to Europe.
WHERE DID HE GET THE MONEY?
• Function Inferences
John wants the book.
JOHN PROBABY WANTS TO READ IT.
• Enablement-Prediction Inferences
Dick looked in his cook book to find out how to make a roux.
DICK WILL NOW BEGIN TO MAKE A ROUX.
Deepak Khemani Conceptual Dependency Theory 34
Inferences (continued)
• Missing Enablement Inferences
Mary couldn’t see the horses finish.
She cursed the man in front of her.
THE MAN BLOCKED HER VISION.
• Intervention Inferences
The baby ran into the street.
Mary ran after him.
MARY WANTS TO PREVENT THE BABY
FROM GETTING HURT.
• Action Prediction Inferences
John wanted some nails.
HE WENT TO THE HARDWARE STORE.
Deepak Khemani Conceptual Dependency Theory 35
Inferences (continued)
• Knowledge-Propogation Inferences
Pete told Bill that Mary hit John with a bat.
BILL KNEW THAT JOHN HAD BEEN HURT.
• Normative Inferences
Does Pete have a gall bladder?
ITS HIGHLY LIKELY.
John saw Mary at the beach Tuesday morning.
WHY WASN’T SHE AT WORK?
• State Duration Inferences
John handed a book to Mary yesterday.
Is Mary still holding it?
PROBABLY NOT.
Deepak Khemani Conceptual Dependency Theory 36
Inferences (continued)
• Feature Inferences
Andy’s diaper is wet.
ANDY IS PROBABLY A BABY.
• Situation Inferences
Mary is going to a masquerade.
SHE WILL PROBABLY WEAR A COSTUME.
• Utterance-Intent Inferences
Mary couldn’t jump the fence.
WHY DID SHE WANT TO?
Deepak Khemani Conceptual Dependency Theory 37
Heuristics for inferences
1. John drooled as he viewed the banana. He ate
• FILL IN THE BANANA AS THE CONCEPTUAL OBJECT OF EATING.
2. Pete and Bill were alone on a desert island. Someone tapped Bill on the
shoulder.
• FILL IN PETE AS THE CONCEPUTAL ACTOR OF “MOVE” WHICH
UNDERLIES “TAP”
3. Mary picked up the rock. She hit John.
• PREDICT THAT IT WAS THE ROCK WAS THE OBJECT OF MARY’S
PROPELLING ACT
Deepak Khemani Conceptual Dependency Theory 38
Heuristics (continued)
4. John was driving his car. He hit Mary.
• PREDICT THE CAR AS THE OBJECT OF THE PROPEL.
5. John bought a hammer.
• “BUY” IS UNDERLIED BY A DUAL ATRANS ACT. WHO IS THE
OTHER ACTOR?
6. John was asleep.
• WHAT IS THE LOCATION OF THIS COMMON STATE LIKELY TO
BE IN THE ABSENCE OF OTHER EXPLICIT INFORMATION?
Deepak Khemani Conceptual Dependency Theory 39
Heuristics (continued)
7. Mary went to work.
• WHAT IS THE TIME OF THIS COMMON ACTION LIKELY TO BE?
8. John went to Paris.
• PREDICT THE LIKELY INSTRUMENTATLITY “FLY”.
Deepak Khemani Conceptual Dependency Theory 40
Yesterday, John hit his little dog
little
John hit dog
John
yesterday
Deepak Khemani Conceptual Dependency Theory 41
The man took a book.
man take book
p
past
But he must have taken the book from someone.
Deepak Khemani Conceptual Dependency Theory 42
The man took a book.
man take book
p R man
X
to
from
Here we have taken the linguistic verb
"take" itself as a conceptual ACT
An explicit conceptual Case Marker
Like Kaarak case markers in Panini
grammar
"Karta ney", "Karma ko", …
Deepak Khemani Conceptual Dependency Theory 43
Conceptual Cases
ACT PP Objective case
Directive case
D
LOC
LOC
ACT
Recipient case
R
PP
PP
ACT
ACT Instrumental case
I
Conceptual cases are predictive mechanisms. They create slots that need
to be filled up. The conceptualization is incomplete till they have been filled.
Dialogs are often sustained by the process of filling up empty slots.
Deepak Khemani Conceptual Dependency Theory 44
I gave the man a book
I give book
p R man
I
to
from
Conceptually "giving" and "taking" both involve transfer of something.
Only the ACTOR is different.
Deepak Khemani Conceptual Dependency Theory 45
TRANS (fer)
I TRANS book
p R man
I
to
from
I gave the man a book
man TRANS book
p R man
someone
to
from
The man took a book
The underlying conceptual act behind give and take is TRANS
Deepak Khemani Conceptual Dependency Theory 46
John grew the plants with fertilizer
Two events are happening here
plants
size = x + y
size = x
The plants
growing …
John do fertilizer
o
… and John
doing something
Linguistically fertilizer
is the instrument.
Conceptually it is the
Object of some act.
State change event
Conceptual action
Deepak Khemani Conceptual Dependency Theory 47
A Causal Connection
John do fertilizer
o
p
John did something
with the fertilizer
i
…which caused
plants
phys st size = x + y
phys st size = x
p
… the plants to
increase in size
A more informed listener might create a
more specific conceptual structure.
Intentional
Deepak Khemani Conceptual Dependency Theory 48
… John transferred the fertilizer
plants
phys st size = x + y
phys st size = x
John Trans fertilizer
p
p
i
D plants ground
bag
Deepak Khemani Conceptual Dependency Theory 49
CD actions
• ATRANS The transfer of an abstract relationship such as
possession, ownership or control.
– Give, take, buy…
• PTRANS Transfer of physical location of an object.
– Go, put…
• PROPEL Application of physical force to an object
(regardless of whether the object is PTRANSed or not).
– Push, pull, throw, kick have PROPEL as part of them.
• MOVE The movement of a body part of an animal by that
animal. Often an instrumental act.
– MOVE foot is the instrument in kick.
Deepak Khemani Conceptual Dependency Theory 50
CD actions (continued)
• GRASP The grasping of an object by an actor
– Verbs grab, let go, and throw involve GRASP
• INGEST to take in
– Eat, drink, smoke, breathe…
• EXPEL expulsion from the body…
– Including sweat, spit, and cry…
• MTRANS The transfer of mental information between
animals or within an animal. Memory partitions – CP (conscious
processor) and LTM (long term memory)
– Tell – MTRANS between people
– See – MTRANS from eyes to CP
– Remember – MTRANS from LTM to CP
Deepak Khemani Conceptual Dependency Theory 51
More CD actions
• MBUILD The construction by an animal of new information
from old information.
– Decide, conclude, imagine, consider…
• SPEAK The actions of producing sounds. Humans often
use it as an instrument for MTRANS.
– Say, play music, purr, scream involve SPEAK
• ATTEND The action of attending or focusing a sense organ
towards a stimulus. Also an instrument to MTRANS.
– See is MTRANS to CP from eye by instrument of ATTEND eye to object.
– Listen is ATTEND ear
Deepak Khemani Conceptual Dependency Theory 52
Linguistically the spoon is the
instrument with which John ate.
Instruments
John ate the ice cream with a spoon
INGEST ice cream
p
John
John
do
I
o
spoon
At a conceptual level the act of eating is
enabled by an instrumental act that
uses the spoon as an object.
Note: arrow meant
for ACT
Deepak Khemani Conceptual Dependency Theory 53
Eating with a spoon
INGEST ice cream
p
John
John
TRANS
I
o
spoon
R
ice cream mouth
John
POSS-BY
ice cream
CONT
The instrumental act is TRANS
of spoon containing ice-cream
towards John's mouth.
Deepak Khemani Conceptual Dependency Theory 54
Instrumental Acts
Every ACT can have an instrumental ACT. For example,
John ingested the icecream, by TRANSing the spoon towards his
mouth, which he did by grasping the spoon and then moving his
hand, by flexing his muscles, by thinking about flexing his
muscles, …
… we truncate our causal reasoning and instrumental
case specification at a granularity suited to our task.
In any domain that we build a conceptual representation system
for we will have to choose an appropriate level for primitive
actions.
Deepak Khemani Conceptual Dependency Theory 55
John was sad because Mary hit him
John
sad
Mary hit John
o
p
Another example of
an ACT causing a
state change.
Not a CD Act !
In CD theory hit would be modeled as coming into a state
of being in forceful contact, with PROPEL being the basic
ACT and MOVE the instrumental ACT.
Deepak Khemani Conceptual Dependency Theory 56
Events can cause other events
When Fred gave Mary a peach she ate it.
Fred Trans peach
p R Mary
Fred
Mary Ingest peach
p
In the conceptualizations we are looking at there are events in which
Actors execute some Acts
Deepak Khemani Conceptual Dependency Theory 57
State change "verbs"
John killed his teacher.
p
John DO
dead
p
teacher
alive
John
POSS-BY
In state change verbs the linguistic verbs often focus on the state
change while ignoring the action.
Deepak Khemani Conceptual Dependency Theory 58
State change "verbs"
p
Adora DO
Health(-10)
p
cockroach
Health(>-10)
indefinite
p
Adora DO
LOC(corner)
p
television
LOC(?)
definite
Adora killed a cockroach Adora moved the table to the corner
Deepak Khemani Conceptual Dependency Theory 59
Being more specific
John killed his teacher by shooting him in the head.
p
John propel
p
teacher
dead
alive
John
POSS-BY
bullets
R
gun
head
teacher
Deepak Khemani Conceptual Dependency Theory 60
Flying…
Sam flew his plane to San Francisco
p
Sam do
plane
Sam
POSS-BY
fly
D S.F.
Deepak Khemani Conceptual Dependency Theory 61
Comforting
John comforted Mary
p
John do
Mary
comfortable
Deepak Khemani Conceptual Dependency Theory
62
Since smoking can kill you, I stopped.
p
one INGEST
p
one
dead
alive
smoke
R
cigarette
one
c
I
tFp
INGEST
smoke
R
cigarette I
Deepak Khemani Conceptual Dependency Theory 63
While going home I saw a frog
I go
D house
I
I see frog
POSS-BY
p
Deepak Khemani Conceptual Dependency Theory 64
Conceptual tenses
• P past
• f future
• t transition
• ts transition start
• tf transition finished
• k continuing
• ? Interrogative
• / negative
• c potential
• nil present
• Δ timeless
Deepak Khemani Conceptual Dependency Theory 65
Yesterday, the boy in the chair hit the boy on the piano in the mouth in the park.
à
boy1
hit mouth
yesterday
park
LOC
chair
boy2
POSS-BY
LOC
piano
à
à
specific
specific
à
specific
Deepak Khemani Conceptual Dependency Theory 66
Separating Action and State
I like books
Books please me.
I do books
I pleased
Deepak Khemani Conceptual Dependency Theory 67
Thinking actions
prevent x do
do
y
instigate x do
do
y
i
Cannot
c
Deepak Khemani Conceptual Dependency Theory 68
Transitive verbs are causal relations
hurt x do
hurt
y
x do
comfortableMENT
y
t
comfort
Mental state
Deepak Khemani Conceptual Dependency Theory 69
I comforted John
I do
comfortableMENT
t
p
John
Deepak Khemani Conceptual Dependency Theory 70
A more complete probabilistic analysis
p
I say z
R
I
john
p
comfortableMENT
upset
John
^
I physcont John
p
gentle
à
I comforted John
Soothing words?
Deepak Khemani Conceptual Dependency Theory 71
A more specific sentence…
p
I trans
t
food
R
I
john
John ingest food
comfortableMENT
upset
John
I comforted John by feeding him.
Note : Giving food leads to eating food leads to becoming comfortable
Deepak Khemani Conceptual Dependency Theory 72
A general threat
threaten x communicate
y believe
i
y do
do
x
hurt
y
t
cf
Note : Y comes to BELIEVE that if Y
does something … it is modeled as Y
in fact getting threatened.
Deepak Khemani Conceptual Dependency Theory 73
A general threat
threaten
x MTRANS
y CONC
i
y doY
doX
x
HEALTH(<0)
y
t
cf
Deepak Khemani Conceptual Dependency Theory 74
A specific threat
I threatened him with a broken nose
communicate
he believe
i
he doX
doy
I
broken
nose
t
I
p I
doy
R
he I
nose
broken
cf
he
he
POSS-BY
poss by
Deepak Khemani Conceptual Dependency Theory 75
Another explicit threat
I threatened him with a hammer.
communicate
he believe
i
he do
do
I
hurt
he
t
p I
do
cf
I f
he
I
R
hammer
he
I
D
hammer
he
I
D
Deepak Khemani Conceptual Dependency Theory 76
Advise communicates belief of speaker
advise
communicate
x
x
y
x
R
believe
y y
dox
pleased
cf
Deepak Khemani Conceptual Dependency Theory 77
Some eating advise
I advised him to try the twice cooked pork
communicate
I
p
I
believe
R
he I
INGEST
c
he pork
à
twice cooked
pleased
he
t
cf
Deepak Khemani Conceptual Dependency Theory 78
Liking ice cream
INGEST ice cream
f
x
f
pleased
x
conceptualize
x
x
INGEST
x
pleased
f
f
ice cream
No thought
component!
X thinks that X will be
pleased if X eats ice
cream
Deepak Khemani Conceptual Dependency Theory 79
Liking ice cream
INGEST ice cream
f
x
f
pleased
x
CONC
Abasi
Abasi
INGEST
Abasi
pleased
f
f
ice cream
No thought
component!
Deepak Khemani Conceptual Dependency Theory 80
Want has a specific time sense
x do
pleased
y
want
Now
For example
Deepak Khemani Conceptual Dependency Theory 81
Past and future
I wanted it
conceptualize
I
x
do
I
pleased
cf
p
past
future
Deepak Khemani Conceptual Dependency Theory 82
realization
John wants it but he doesn't realize it
conceptualize
speaker
x
do
John
pleased
cf
conceptualize
John
x
do
John
pleased
cf
^
Somebody
has to realize
it if it is to be
mentioned!
Deepak Khemani Conceptual Dependency Theory 83
Unwareness
He hit Bill’s car but he doesn’t know it.
he hit car
p
Bill
POSS-By
conceptualize
^
he hit car
Bill
POSS-By
he
Deepak Khemani Conceptual Dependency Theory 84
Remembering is thinking about
I remember the time we ate oysters.
I conceptualize
we
INGEST
I
I
T1
oysters
p
MTRANS
INGEST oysters
We
R
LTM CP
Poss-by
POSS-BY
I
I
Remembering BY Mtransing it from LTM to CP (conscious processor)
Deepak Khemani Conceptual Dependency Theory 85
MTRANS – transferring info - "mental"
communicate
MTRANS
y R x
y
say to / tell
MTRANS
y R x
y
I
y
speak
“words”
x y
say to / tell
Deepak Khemani Conceptual Dependency Theory 86
Movement of info within
Perceive
MTRANS
y R IM
CP
Learn
MTRANS
y R CP
sense-organ
Immediate
Memory
Deepak Khemani Conceptual Dependency Theory 87
Forgetting is being unable to remember
MTRANS
y R CP
LTM
remember
forget
MTRANS
y R CP
LTM
c
Deepak Khemani Conceptual Dependency Theory 88
Seeing as conceptualizing
I saw John eating soup.
I CONC
INGEST
I
MTRANS
I LOOK AT
p
John,soup
p
John
soup
p
John ingest soup
eyes CP
R
I
I
Deepak Khemani Conceptual Dependency Theory 89
To Conceptualize is to Ponder
consider x CONC f
ponder
x CONC
dream
x CONC
asleep
x
while
wonder
x CONC
?
Deepak Khemani Conceptual Dependency Theory 90
Love and hate are states
love
x CONC
hate
x
y
s
hate
x CONC
love
x
y
s
Deepak Khemani Conceptual Dependency Theory 91
Think – another sense
I believe that John is a fool
I think that John is a fool
John
fool
LOC(M)
POSS-BY
I
The conceptualization "John is a fool" is located in my memory.
Deepak Khemani Conceptual Dependency Theory 92
Kasparov
brilliant
LOC(IM)
POSS-BY
I
CONC
I
brilliant
Kasparov
Deepak Khemani Conceptual Dependency Theory 93
ACTIONS: Inputs to Understanding
• Goals and Plans are not linguistic entities
• Instead they form Knowledge Structures
• Goals and Plans are often not stated explicitly
• Instead what we see is a sequence of Actions
• For example, designing a game playing agent :
For an intelligent
game agent,
actions are your
keyboard strokes…
it needs to
understand your
intentions from them.
Software agents have to make sense of information
coming via the keyboard or some other medium.
Deepak Khemani Conceptual Dependency Theory 94
Kasparov
brilliant
LOC(IM)
POSS-BY
I
CONC
I
brilliant
Kasparov
MTRANS
I D
Match Venue
CP
I
Kasparov ! Anand POSS-BY
I
Play Chess
Deepak Khemani Conceptual Dependency Theory 95
Kasparov
brilliant
LOC(IM)
POSS-BY
I
CONC
I
brilliant
Kasparov
MTRANS
I D
Match Venue
CP
I
Kasparov ! Anand POSS-BY
I
Play Chess
MBUILD
I
brilliant
Kasparov
Deepak Khemani Conceptual Dependency Theory 96
Believes
Fred believes John.
MTRANS
John R
John
Fred
I
LOC(M)
POSS-BY
Fred
I
Fred tells something to John, and John puts it in his memory.
Deepak Khemani Conceptual Dependency Theory 97
Believes – as in agrees with
Fred believes John.
MTRANS
John R
John
one
LOC(M)
POSS-BY
Fred
>
I
I
John is saying something (to someone) and Fred also believes that.
Deepak Khemani Conceptual Dependency Theory 98
But Fred must "put" it in his memory
MTRANS
John R
John
CP
I
CONC
Fred I
Poss-by
Fred
MBUILD
Fred R
CP
IM
I
Poss-by
Fred
Poss-by
Fred
I
LOC(IM)
POSS-BY
Fred
Deciding to believe it, Fred
must create the structure in
his memory
Deepak Khemani Conceptual Dependency Theory 99
Modeling inferences
Conclude – infer Fx from F1, F2, …
MBUILD
o
x
x
1 2
>
…
R IM
IM
Deepak Khemani Conceptual Dependency Theory 100
Physical actions in CD
MOVE own body part
PROPEL something else
INGEST input
EXPEL output
PTRANS change of location
GRASP grasp
If a PTRANS happens then infer that (1) the object ceases to be at the
origin location and (2) exists at destination location.
Likewise in ATRANS, but not in MTRANS
(except when donor is CP)
Deepak Khemani Conceptual Dependency Theory 101
PTRANS
I
D
cafeteria
I
tr
I
I MOVE
p
feet
cafeteria
D
I
POSS BY
I walked to the cafeteria
The key act is PTRANS. Infer
that I am at cafeteria
MOVE is
instrumental act
Deepak Khemani Conceptual Dependency Theory 102
John threw a rock at Sam
PTRANS
D Sam
rock
P
I
John PROPEL
p rock
Sam
D
air
John
John
John
Throw = PTRANS in air by doing PROPEL
Deepak Khemani Conceptual Dependency Theory 103
John threw a rock at Sam
PTRANS
D
Ayumu
pencil
P
I
Adriana PROPEL
p
pencil
Ayumu
D air
Adriana
Adriana
Adriana
Deepak Khemani Conceptual Dependency Theory 104
John threw the pencil to Sam.
Throw to – is an instrumental act for ATRANS
ATRANS
R Sam
pencil
P
I
John PTRANS
p
pencil
Sam
D
air
John
John
John
PROPEL
D Sam
pencil
P
John
John
I
Deepak Khemani Conceptual Dependency Theory 105
PROPEL
D
Mary
X
p
John
John
PHYSCONT
Mary
>
X
John hit Mary
Hit with something. PROPEL that something so
that it comes into (hard) contact
Deepak Khemani Conceptual Dependency Theory 106
PROPEL
D Mary
fist
P
I
John
MOVE
fist
Mary
D
John
John
POSS-BY
John
PHYSCONT
Mary
>
fist
John
POSS-BY
John
John punched Mary
Deepak Khemani Conceptual Dependency Theory 107
More violence…
John hit Mary by throwing a stick at her.
PROPEL
D Mary
stick
P
I
John
MOVE
hand
Mary
D
John
John
CONT
stick
PHYSCONT
Mary
>
stick
John
John
air
P
>
John
GRASP
tr
POSS-BY
Deepak Khemani Conceptual Dependency Theory 108
A car hit Mary.
PROPEL
D
Mary
car
P
*
PHYSCONT
Mary
>
car
Deepak Khemani Conceptual Dependency Theory 109
I moved the table to the corner.
table
corner
I do table
It could be possible that I PTRANSed the table by using PROPEL, but it
could also be possible that I told someone to move it…
Deepak Khemani Conceptual Dependency Theory 110
p
I MOVE
meat
slices
whole
POSS-BY
hand
D
in
meat
I
knife
CONT
back & forth
I
GRASP
knife
hand
D
I
I
POSS-BY
I sliced the meat with a knife.
Deepak Khemani Conceptual Dependency Theory 111
Conceptual Analysis
I want to go to the park with the girl.
cf
pleased
x
cf
vs
vt
x y
human
x y
human physobj
want
ATRANS
R
X
Y
one
pleased
x
one
cf
cf
Deepak Khemani Conceptual Dependency Theory 112
"want" – a third sense
vt
x y
human human
want
PTRANS
D
here
Y
Y
pleased
x
cf
cf
The first sense of want – state verb – is chosen.
The parser is now on the lookout for a complete
conceptualization to fill in.
Deepak Khemani Conceptual Dependency Theory 113
I want TO GO…
go
PTRANS
D
someplace
x
x
vio
animal
PTRANS
D
someplace
x
one
vio
physobj
x
Deepak Khemani Conceptual Dependency Theory 114
"to go" fulfills expectation of conceptualization
PTRANS
D
“place”
I
I
cf
PTRANS
D
park1
I
I
pleased
I
cf
cf
I want..
pleased
I
cf
cf
…to go… …the park…
…the park…
Deepak Khemani Conceptual Dependency Theory 115
…with the girl
Examples,
1. I went with a book to the park
2. I went to the park with the playground
3. I went with the girl to the park
4. I hit the boy with the bat
5. I hit the boy with the girl
6. I hit the boy with vengeance
"with PP" has many conceptual possibilities.
1. PP is object of instrumental case (4)
2. PP is additional actor of the conceptualization (3)
3. PP is an attribute of PP immediately preceding it (1,2,5)
4. PP is an attribute of the actor of the conceptualization (1,6)
Deepak Khemani Conceptual Dependency Theory 116
PTRANS
D
park
I
I
pleased
I
cf
cf
specific
girl
>
specific
girl
>
specific
I want to go to the park with the girl.
Deepak Khemani Conceptual Dependency Theory 117
Conceptual semantics
The boy ate a book
INGEST
X
Y
X in
eat: vt
X Y
animal food
INGEST
boy
boy
p
book * in
o
Given that there is no other
word sense for eat, one has
no choice… but one can mark
the conceptualization is
semantically inconsistent
Deepak Khemani Conceptual Dependency Theory 118
John ate the steak with the odor
INGEST
John
John steak
in
D
smell:odor
1. PP is object of instrumental case
2. PP is additional actor of the conceptualization
3. PP is an attribute of PP immediately preceding it
4. PP is an attribute of the actor of the conceptualization
First one that fits
semantically
Deepak Khemani Conceptual Dependency Theory 119
John ate the steak with the fork
INGEST
John
John steak
fork
D I
PTRANS
fork
mouth
D
John
POSS-BY
in
John
1. PP is object of instrumental case
2. PP is additional actor of the conceptualization
3. PP is an attribute of PP immediately preceding it
4. PP is an attribute of the actor of the conceptualization
First one that fits
semantically
First one that fits
semantically
Deepak Khemani Conceptual Dependency Theory 120
PROPEL
girl
John bullet
rifle
D I
PROPEL
bullet
girl
D
rifle
rifle
PHYSCONT
girl
>
bullet
1. PP is object of instrumental case
2. PP is additional actor of the conceptualization
3. PP is an attribute of PP immediately preceding it
4. PP is an attribute of the actor of the conceptualization
He shot the girl with a rifle
But, he could
have been a
photographer!
In the verb-ACT dictionary
"shoot" = PROPEL bullets from gun!
Deepak Khemani Conceptual Dependency Theory 121
Syntactic ambiguity
Syntactic ambiguity has always been a problem in NLP.
Remember Kuno and Oettinger's "Time flies like an arrow".
Consider a sentence,
I saw the Grand Canyon flying to New York.
Most people are unwilling to accept a flying Grand Canyon and
construct an appropriate structure in which one event marks the
time of another.
ELI also does this because it uses semantic information.
Deepak Khemani Conceptual Dependency Theory 122
Seeing
see
MTRANS
x R IM
CP
Poss-by
x
Poss-by
x
human
vi
vs MTRANS
x R CP
Poss-by
x
I
LOOK-AT y
x
animal
Understand,
perceive
Deepak Khemani Conceptual Dependency Theory 123
See
MTRANS
x R CP
Poss-by
x
animal
vt
y
BE
physobj
I
LOOK-AT y
x
Deepak Khemani Conceptual Dependency Theory 124
I saw the Grand Canyon…
I saw the Grand Canyon flying to New York.
MTRANS
I
Grand Canyon
I
LOOK-AT
Grand Canyon
I
R CP
eye
Poss-by
Poss-by
I
I
Deepak Khemani Conceptual Dependency Theory 125
… flying (fly has three senses)
fly
PTRANS
D
X
I
X
PROPEL
X
D
air
X
bird, plane, insect
vio
Birds, planes
and insects can
fly….
Deepak Khemani Conceptual Dependency Theory 126
Or humans can fly planes
PROPEL
D
Y
y
DO
x
vt
air
human plane
Deepak Khemani Conceptual Dependency Theory 127
Or humans can fly in planes
PTRANS
D
X
I
plane
PROPEL
plane
D
air
X
human
vio
Deepak Khemani Conceptual Dependency Theory 128
I saw the Grand Canyon flying to New York
MTRANS
I
Grand Canyon
I
LOOK-AT
Grand Canyon
I
R
IM
eye
PTRANS
D
I
I
plane
PROPEL
plane
D
air
I
NY
NY
p
p
while
plane
LOC
"I" am the only subject in the sentence, so the second or third form of
fly must be used …. An English specific rule says that the second
conceptualization marks the time of the first one.
Deepak Khemani Conceptual Dependency Theory 129
I saw the Grand Canyon flying to New York
MTRANS
I
Grand Canyon LOOK-AT
Grand Canyon
I
IM
eye
PTRANS
D
I
I
plane
PROPEL
plane
D
air
I
NY
NY
p
p
while
plane
LOC
I
CONT
I
Deepak Khemani Conceptual Dependency Theory 130
Semantic Ambiguity
fill
vt PTRANS
x
“liquid”
R
y
liquid
Q
Q
c CONT
human
container
PTRANS
one “liquid”
R
y
liquid
Q
Q
c CONT
container
physobj
I
one
x
do
vt
Deepak Khemani Conceptual Dependency Theory 131
Semantic Ambiguity
The old man’s glasses were filled with sherry. Glasses in
the sense of
containers!
PTRANS
one sherry
D
glasses
Q
Q
c CONT
p
"the old man"
POSS-BY
Deepak Khemani Conceptual Dependency Theory 132
Syntactic similarity
John’s love of Mary was harmful.
John CONC
love
John
Mary
s
one
hurt
John’s can of beans was edible.
one INGEST beans
c
can
John
CONT-BY
POSS-BY
Deepak Khemani Conceptual Dependency Theory 133
End
Deepak Khemani Conceptual Dependency Theory 134
Poss-by
Loc
Cont
I
R
D
Deepak Khemani Conceptual Dependency Theory 135
Symbols
Poss-by
Loc
Cont
D
LOC
LOC
ACT
R
ACT
PP
PP
I
ACT
PP
ACT
PP PP
T LOC
PP ACT

Weitere ähnliche Inhalte

Kürzlich hochgeladen

(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSHARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSRajkumarAkumalla
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Call Girls in Nagpur High Profile
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...Call Girls in Nagpur High Profile
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝soniya singh
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...ranjana rawat
 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSKurinjimalarL3
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escortsranjana rawat
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxpurnimasatapathy1234
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxAsutosh Ranjan
 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVRajaP95
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptxthe ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptxhumanexperienceaaa
 

Kürzlich hochgeladen (20)

(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSHARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
 
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCRCall Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptx
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
 
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
 
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptxthe ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
the ladakh protest in leh ladakh 2024 sonam wangchuk.pptx
 

Empfohlen

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

Empfohlen (20)

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 

Conceptual dependency theory in Artificial Intelligence.pdf

  • 1. Deepak Khemani Conceptual Dependency Theory 1 Knowledge Representation Conceptual Dependency Based on the work done by Roger Schank and his group at Yale University in the 1970s. Deepak Khemani Department of Computer Science & Engineering IIT Madras
  • 2. Deepak Khemani Conceptual Dependency Theory 2 Perception / Understanding Making sense of some inputs. Natural Language Understanding Speech Understanding Image Understanding Understanding is like parsing. Thesis : Understanding has a strong top down component. It involves concept driven mapping into preconceived notions, rather than data driven bottom up approach.
  • 3. Deepak Khemani Conceptual Dependency Theory 3 A short story John meets Fred on the road. Fred has a knife. John is angry because his wife Mary has yelled at him… Fred : Hi John : What are you doing with the knife? Fred : Thought I'd teach the kids to play mumbly-peg. John : I could use a knife right now. Fred : What's the matter? John : Damn Mary, always on my back. She'll be sorry. Fred : I don't think a knife will help you. John : You're just on her side. I think I ought to . . . From "Identification of Conceptualizations underlying Natural Language" – Roger Schank … at this point the listener has some expectations
  • 4. Deepak Khemani Conceptual Dependency Theory 4 Expectations Syntax a verb Meaning a "conceptual structure" type and a filler for it Context the conceptual structure predicts an "action". Context delimits the range of possible actions, for example end relationship hurt someone go to some place emote Conversational people talk for a reason. To arouse sympathy, or to inform about intent, etcetra… World view of listener If John is known to be a convicted murderer the expectation would be different from if he were known to be an avowed pacifist. Cultural norm what is accepted within a culture What kind of knowledge structures in memory would generate such expectations?
  • 5. Deepak Khemani Conceptual Dependency Theory 5 A short story John meets Fred on the road. Fred has a knife. John is angry because his wife Mary has yelled at him… Fred : Hi John : What are you doing with the knife? Fred : Thought I'd teach the kids to play mumbly-peg. John : I could use a knife right now. Fred : What's the matter? John : Damn Mary, always on my back. She'll be sorry. Fred : I don't think a knife will help you. John : You're just on her side. I think I ought to . . . One would be considerably surprised to hear “I think I ought to go and eat some fish" Jokes exploit such violation of expectation.
  • 6. Deepak Khemani Conceptual Dependency Theory 6 Courtesy: Richard Gregory Vision..
  • 7. Deepak Khemani Conceptual Dependency Theory 7
  • 8. Deepak Khemani Conceptual Dependency Theory 8
  • 9. Deepak Khemani Conceptual Dependency Theory 9 Conceptual Dependency Theory • The CD theory defines a semantic base for knowledge representation. • The objective was to understand natural language stories. • The CD theory is designed for everyday actions. • More specific domains would require a specific set of primitives. Basic unit à CONCEPTUALIZATION something like a Well Formed Formula Main component à EVENT defined by an ACTOR an ACTION an OBJECT a sense of DIRECTION
  • 10. Deepak Khemani Conceptual Dependency Theory 10 Concepts Conceptualization Concepts + Relations nominals picture producers (PP) actions actions (ACT) modifiers action aiders (AA) picture aiders (PA) Inherently governing categories Inherently dependent categories
  • 11. Deepak Khemani Conceptual Dependency Theory 11 Conceptualizations • Nominals and actions can exist as independent notions. – Nominals stand for objects and people. – Actions are acts of nominals. • Modifiers give additional information on the nominals or actions. • A dependent concept predicts the existence of a governer. • A conceptualization is a collection of concepts and relations in which there is at least a two way dependency. • A conceptualization tells you something about the world. • Conceptual Dependency theory defines the set of actions that can be done by people. • Can be described in a logic like syntax – For example in “Artificial Intelligence”, by Charniak and McDermott. • Can be depicted graphically by C-diagrams.
  • 12. Deepak Khemani Conceptual Dependency Theory 12 Example 1. John hit his little dog. PP – Can be understood by itself. Act – Conceptually an action. PP – a governor. Related to act hit as object of action. Is dependent on hit : cannot be understood in the conceptualization without it. Objective dependency. A two way dependency between the two concepts. The core of the conceptualization. John hit dog
  • 13. Deepak Khemani Conceptual Dependency Theory 13 Example 1 (continued) John hit his little dog. A PA dependent on the dog. Attributive Dependency. little A little more complex - “his” is dependent on “dog”. But it is also a linguistic item – pronoun – for “John”. One PP as dependent on another PP : Prepositional Dependency. Label indicates type of dependency. Poss-by John hit dog John
  • 14. Deepak Khemani Conceptual Dependency Theory 14 Time
  • 15. Deepak Khemani Conceptual Dependency Theory 15 Conceptual Dependencies 1. PP ACT Certain PPs can ACT 2. PP PA PPs (and some Conceptualizations) can be described by an attrtibute. 3. ACT PP ACTs have objects. 4. ACTs have direction. D LOC LOC ACT 5. ACTs have recipients.. R PP PP ACT 6. ACT MTRANS requires conceptualizations as objects, and MBUILD has its own object type.
  • 16. Deepak Khemani Conceptual Dependency Theory 16 Conceptual Dependencies PP ACT PP PA ACT PP D LOC LOC ACT R PP PP ACT ACT
  • 17. Deepak Khemani Conceptual Dependency Theory 17 Conceptual Dependencies 8. PPs can be described by the conceptualizations in which they occur. PP PP 9. Conceptualizations have times. T LOC 10. Conceptualizations have locations. 7. ACT ACTs have conceptualizations as instruments. I
  • 18. Deepak Khemani Conceptual Dependency Theory 18 Conceptual Dependencies PP PP T LOC ACT I
  • 19. Deepak Khemani Conceptual Dependency Theory 19 Conceptual Dependencies 11. Conceptualizations can result in state changes for PPs. r 12. Conceptualizations involving mental ACTs can server as reasons for conceptualizations. R 13. State or state changes can enable conceptualizations to occur. E E 14. PP PP One PP is equivalent to or an instance of another PP. 15. ACTs can be varied along certain dimensions (e.g. speed for motions ACTS). ACT AA
  • 20. Deepak Khemani Conceptual Dependency Theory 20 Conceptual Dependencies r R E E PP PP ACT AA huge Rashmi ate Hot dog Rashmi watch Movie scary indefinite definite
  • 21. Deepak Khemani Conceptual Dependency Theory 21 Conceptual Dependencies big Piyush read book Piyush tf yesterday
  • 22. Deepak Khemani Conceptual Dependency Theory 22 State Variables HEALTH: goes from –10 to +10 Examples: dead -10 gravely ill -9 sick -9 to -1 under the weather -2 all right 0 tip top +7 perfect health +10 PHYSICAL STATE: goes from -10 to +10 Examples: dead -10 harmed -9 injured -5 broken (for objects) -5 harmed -1 to -7 hurt -1 to -7 OK 10
  • 23. Deepak Khemani Conceptual Dependency Theory 23 State Variables ANGER : goes from -10 to 0 Examples: furious -9 enraged -8 angry -5 irked -3 upset -2 calm 0 MENTAL STATE: goes from -10 to +10. Examples: catatonic -9 (same as JOY in MARGIE) depressed -5 upset -3 sad -2 OK 0 pleased +2 happy +5 ecstatic +10
  • 24. Deepak Khemani Conceptual Dependency Theory 24 State Variables CONSCIOUSNESS: goes from 0 to +10 Examples: unconscious 0 asleep 5 awake 10 “higher drug consciousness” > 10 FEAR : goes from -10 to 0 Examples: terrified -9 scared -5 anxious -2 calm 0 SURPRISE : goes from 0 to 10 Examples: surprised 5 amazed 7 astounded 9
  • 25. Deepak Khemani Conceptual Dependency Theory 25 State Variables HUNGER: goes from -10 to +10. Examples: Starving -8 ravenous -6 “could eat a horse” -5 hungry -3 no appetite 0 satisfied 3 full 5 stuffed 8 satiated 3 - 10 DISGUST : goes from -10 to 0 Examples: nauseated -8 revolted -7 disgusted -6 bothered -2
  • 26. Deepak Khemani Conceptual Dependency Theory 26 Compound states • shocked = SURPRISE (6) DISGUST (-5) • calm/cool = SURPRISE (0) DISGUST (0) FEAR (0) ANGER (0) CONSCIOUSNESS (>0)
  • 27. Deepak Khemani Conceptual Dependency Theory 27 Margie : Inference mode INPUT : John told Mary that Bill wants a book. OUTPUT 1 : A book about what? OUTPUT 2 : Mary knows that Bill wants a book. OUTPUT 3 : Bill wants to come to have a book. OUTPUT 4 : Bill wants someone to cease to have a book. OUTPUT 5 : Bill wants to read a book. INPUT : John gave Mary a beating with a stick. OUTPUT 1 : A stick touched Mary. OUTPUT 2 : Mary became hurt. OUTPUT 3 : John wanted Mary to become hurt. OUTPUT 4 : Why was John angry?
  • 28. Deepak Khemani Conceptual Dependency Theory 28 Margie : Inference mode INPUT : John gave Mary an aspirin. OUTPUT 1 : John believes that Mary wants an aspirin. OUTPUT 2 : Mary is sick. OUTPUT 3 : Mary wants to feel better. OUTPUT 4 : Mary will ingest the aspirin. INPUT : John is going to go to the store. OUTPUT 1 : John wants to be at the store. OUTPUT 2 : What does John want to buy? OUTPUT 3 : John will trade money to the store for something.
  • 29. Deepak Khemani Conceptual Dependency Theory 29 Margie : Paraphrase mode INPUT : John advised Mary to drink the wine. OUTPUT : John told Mary that drinking the wine would benefit her. INPUT : John killed Mary by choking Mary. OUTPUT 1 : John strangled Mary. OUTPUT 2 : John choked Mary and she died because she could not breathe.
  • 30. Deepak Khemani Conceptual Dependency Theory 30 Margie : Paraphrase mode INPUT : John prevented Bill from giving a banana to Mary by selling a banana to Rita. OUTPUT 1 : Bill was unable to give a banana to Mary because Rita traded John some money for a banana. OUTPUT 2 : Mary could not get a banana from Bill because Rita bought a banana from John. INPUT : Reading the book reminded Rita to loan the book to Bill. OUTPUT : Rita remembered to give the book to Bill and she expects him to return it to her because someone read the book.
  • 31. Deepak Khemani Conceptual Dependency Theory 31 Representation of the meaning of sentences. Basic axioms- 1. For two sentences with identical meaning, regardless of language, there should be only one representation. 2. Any information that is implicit in the sentence must be made explicit in the representation (via inferences). 3. The meaning propositions underlying language are called conceptualizations – active or stative. 4. Active à Actor Action Object Direction (Instrument) 5. Stative à Object (is in) State (with Value). Conceptual Dependency Theory
  • 32. Deepak Khemani Conceptual Dependency Theory 32 Margie : Inferences • Specification Inferences John picked up a rock. He hit Bill. JOHN HIT BILL WITH THE ROCK. John and Bill were alone on a desert island. Bill was tapped on the shoulder. JOHN TAPPED BILL. • Causative Inferences John hit Mary with a rock. JOHN WAS PROBABLY MAD AT MARY. • Resultative Inferences Mary gave John a car. JOHN HAS THE CAR.
  • 33. Deepak Khemani Conceptual Dependency Theory 33 Inferences (continued) • Motivational Inferences John hit Mary. JOHN PROBABLY WANTED MARY TO BE HURT. • Enablement Inferences Pete went to Europe. WHERE DID HE GET THE MONEY? • Function Inferences John wants the book. JOHN PROBABY WANTS TO READ IT. • Enablement-Prediction Inferences Dick looked in his cook book to find out how to make a roux. DICK WILL NOW BEGIN TO MAKE A ROUX.
  • 34. Deepak Khemani Conceptual Dependency Theory 34 Inferences (continued) • Missing Enablement Inferences Mary couldn’t see the horses finish. She cursed the man in front of her. THE MAN BLOCKED HER VISION. • Intervention Inferences The baby ran into the street. Mary ran after him. MARY WANTS TO PREVENT THE BABY FROM GETTING HURT. • Action Prediction Inferences John wanted some nails. HE WENT TO THE HARDWARE STORE.
  • 35. Deepak Khemani Conceptual Dependency Theory 35 Inferences (continued) • Knowledge-Propogation Inferences Pete told Bill that Mary hit John with a bat. BILL KNEW THAT JOHN HAD BEEN HURT. • Normative Inferences Does Pete have a gall bladder? ITS HIGHLY LIKELY. John saw Mary at the beach Tuesday morning. WHY WASN’T SHE AT WORK? • State Duration Inferences John handed a book to Mary yesterday. Is Mary still holding it? PROBABLY NOT.
  • 36. Deepak Khemani Conceptual Dependency Theory 36 Inferences (continued) • Feature Inferences Andy’s diaper is wet. ANDY IS PROBABLY A BABY. • Situation Inferences Mary is going to a masquerade. SHE WILL PROBABLY WEAR A COSTUME. • Utterance-Intent Inferences Mary couldn’t jump the fence. WHY DID SHE WANT TO?
  • 37. Deepak Khemani Conceptual Dependency Theory 37 Heuristics for inferences 1. John drooled as he viewed the banana. He ate • FILL IN THE BANANA AS THE CONCEPTUAL OBJECT OF EATING. 2. Pete and Bill were alone on a desert island. Someone tapped Bill on the shoulder. • FILL IN PETE AS THE CONCEPUTAL ACTOR OF “MOVE” WHICH UNDERLIES “TAP” 3. Mary picked up the rock. She hit John. • PREDICT THAT IT WAS THE ROCK WAS THE OBJECT OF MARY’S PROPELLING ACT
  • 38. Deepak Khemani Conceptual Dependency Theory 38 Heuristics (continued) 4. John was driving his car. He hit Mary. • PREDICT THE CAR AS THE OBJECT OF THE PROPEL. 5. John bought a hammer. • “BUY” IS UNDERLIED BY A DUAL ATRANS ACT. WHO IS THE OTHER ACTOR? 6. John was asleep. • WHAT IS THE LOCATION OF THIS COMMON STATE LIKELY TO BE IN THE ABSENCE OF OTHER EXPLICIT INFORMATION?
  • 39. Deepak Khemani Conceptual Dependency Theory 39 Heuristics (continued) 7. Mary went to work. • WHAT IS THE TIME OF THIS COMMON ACTION LIKELY TO BE? 8. John went to Paris. • PREDICT THE LIKELY INSTRUMENTATLITY “FLY”.
  • 40. Deepak Khemani Conceptual Dependency Theory 40 Yesterday, John hit his little dog little John hit dog John yesterday
  • 41. Deepak Khemani Conceptual Dependency Theory 41 The man took a book. man take book p past But he must have taken the book from someone.
  • 42. Deepak Khemani Conceptual Dependency Theory 42 The man took a book. man take book p R man X to from Here we have taken the linguistic verb "take" itself as a conceptual ACT An explicit conceptual Case Marker Like Kaarak case markers in Panini grammar "Karta ney", "Karma ko", …
  • 43. Deepak Khemani Conceptual Dependency Theory 43 Conceptual Cases ACT PP Objective case Directive case D LOC LOC ACT Recipient case R PP PP ACT ACT Instrumental case I Conceptual cases are predictive mechanisms. They create slots that need to be filled up. The conceptualization is incomplete till they have been filled. Dialogs are often sustained by the process of filling up empty slots.
  • 44. Deepak Khemani Conceptual Dependency Theory 44 I gave the man a book I give book p R man I to from Conceptually "giving" and "taking" both involve transfer of something. Only the ACTOR is different.
  • 45. Deepak Khemani Conceptual Dependency Theory 45 TRANS (fer) I TRANS book p R man I to from I gave the man a book man TRANS book p R man someone to from The man took a book The underlying conceptual act behind give and take is TRANS
  • 46. Deepak Khemani Conceptual Dependency Theory 46 John grew the plants with fertilizer Two events are happening here plants size = x + y size = x The plants growing … John do fertilizer o … and John doing something Linguistically fertilizer is the instrument. Conceptually it is the Object of some act. State change event Conceptual action
  • 47. Deepak Khemani Conceptual Dependency Theory 47 A Causal Connection John do fertilizer o p John did something with the fertilizer i …which caused plants phys st size = x + y phys st size = x p … the plants to increase in size A more informed listener might create a more specific conceptual structure. Intentional
  • 48. Deepak Khemani Conceptual Dependency Theory 48 … John transferred the fertilizer plants phys st size = x + y phys st size = x John Trans fertilizer p p i D plants ground bag
  • 49. Deepak Khemani Conceptual Dependency Theory 49 CD actions • ATRANS The transfer of an abstract relationship such as possession, ownership or control. – Give, take, buy… • PTRANS Transfer of physical location of an object. – Go, put… • PROPEL Application of physical force to an object (regardless of whether the object is PTRANSed or not). – Push, pull, throw, kick have PROPEL as part of them. • MOVE The movement of a body part of an animal by that animal. Often an instrumental act. – MOVE foot is the instrument in kick.
  • 50. Deepak Khemani Conceptual Dependency Theory 50 CD actions (continued) • GRASP The grasping of an object by an actor – Verbs grab, let go, and throw involve GRASP • INGEST to take in – Eat, drink, smoke, breathe… • EXPEL expulsion from the body… – Including sweat, spit, and cry… • MTRANS The transfer of mental information between animals or within an animal. Memory partitions – CP (conscious processor) and LTM (long term memory) – Tell – MTRANS between people – See – MTRANS from eyes to CP – Remember – MTRANS from LTM to CP
  • 51. Deepak Khemani Conceptual Dependency Theory 51 More CD actions • MBUILD The construction by an animal of new information from old information. – Decide, conclude, imagine, consider… • SPEAK The actions of producing sounds. Humans often use it as an instrument for MTRANS. – Say, play music, purr, scream involve SPEAK • ATTEND The action of attending or focusing a sense organ towards a stimulus. Also an instrument to MTRANS. – See is MTRANS to CP from eye by instrument of ATTEND eye to object. – Listen is ATTEND ear
  • 52. Deepak Khemani Conceptual Dependency Theory 52 Linguistically the spoon is the instrument with which John ate. Instruments John ate the ice cream with a spoon INGEST ice cream p John John do I o spoon At a conceptual level the act of eating is enabled by an instrumental act that uses the spoon as an object. Note: arrow meant for ACT
  • 53. Deepak Khemani Conceptual Dependency Theory 53 Eating with a spoon INGEST ice cream p John John TRANS I o spoon R ice cream mouth John POSS-BY ice cream CONT The instrumental act is TRANS of spoon containing ice-cream towards John's mouth.
  • 54. Deepak Khemani Conceptual Dependency Theory 54 Instrumental Acts Every ACT can have an instrumental ACT. For example, John ingested the icecream, by TRANSing the spoon towards his mouth, which he did by grasping the spoon and then moving his hand, by flexing his muscles, by thinking about flexing his muscles, … … we truncate our causal reasoning and instrumental case specification at a granularity suited to our task. In any domain that we build a conceptual representation system for we will have to choose an appropriate level for primitive actions.
  • 55. Deepak Khemani Conceptual Dependency Theory 55 John was sad because Mary hit him John sad Mary hit John o p Another example of an ACT causing a state change. Not a CD Act ! In CD theory hit would be modeled as coming into a state of being in forceful contact, with PROPEL being the basic ACT and MOVE the instrumental ACT.
  • 56. Deepak Khemani Conceptual Dependency Theory 56 Events can cause other events When Fred gave Mary a peach she ate it. Fred Trans peach p R Mary Fred Mary Ingest peach p In the conceptualizations we are looking at there are events in which Actors execute some Acts
  • 57. Deepak Khemani Conceptual Dependency Theory 57 State change "verbs" John killed his teacher. p John DO dead p teacher alive John POSS-BY In state change verbs the linguistic verbs often focus on the state change while ignoring the action.
  • 58. Deepak Khemani Conceptual Dependency Theory 58 State change "verbs" p Adora DO Health(-10) p cockroach Health(>-10) indefinite p Adora DO LOC(corner) p television LOC(?) definite Adora killed a cockroach Adora moved the table to the corner
  • 59. Deepak Khemani Conceptual Dependency Theory 59 Being more specific John killed his teacher by shooting him in the head. p John propel p teacher dead alive John POSS-BY bullets R gun head teacher
  • 60. Deepak Khemani Conceptual Dependency Theory 60 Flying… Sam flew his plane to San Francisco p Sam do plane Sam POSS-BY fly D S.F.
  • 61. Deepak Khemani Conceptual Dependency Theory 61 Comforting John comforted Mary p John do Mary comfortable
  • 62. Deepak Khemani Conceptual Dependency Theory 62 Since smoking can kill you, I stopped. p one INGEST p one dead alive smoke R cigarette one c I tFp INGEST smoke R cigarette I
  • 63. Deepak Khemani Conceptual Dependency Theory 63 While going home I saw a frog I go D house I I see frog POSS-BY p
  • 64. Deepak Khemani Conceptual Dependency Theory 64 Conceptual tenses • P past • f future • t transition • ts transition start • tf transition finished • k continuing • ? Interrogative • / negative • c potential • nil present • Δ timeless
  • 65. Deepak Khemani Conceptual Dependency Theory 65 Yesterday, the boy in the chair hit the boy on the piano in the mouth in the park. à boy1 hit mouth yesterday park LOC chair boy2 POSS-BY LOC piano à à specific specific à specific
  • 66. Deepak Khemani Conceptual Dependency Theory 66 Separating Action and State I like books Books please me. I do books I pleased
  • 67. Deepak Khemani Conceptual Dependency Theory 67 Thinking actions prevent x do do y instigate x do do y i Cannot c
  • 68. Deepak Khemani Conceptual Dependency Theory 68 Transitive verbs are causal relations hurt x do hurt y x do comfortableMENT y t comfort Mental state
  • 69. Deepak Khemani Conceptual Dependency Theory 69 I comforted John I do comfortableMENT t p John
  • 70. Deepak Khemani Conceptual Dependency Theory 70 A more complete probabilistic analysis p I say z R I john p comfortableMENT upset John ^ I physcont John p gentle à I comforted John Soothing words?
  • 71. Deepak Khemani Conceptual Dependency Theory 71 A more specific sentence… p I trans t food R I john John ingest food comfortableMENT upset John I comforted John by feeding him. Note : Giving food leads to eating food leads to becoming comfortable
  • 72. Deepak Khemani Conceptual Dependency Theory 72 A general threat threaten x communicate y believe i y do do x hurt y t cf Note : Y comes to BELIEVE that if Y does something … it is modeled as Y in fact getting threatened.
  • 73. Deepak Khemani Conceptual Dependency Theory 73 A general threat threaten x MTRANS y CONC i y doY doX x HEALTH(<0) y t cf
  • 74. Deepak Khemani Conceptual Dependency Theory 74 A specific threat I threatened him with a broken nose communicate he believe i he doX doy I broken nose t I p I doy R he I nose broken cf he he POSS-BY poss by
  • 75. Deepak Khemani Conceptual Dependency Theory 75 Another explicit threat I threatened him with a hammer. communicate he believe i he do do I hurt he t p I do cf I f he I R hammer he I D hammer he I D
  • 76. Deepak Khemani Conceptual Dependency Theory 76 Advise communicates belief of speaker advise communicate x x y x R believe y y dox pleased cf
  • 77. Deepak Khemani Conceptual Dependency Theory 77 Some eating advise I advised him to try the twice cooked pork communicate I p I believe R he I INGEST c he pork à twice cooked pleased he t cf
  • 78. Deepak Khemani Conceptual Dependency Theory 78 Liking ice cream INGEST ice cream f x f pleased x conceptualize x x INGEST x pleased f f ice cream No thought component! X thinks that X will be pleased if X eats ice cream
  • 79. Deepak Khemani Conceptual Dependency Theory 79 Liking ice cream INGEST ice cream f x f pleased x CONC Abasi Abasi INGEST Abasi pleased f f ice cream No thought component!
  • 80. Deepak Khemani Conceptual Dependency Theory 80 Want has a specific time sense x do pleased y want Now For example
  • 81. Deepak Khemani Conceptual Dependency Theory 81 Past and future I wanted it conceptualize I x do I pleased cf p past future
  • 82. Deepak Khemani Conceptual Dependency Theory 82 realization John wants it but he doesn't realize it conceptualize speaker x do John pleased cf conceptualize John x do John pleased cf ^ Somebody has to realize it if it is to be mentioned!
  • 83. Deepak Khemani Conceptual Dependency Theory 83 Unwareness He hit Bill’s car but he doesn’t know it. he hit car p Bill POSS-By conceptualize ^ he hit car Bill POSS-By he
  • 84. Deepak Khemani Conceptual Dependency Theory 84 Remembering is thinking about I remember the time we ate oysters. I conceptualize we INGEST I I T1 oysters p MTRANS INGEST oysters We R LTM CP Poss-by POSS-BY I I Remembering BY Mtransing it from LTM to CP (conscious processor)
  • 85. Deepak Khemani Conceptual Dependency Theory 85 MTRANS – transferring info - "mental" communicate MTRANS y R x y say to / tell MTRANS y R x y I y speak “words” x y say to / tell
  • 86. Deepak Khemani Conceptual Dependency Theory 86 Movement of info within Perceive MTRANS y R IM CP Learn MTRANS y R CP sense-organ Immediate Memory
  • 87. Deepak Khemani Conceptual Dependency Theory 87 Forgetting is being unable to remember MTRANS y R CP LTM remember forget MTRANS y R CP LTM c
  • 88. Deepak Khemani Conceptual Dependency Theory 88 Seeing as conceptualizing I saw John eating soup. I CONC INGEST I MTRANS I LOOK AT p John,soup p John soup p John ingest soup eyes CP R I I
  • 89. Deepak Khemani Conceptual Dependency Theory 89 To Conceptualize is to Ponder consider x CONC f ponder x CONC dream x CONC asleep x while wonder x CONC ?
  • 90. Deepak Khemani Conceptual Dependency Theory 90 Love and hate are states love x CONC hate x y s hate x CONC love x y s
  • 91. Deepak Khemani Conceptual Dependency Theory 91 Think – another sense I believe that John is a fool I think that John is a fool John fool LOC(M) POSS-BY I The conceptualization "John is a fool" is located in my memory.
  • 92. Deepak Khemani Conceptual Dependency Theory 92 Kasparov brilliant LOC(IM) POSS-BY I CONC I brilliant Kasparov
  • 93. Deepak Khemani Conceptual Dependency Theory 93 ACTIONS: Inputs to Understanding • Goals and Plans are not linguistic entities • Instead they form Knowledge Structures • Goals and Plans are often not stated explicitly • Instead what we see is a sequence of Actions • For example, designing a game playing agent : For an intelligent game agent, actions are your keyboard strokes… it needs to understand your intentions from them. Software agents have to make sense of information coming via the keyboard or some other medium.
  • 94. Deepak Khemani Conceptual Dependency Theory 94 Kasparov brilliant LOC(IM) POSS-BY I CONC I brilliant Kasparov MTRANS I D Match Venue CP I Kasparov ! Anand POSS-BY I Play Chess
  • 95. Deepak Khemani Conceptual Dependency Theory 95 Kasparov brilliant LOC(IM) POSS-BY I CONC I brilliant Kasparov MTRANS I D Match Venue CP I Kasparov ! Anand POSS-BY I Play Chess MBUILD I brilliant Kasparov
  • 96. Deepak Khemani Conceptual Dependency Theory 96 Believes Fred believes John. MTRANS John R John Fred I LOC(M) POSS-BY Fred I Fred tells something to John, and John puts it in his memory.
  • 97. Deepak Khemani Conceptual Dependency Theory 97 Believes – as in agrees with Fred believes John. MTRANS John R John one LOC(M) POSS-BY Fred > I I John is saying something (to someone) and Fred also believes that.
  • 98. Deepak Khemani Conceptual Dependency Theory 98 But Fred must "put" it in his memory MTRANS John R John CP I CONC Fred I Poss-by Fred MBUILD Fred R CP IM I Poss-by Fred Poss-by Fred I LOC(IM) POSS-BY Fred Deciding to believe it, Fred must create the structure in his memory
  • 99. Deepak Khemani Conceptual Dependency Theory 99 Modeling inferences Conclude – infer Fx from F1, F2, … MBUILD o x x 1 2 > … R IM IM
  • 100. Deepak Khemani Conceptual Dependency Theory 100 Physical actions in CD MOVE own body part PROPEL something else INGEST input EXPEL output PTRANS change of location GRASP grasp If a PTRANS happens then infer that (1) the object ceases to be at the origin location and (2) exists at destination location. Likewise in ATRANS, but not in MTRANS (except when donor is CP)
  • 101. Deepak Khemani Conceptual Dependency Theory 101 PTRANS I D cafeteria I tr I I MOVE p feet cafeteria D I POSS BY I walked to the cafeteria The key act is PTRANS. Infer that I am at cafeteria MOVE is instrumental act
  • 102. Deepak Khemani Conceptual Dependency Theory 102 John threw a rock at Sam PTRANS D Sam rock P I John PROPEL p rock Sam D air John John John Throw = PTRANS in air by doing PROPEL
  • 103. Deepak Khemani Conceptual Dependency Theory 103 John threw a rock at Sam PTRANS D Ayumu pencil P I Adriana PROPEL p pencil Ayumu D air Adriana Adriana Adriana
  • 104. Deepak Khemani Conceptual Dependency Theory 104 John threw the pencil to Sam. Throw to – is an instrumental act for ATRANS ATRANS R Sam pencil P I John PTRANS p pencil Sam D air John John John PROPEL D Sam pencil P John John I
  • 105. Deepak Khemani Conceptual Dependency Theory 105 PROPEL D Mary X p John John PHYSCONT Mary > X John hit Mary Hit with something. PROPEL that something so that it comes into (hard) contact
  • 106. Deepak Khemani Conceptual Dependency Theory 106 PROPEL D Mary fist P I John MOVE fist Mary D John John POSS-BY John PHYSCONT Mary > fist John POSS-BY John John punched Mary
  • 107. Deepak Khemani Conceptual Dependency Theory 107 More violence… John hit Mary by throwing a stick at her. PROPEL D Mary stick P I John MOVE hand Mary D John John CONT stick PHYSCONT Mary > stick John John air P > John GRASP tr POSS-BY
  • 108. Deepak Khemani Conceptual Dependency Theory 108 A car hit Mary. PROPEL D Mary car P * PHYSCONT Mary > car
  • 109. Deepak Khemani Conceptual Dependency Theory 109 I moved the table to the corner. table corner I do table It could be possible that I PTRANSed the table by using PROPEL, but it could also be possible that I told someone to move it…
  • 110. Deepak Khemani Conceptual Dependency Theory 110 p I MOVE meat slices whole POSS-BY hand D in meat I knife CONT back & forth I GRASP knife hand D I I POSS-BY I sliced the meat with a knife.
  • 111. Deepak Khemani Conceptual Dependency Theory 111 Conceptual Analysis I want to go to the park with the girl. cf pleased x cf vs vt x y human x y human physobj want ATRANS R X Y one pleased x one cf cf
  • 112. Deepak Khemani Conceptual Dependency Theory 112 "want" – a third sense vt x y human human want PTRANS D here Y Y pleased x cf cf The first sense of want – state verb – is chosen. The parser is now on the lookout for a complete conceptualization to fill in.
  • 113. Deepak Khemani Conceptual Dependency Theory 113 I want TO GO… go PTRANS D someplace x x vio animal PTRANS D someplace x one vio physobj x
  • 114. Deepak Khemani Conceptual Dependency Theory 114 "to go" fulfills expectation of conceptualization PTRANS D “place” I I cf PTRANS D park1 I I pleased I cf cf I want.. pleased I cf cf …to go… …the park… …the park…
  • 115. Deepak Khemani Conceptual Dependency Theory 115 …with the girl Examples, 1. I went with a book to the park 2. I went to the park with the playground 3. I went with the girl to the park 4. I hit the boy with the bat 5. I hit the boy with the girl 6. I hit the boy with vengeance "with PP" has many conceptual possibilities. 1. PP is object of instrumental case (4) 2. PP is additional actor of the conceptualization (3) 3. PP is an attribute of PP immediately preceding it (1,2,5) 4. PP is an attribute of the actor of the conceptualization (1,6)
  • 116. Deepak Khemani Conceptual Dependency Theory 116 PTRANS D park I I pleased I cf cf specific girl > specific girl > specific I want to go to the park with the girl.
  • 117. Deepak Khemani Conceptual Dependency Theory 117 Conceptual semantics The boy ate a book INGEST X Y X in eat: vt X Y animal food INGEST boy boy p book * in o Given that there is no other word sense for eat, one has no choice… but one can mark the conceptualization is semantically inconsistent
  • 118. Deepak Khemani Conceptual Dependency Theory 118 John ate the steak with the odor INGEST John John steak in D smell:odor 1. PP is object of instrumental case 2. PP is additional actor of the conceptualization 3. PP is an attribute of PP immediately preceding it 4. PP is an attribute of the actor of the conceptualization First one that fits semantically
  • 119. Deepak Khemani Conceptual Dependency Theory 119 John ate the steak with the fork INGEST John John steak fork D I PTRANS fork mouth D John POSS-BY in John 1. PP is object of instrumental case 2. PP is additional actor of the conceptualization 3. PP is an attribute of PP immediately preceding it 4. PP is an attribute of the actor of the conceptualization First one that fits semantically First one that fits semantically
  • 120. Deepak Khemani Conceptual Dependency Theory 120 PROPEL girl John bullet rifle D I PROPEL bullet girl D rifle rifle PHYSCONT girl > bullet 1. PP is object of instrumental case 2. PP is additional actor of the conceptualization 3. PP is an attribute of PP immediately preceding it 4. PP is an attribute of the actor of the conceptualization He shot the girl with a rifle But, he could have been a photographer! In the verb-ACT dictionary "shoot" = PROPEL bullets from gun!
  • 121. Deepak Khemani Conceptual Dependency Theory 121 Syntactic ambiguity Syntactic ambiguity has always been a problem in NLP. Remember Kuno and Oettinger's "Time flies like an arrow". Consider a sentence, I saw the Grand Canyon flying to New York. Most people are unwilling to accept a flying Grand Canyon and construct an appropriate structure in which one event marks the time of another. ELI also does this because it uses semantic information.
  • 122. Deepak Khemani Conceptual Dependency Theory 122 Seeing see MTRANS x R IM CP Poss-by x Poss-by x human vi vs MTRANS x R CP Poss-by x I LOOK-AT y x animal Understand, perceive
  • 123. Deepak Khemani Conceptual Dependency Theory 123 See MTRANS x R CP Poss-by x animal vt y BE physobj I LOOK-AT y x
  • 124. Deepak Khemani Conceptual Dependency Theory 124 I saw the Grand Canyon… I saw the Grand Canyon flying to New York. MTRANS I Grand Canyon I LOOK-AT Grand Canyon I R CP eye Poss-by Poss-by I I
  • 125. Deepak Khemani Conceptual Dependency Theory 125 … flying (fly has three senses) fly PTRANS D X I X PROPEL X D air X bird, plane, insect vio Birds, planes and insects can fly….
  • 126. Deepak Khemani Conceptual Dependency Theory 126 Or humans can fly planes PROPEL D Y y DO x vt air human plane
  • 127. Deepak Khemani Conceptual Dependency Theory 127 Or humans can fly in planes PTRANS D X I plane PROPEL plane D air X human vio
  • 128. Deepak Khemani Conceptual Dependency Theory 128 I saw the Grand Canyon flying to New York MTRANS I Grand Canyon I LOOK-AT Grand Canyon I R IM eye PTRANS D I I plane PROPEL plane D air I NY NY p p while plane LOC "I" am the only subject in the sentence, so the second or third form of fly must be used …. An English specific rule says that the second conceptualization marks the time of the first one.
  • 129. Deepak Khemani Conceptual Dependency Theory 129 I saw the Grand Canyon flying to New York MTRANS I Grand Canyon LOOK-AT Grand Canyon I IM eye PTRANS D I I plane PROPEL plane D air I NY NY p p while plane LOC I CONT I
  • 130. Deepak Khemani Conceptual Dependency Theory 130 Semantic Ambiguity fill vt PTRANS x “liquid” R y liquid Q Q c CONT human container PTRANS one “liquid” R y liquid Q Q c CONT container physobj I one x do vt
  • 131. Deepak Khemani Conceptual Dependency Theory 131 Semantic Ambiguity The old man’s glasses were filled with sherry. Glasses in the sense of containers! PTRANS one sherry D glasses Q Q c CONT p "the old man" POSS-BY
  • 132. Deepak Khemani Conceptual Dependency Theory 132 Syntactic similarity John’s love of Mary was harmful. John CONC love John Mary s one hurt John’s can of beans was edible. one INGEST beans c can John CONT-BY POSS-BY
  • 133. Deepak Khemani Conceptual Dependency Theory 133 End
  • 134. Deepak Khemani Conceptual Dependency Theory 134 Poss-by Loc Cont I R D
  • 135. Deepak Khemani Conceptual Dependency Theory 135 Symbols Poss-by Loc Cont D LOC LOC ACT R ACT PP PP I ACT PP ACT PP PP T LOC PP ACT