4. Learning slot-argument links

Using the previously explained learning mechanisms, the agent has acquired a number of item-based and lexical constructions. This learning mechanism covers the cases where previosuly acquired constructions cover the observed utterance, but where the slot-and-argument combination has not been observed before. In such cases, the agent simply adds the slot-argument link to the categorial network.

Interaction 10

The tutor is the speaker.

The learner is the listener.

Current Scene:

Topic:

cube
shape-category

Question: "What shape is the big gray object?"

Comprehending "What shape is the big gray object?"

Applying
HASHED FCG CONSTRUCTION SET (6)
g2big-3541what-material-is-the-?x-cube-152->10.305gray-31405->10.300cyan-39991->00.103what-shape-is-the-?y-?x-object-(?y)-103->20.204what-shape-is-the-?y-?x-object-(?x)-104->00.20
in comprehension

Evaluating irl program

irl program
((bind attribute-category ?attribute-353 shape) (query ?answer-229 ?source-object-257 ?attribute-353) (unique ?source-object-257 ?source-set-569) (filter ?source-set-569 ?source-set-570 ?category-379) (filter ?source-set-570 ?source-set-548-20 ?category-363-20) (get-context ?source-set-548-20) (bind color-category ?category-363-20 gray) (bind size-category ?category-379 large))
gstruct0(bindattribute-category?attribute-353shape)struct1(query?answer-229?source-object-257?attribute-353)struct0:varATTRIBUTEdash3531->struct1:varATTRIBUTEdash3532struct2(unique?source-object-257?source-set-569)struct1:varSOURCEdashOBJECTdash2572->struct2:varSOURCEdashOBJECTdash2573struct3(filter?source-set-569?source-set-570?category-379)struct2:varSOURCEdashSETdash5693->struct3:varSOURCEdashSETdash5694struct4(filter?source-set-570?source-set-548-20?category-363-20)struct3:varSOURCEdashSETdash5704->struct4:varSOURCEdashSETdash5705struct7(bindsize-category?category-379large)struct3:varCATEGORYdash3794->struct7:varCATEGORYdash3798struct5(get-context?source-set-548-20)struct4:varSOURCEdashSETdash548dash205->struct5:varSOURCEdashSETdash548dash206struct6(bindcolor-category?category-363-20gray)struct4:varCATEGORYdash363dash205->struct6:varCATEGORYdash363dash207

Applying



on the ontology

evaluation process

Solutions:

solution 1
?answer-229
shape-category
score: 1.000
?attribute-353
attribute-category
score: 1.000
?category-363-20
color-category
score: 1.000
?category-379
size-category
score: 1.000
?source-set-548-20
clevr-scene
score: 1.000
?source-set-570
clevr-object-set
score: 1.000
?source-set-569
clevr-object-set
score: 1.000
?source-object-257
clevr-object
score: 1.000

initial structure
application process
applied constructions
resulting structure

Meaning:

gstruct0(bindattribute-category?attribute-353shape)struct1(query?answer-229?source-object-257?attribute-353)struct0:varATTRIBUTEdash3531->struct1:varATTRIBUTEdash3532struct2(unique?source-object-257?source-set-569)struct1:varSOURCEdashOBJECTdash2572->struct2:varSOURCEdashOBJECTdash2573struct3(filter?source-set-569?source-set-570?category-379)struct2:varSOURCEdashSETdash5693->struct3:varSOURCEdashSETdash5694struct4(filter?source-set-570?source-set-548-20?category-363-20)struct3:varSOURCEdashSETdash5704->struct4:varSOURCEdashSETdash5705struct7(bindsize-category?category-379large)struct3:varCATEGORYdash3794->struct7:varCATEGORYdash3798struct5(get-context?source-set-548-20)struct4:varSOURCEdashSETdash548dash205->struct5:varSOURCEdashSETdash548dash206struct6(bindcolor-category?category-363-20gray)struct4:varCATEGORYdash363dash205->struct6:varCATEGORYdash363dash207

Comprehension succeeded

Interpretation finished

Computed answer:

cube
shape-category

Alignment started

The following cxns are rewarded:

gray-cxn-14 (non-holophrase 0.70) show attributes
big-cxn-18 (non-holophrase 0.70) show attributes
what-shape-is-the-?y-?x-object-cxn-10 (non-holophrase 0.60) show attributes

Interaction succeeded

Back to top of this page.

Back to the main page.