← Back to team overview

commonsense team mailing list archive

[Bug 445125] Re: non-normalized concepts exist

 

And they're not the Verbosity import, at least not all of them. Here's a
sample:

communicate verbally
may be charming, but they can also be expensive to heat
take the path less taken
probably got the book at the library
the statement 'visa is one credit card' helps answer the question 'what
no one else will take care of them
getting loved
can't sleep during the day
when a saw
express repressed feelings
getting bored easily
statement 'a criminal is likely to have a weapon.' helps answer the question 'what

Though part of the issue may be that we changed normalization. For example, the last phrase's concept text is:
"statement 'a criminal likely weapon.' help answer question 'what"

but en_nl.normalize(that) is:
"statement criminal likely weapon help answer question"

(this ignoring the utter uselessness of that concept..., for the purpose
of example)

-- 
non-normalized concepts exist
https://bugs.launchpad.net/bugs/445125
You received this bug notification because you are a member of
Commonsense Computing, which is the registrant for ConceptNet.

Status in ConceptNet API: New

Bug description:
I noticed that some concepts seem to be not normalized:

>>> Concept.get('balls', 'en')
<Concept: <en: balls>>
>>> Concept.get('ball', 'en')
<Concept: <en: ball>>
>>> Concept.get('balls', 'en').surfaceform_set.all()[0]
<SurfaceForm: balls>
>>> Concept.get('balls', 'en').get_assertions().count()
45

Where'd that come from?



References