![]() Here are some actual probabilities from a 6 billion word corpus:Īs one might expect, ice co-occurs more frequently with solid than it does with gas, whereas steam co-occurs more frequently with gas than it does with solid. For example, consider the co-occurrence probabilities for target words ice and steam with various probe words from the vocabulary. The main intuition underlying the model is the simple observation that ratios of word-word co-occurrence probabilities have the potential for encoding some form of meaning. ![]() GloVe is essentially a log-bilinear model with a weighted least-squares objective.
0 Comments
Leave a Reply. |