Topic Modeling

There are more things in heaven and earth, Horatio, Than are dreamt of in your philosophy.
Post Reply
User avatar
Enki
Posts: 5052
Joined: Thu Dec 22, 2011 6:04 pm

Topic Modeling

Post by Enki »

http://tedunderwood.com/2012/04/07/topi ... le-enough/
Topic modeling is a way of extrapolating backward from a collection of documents to infer the discourses (“topics”) that could have generated them. (The notion that documents are produced by discourses rather than authors is alien to common sense, but not alien to literary theory.) Unfortunately, there is no way to infer the topics exactly: there are too many unknowns. But pretend for a moment that we had the problem mostly solved.
This is an introduction to Natural Language Processing that explains the concepts without going into the math behind Latent Dirichlet Allocation
Men often oppose a thing merely because they have had no agency in planning it, or because it may have been planned by those whom they dislike.
-Alexander Hamilton
noddy
Posts: 11325
Joined: Tue Dec 13, 2011 3:09 pm

Re: Topic Modeling

Post by noddy »

this stuff is in my huge list of "things id love to spend some time playing with but struggle to milk enough hours out of the day" (tm)

http://nltk.org/ is a free one that seems worth playing with.
ultracrepidarian
User avatar
Enki
Posts: 5052
Joined: Thu Dec 22, 2011 6:04 pm

Re: Topic Modeling

Post by Enki »

I made a comment about n-grams on Facebook and had my decision to be friends with relative strangers validated when someone offered to go to lunch and talk about NLP. He worlds in the field. So I will be having lunch on the topic today.
Men often oppose a thing merely because they have had no agency in planning it, or because it may have been planned by those whom they dislike.
-Alexander Hamilton
Post Reply