How to identify tags (key words) automatically from a given text?

Question

It should behave like Delicious toolbar for Firefox does; it lists possible tags to click. The effect is shown as below:

The code should be able to find key words for the text. Any good algorithm or open source project to recommend?

I found this post, but it is a bit too general for my specific need.

Katabatic

OK, I think you need to be a little more specific than just "it lists possible tags to click"... delicious is a bookmarking service and the the question you referenced is for data-mining/text-mining. What are you trying to achieve? – Jaala

edited. I wish the question to be clearer now.. – Katabatic

I thought that these tags are sampled from the tags that other people has already bookmarked on this URL. – Levey

Answer 1

I think you're looking for one of these answers,

• tag generation from a text content
• How to extract common / significant phrases from a series of text entries
• tag generation from a small text content (such as tweets)

In a nutshell - you're looking to extract unigrams from the text that somehow represent the concepts within it - a technique to do this is called Pointwise Mutual Information, which is illustrated with an example in the first two links. Using the Python NLTK framework (which already has a bunch of these algorithms built in) might be your best starting point to work off from.

Good luck!

Broadbrim

This is by far the most helpful answer for this question. Thanks. – Katabatic

Thanks! In case you found the answer useful - you might want to accept it. – Broadbrim