{"id":90,"date":"2020-12-03T09:19:10","date_gmt":"2020-12-03T09:19:10","guid":{"rendered":"http:\/\/dmslab.hkg03.bdysite.com\/?page_id=90"},"modified":"2023-01-17T15:29:39","modified_gmt":"2023-01-17T15:29:39","slug":"keyword-extraction","status":"publish","type":"page","link":"http:\/\/dmslab.net\/?page_id=90","title":{"rendered":"Keyword extraction"},"content":{"rendered":"\n

Keyword extraction by entropy difference between the intrinsic and extrinsic mode<\/strong><\/h2>\n\n\n\n

We strive to propose a new metric to evaluate and rank the relevance of words in a text. The method uses the Shannon\u2019s entropy difference between the intrinsic and extrinsic mode, which refers to the fact that relevant words significantly reflect the author\u2019s writing intention, i.e., their occurrences are modulated by the author\u2019s purpose, while the irrelevant words are distributed randomly in the text. By using The Origin of Species by Charles Darwin as a representative text sample, the performance of our detector is demonstrated and compared to previous proposals. Since a reference text \u2018\u2018corpus\u2019\u2019 is all of an author\u2019s writings, books, papers, etc. his collected works is not needed. Our approach is especially suitable for single documents of which there is no a priori information available.<\/p>\n\n\n\n