Docket Number:05T-891002
Inventor:Keh-Jiann Chen
IP Status:Know-how
Abstract:
Keywords occurred in the documents and most of them are unknown words, such as names of the people, organizations, products, contracts… etc. Therefore automatic identification of the keywords in a Chinese text is a very difficult task.
The application we develop can extract the keywords with high precision. Through incorporating our Chinese word segmentation method with the text processing application, we built a program having the function of unknown word identification and part-of-speech tagging. The system contains a 100,000-entry lexicon with pos tags, word frequencies, pos tag bigram information, etc. The word segmentation process is based on the lexicons, morphological rules for quantifier words and reduplicated words. Pos tagging is for both known and unknown words.
Fields of Application:
- Chinese information retrieval
- Automatic document classification
- Chinese word segmentation system
Advantages when compared to the existing technologies:
- The system can extract both high frequency and low frequency unknown words.
- It can identify both common words and proper names.
- The system performs with high precision and high recall.
Contact Person:
對本技術有興趣,請於本處網頁廠商選項下(廠商需求與諮詢)網頁填寫資料,承辦人將跟您聯絡。
If you are interested in this technology, please fill in the information on the webpage under the manufacturer option (Apply for Technology Licensing, Material Transfer, or Sponsored Research) on the website of this office, and the undertaker will contact you
