ChineseTextClassification
Ji Chong Wen Ben Fen Lei Fang Fa
1, Qian Yan
Gang Kai Shi Jie Hong NLP,Xuan Ze Cong Zui Ji Chu De Wen Ben Fen Lei Ru Shou ,Wan Quan Xiao Bai Yi Ge ,Yi Kai Shi Lian Ru He Chu Li Shu Ju Du Bu Zhi Dao , TensorFlowYe Bu Hui ,Zai Xie Dai Ma De Guo Cheng Zhong ,Ye Can Kao Liao Hen Duo Bie Ren De Dai Ma ,You Qi Gan Xie gaussic ,Ta De Dai Ma Gei Liao Wo Hen Da Hen Da De Bang Zhu .
PS.Hen Duo Xi Jie Mei Bu Chong ,Shang Chuan De Wen Jian Ke Neng Ye You Wen Ti ,You Shi Jian Hui Ji Xu Bu Chong , Gai Zheng ,Huan Ying Ti Jiao issue.
2, Huan Jing
- Python3.6
- TensorFlow 1.3
- numpy
- scikit-learn
- jieba
3, Shu Ju Ji
THUCNews
THUCNewsShi Gen Ju Xin Lang Xin Wen RSSDing Yue Pin Dao 2005~2011Nian Jian De Li Shi Shu Ju Shai Xuan Guo Lu Sheng Cheng ,Ben Ci Shi Yan Xuan Qu Ti Yu , Cai Jing , Jia Ju , Jiao Yu , Ke Ji , Shi Shang , Shi Zheng , You Xi , Yu Le Gong 9Ge Lei Bie ,Mei Ge Lei Bie Xuan Qu 5000Ge Yang Ben .
Fu Dan Zhong Wen Wen Ben Fen Lei Yu Liao
You Fu Dan Da Xue Ji Suan Ji Xin Xi Yu Ji Zhu Xi Guo Ji Shu Ju Ku Zhong Xin Zi Ran Yu Yan Chu Li Xiao Zu Fa Bu ,Bao Han Art, Literature , Economy, SportsDeng 20Ge Lei Bie ,Fen Wei Xun Lian Ji He Ce Shi Ji Liang Ge Shu Ju Ji ,Fen Bie Bao Han 9804He 9833Pian Wen Dang .
Shu Ju Yu Chu Li
Zhi Ti Qu Wen Dang Zhong De Zhong Wen Zi Fu ,Shi Yong jiebaJin Xing Fen Ci ,Ran Hou Qu Ting Yong Ci .
Dui THUCNewsAn Zhao 0.7:0.1:0.2De Bi Li Jiang Shu Ju Ji Hua Fen Cheng Xun Lian Ji , Yan Zheng Ji , Ce Shi Ji .
You Yu Fu Dan Zhong Wen Wen Ben Fen Lei Yu Liao Zhi Bao Han Xun Lian Ji He Ce Shi Ji ,Gu Cong Xun Lian Ji Zhong Xuan Qu 0.1De Wen Dang Zuo Wei Yan Zheng Ji ,Zui Zhong Xun Lian Ji Bao Han 8088Pian Wen Dang , Yan Zheng Ji Bao Han 989Pian Wen Dang , Ce Shi Ji Bao Han 9825Pian Wen Dang . Fen Bu Ru Xia :
| Ce Shi Ji | Yan Zheng Ji | Xun Lian Ji |
|---|---|---|
| Art | 666 | 74 |
| Literature | 29 | 4 |
| Economy | 1440 | 160 |
| Mine | 29 | 4 |
| Sports | 1127 | 126 |
| History | 419 | 47 |
| Computer | 1215 | 135 |
| Transport | 51 | 6 |
| Energy | 28 | 4 |
| Politics | 921 | 103 |
| Space | 576 | 64 |
| Communication | 22 | 3 |
| Agriculture | 918 | 103 |
| Education | 53 | 6 |
| Military | 66 | 8 |
| Electronics | 24 | 3 |
| Medical | 45 | 6 |
4, Mo Xing Jie Shao
Suo You Mo Xing Du Mei Shi Yong Yu Xun Lian De Ci Xiang Liang ,Can Shu Ye Mei You Zi Xi Diao Guo ,Mo Xing Xing Neng Wei Da Dao Zui You ,Jie Guo Jin Gong Can Kao .
SVM
Qu Diao Di Pin Ci (Pin Lu Di Yu 3),Shi Yong Xin Xi Zeng Yi Xuan Ze Te Zheng Ci ,Ran Hou Yong TF-IDFZuo Wei Quan Zhong ,Shi Yong scikit-learnDe SVCMo Xing Xun Lian .
Zhe Ge Mu Qian Zai Xuan Ze Te Zheng Ci De Shi Hou You Ge Xiao BUG,Yin Wei Shi Mei Ge Lei Bie Ti Qu nGe Te Zheng Ci ,You Yu Dai Ma Shi Xian Yuan Yin Ru Guo Zhe Ge Lei Bie De Te Zheng Ci De Ge Shu n,Ze Jiang Hui Ba Suo You De Ci Quan Bu Xuan Ru ,Zhe Ge You Shi Jian Hui Geng Xin .
TextCNN
Ji Yu Zhe Pian Lun Wen Ti Chu De Mo Xing Convolutional Neural Networks for Sentence Classification
CharCNN
Zuo Liao Liang Ge Mo Xing
-
char_cnn_modelShi Yong De Mo Xing Can Kao Liao gaussicShi Yong De Mo Xing ,Zai EmbeddingCeng Hou Jia Liao Yi Ge Juan Ji Ceng , Max PoolingCeng He SoftmaxCeng .
-
char_cnn_model2Shi Yong De Mo Xing Shi Character-level Convolutional Networks for Text Classification Suo Shu De Mo Xing .
RNN
Bao Gua 4Ge Mo Xing
-
text_rnn_modelYe Shi Can Kao Liao gaussicShi Yong De RNNMo Xing , Shi Yong Liao Shuang Ceng De LSTMBa Zui Hou Yi Ge StepDe Shu Chu Zhi Jie Song Ru SoftmaxCeng Jin Xing Fen Lei .
-
text_bilstm_modelShi Wo Zai Zuo Wan CNNHe RNNDe Shi Yan Hou ,Xiang Dao De ,Jiu Shi Liao Yi Xia ,Ye Mei Qu Cha Shi Fou You Ren Zhe Yao Zuo Guo , Shi Yong Shuang Xiang LSTM,Jiang Mei Ge StepQian Xiang He Hou Xiang De Shu Chu Pin Jie Qi Lai ,Song Ru Yi Ge Juan Ji Ceng ,Ran Hou Shi Yong Max Pooling,Zui Hou Song Ru SoftMax.
-
text_rcnn_modelShi Can Kao Liao Zi Dong Hua Suo NLPRDe Xue Sheng Fa Biao Zai AAAI2015Shang De Yi Pian Wen Zhang Recurrent Convolutional Neural Networks for Text Classification.
-
text_dnn_modelCan Kao Liao Ha Gong Da Xun Fei Lian He Shi Yan Shi Fa Biao Zai ACL2018Shang De Disconnected Recurrent Neural Networks for Text Categorization Gan Jue Zi Ji Fu Xian De You Xie Wen Ti ,Huan Zai Gai Jin Zhong ,Bu Guo Mu Qian Fa Xian Zhe Ge Mo Xing Zai Chu Li Chang Wen Ben Shi ,Fei Chang Hao Shi .
5, Shi Yan Jie Guo
Error-RCNNShi Wo Yi Kai Shi Fu Xian RCNNDe Shi Hou ,Cuo Wu De Jiang BiLSTMDe Yi Ceng MLPLi Jie Cheng Juan Ji Ceng ,Shi Yong Da Xiao Wei 1De window sizePao Chu De Jie Guo ,Jing Ran Bi Shi Yong MLPXiao Guo Geng Hao ,Mu Qian Bu Que Ding Shi Fou Shi Ou Ran Yin Su ,Hui Jin Yi Bu Jin Xing Shi Yan ,Xun Zhao Yuan Yin .
Zui Hou Liang Xing Dai *Hao De Wei Recurrent Convolutional Neural Networks for Text Classification Zhe Pian Lun Wen Zhong Zuo Zhe Shi Yong CNNHe RCNNDe Dao Jie Guo (Zuo Zhe Shi Yong Liao Yu Xun Lian De Ci Xiang Liang )