Our paper is published on IEEE/ACM International Symposium on Quality of Service (IWQoS 2017,) and IEEE Access 2020. The information can be found here:

• Shenglin Zhang, Weibin Meng, Jiahao Bu, Sen Yang, Ying Liu, Dan Pei, Jun(Jim) Xu, Yu Chen, Hui Dong, Xianping Qu, Lei Song. Syslog Processing for Switch Failure Diagnosis and Prediction in Datacenter Networks. Vilanova i la Geltru, Barcelona, Spain, 14-16 June 2017.paper link
• Shenglin Zhang, Ying Liu, Weibin Meng, Jiahao Bu, Sen Yang, Yongqian sun, Dan Pei, Jun Xu, Yuzhi Zhang, Lei Sone, Ming Zhang. Efficient and Robust Syslog Parsing for Network Devices in Datacenter Networks. paper link

• python main_train.py -train_log_path training.log -out_seq_path output.seq -templates output.template
  • Parameters:
    • -train_log_path: rawlog path
    • -out_seq_path:template index file
    • -templates:template file

• python main_match.py -templates ./output.template -logs training.log
  • Parameters:
    • -templates: template path
    • -logs:logs which need to match

• Yun Xing Ming Ling :python main_train.py -train_log_path training.log -out_seq_path output.seq -templates output.template
  • Can Shu Jie Shi :
    • -train_log_path: Xun Lian Suo Xu Yao De Yuan Shi Ri Zhi
    • -out_seq_path:Ri Zhi Pi Pei Wan Zhi Hou De Bian Hao Xu Lie
    • -templates:Shu Chu De Mo Ban Wen Jian
  • Zhu Yi :Shi Yong Gai Suan Fa Shi ,Zui Hao Jiang Shu Ju Ji Zhong Qian Mian Ji Lie Shi Jian , Xiao Xi Lei Xing De Xin Xi Shan Diao ,Yao Bu Ran Bi Jiao Luan .

• Shu Chu Wen Jian :Mo Ban , Dan Ci Ci Pin Lie Biao
  • Yun Xing Jiao Ben De De Ming Ling :
    • python ft_tree.py -FIRST_COL 0 -NO_CUTTING 1 -CUTTING_PERCENT 0.3 -data_path ./training.log -template_path ./output.template -fre_word_path ./output.fre -picture_path ./tree.png -leaf_num 4 -short_threshold 5 -plot_flag 1
  • Can Shu Yang Li :
    • FIRST_COL Mei Xing Ri Zhi Cong Di Ji Lie Zuo Wei Shu Ru ,Mo Ren Wei 0
    • NO_CUTTING = 0 #Chu Bu She Ding 1Shi ,Shi Qian 30% Bu Jian Zhi ,Quan Ju Kai Guan , Dang Qi Wei 0Shi ,Quan Ju An Zhao min_thresholdJian Zhi
    • CUTTING_PERCENT =0.6 #Qian Bai Fen Zhi Duo Shao Shi Bu Jian Zhi De
    • train_log_path='input.txt'
    • template_path = "./logTemplate.txt" #Mo Ban
    • fre_word_path = "./fre_word.txt" #
    • leaf_num = 4 #Jian Zhi Shu
    • picture_path = './tree.png'
    • short_threshold = 2 #Guo Lu Diao Chang Du Xiao Yu 5De Ri Zhi
    • plot_flag Mo Ren Wei 0,Bu Hua Tu ,Ruo Wei 1,Ze Jiang ft_treeHua Chu Lai ,Hui Tong Shi Hua Chu "Duan Mo Ban "(Lan Se )He "Jian Zhi Jie Dian "(Hong Se )

• Yun Xing Jiao Ben De De Ming Ling :

  • python3 matchTemplate.py -short_threshold 5 -leaf_num 6 -template_path ./output.template -fre_word_path ./output.fre -log_path ./training.log -out_seq_path ./output.seq -plot_flag 0 -CUTTING_PERCENT 0.3 -NO_CUTTING 1 -match_model 1

• Can Shu Yang Li :

  • short_threshold = 2 #Guo Lu Diao Chang Du Xiao Yu 5De Ri Zhi
  • leaf_num Zeng Liang Xue Xi Shi De Jian Zhi Yu Zhi . (Ru Guo Jiang 6Gai Cheng 10,Ke Yi Tong Guo Yang Li Shu Ju Kan Chu Bu Tong Pi Pei Ji Zhi Zhong De Bu Tong Xiao Guo ,Ji LearnTemplateByIntervalsHui Dui Xin Lai De Shu Ju Zuo Jian Zhi )
  • template_path = './output.template'
  • fre_word_path = './output.fre'
  • runtime_log_path = './new.log'
  • out_seq_path = './output.seq'
  • plot_flag 0Wei Bu Hua Tu ,1Wei Hua Tu ,Mo Ren Wei 0. (Ru Shu Tai Da Bu Yao Hua Tu ,Hui Qia Si )
  • CUTTING_PERCENT Zhi Ding Mei Tiao Ri Zhi De Qian Bai Fen Zhi Ji De Dan Ci Bu Jian Zhi ,Zeng Liang Xue Xi Shi Hui Yong Dao ,Zheng Chang Pi Pei Yong Bu Dao
  • NO_CUTTING Shi Fou Mei Tiao Ri Zhi De Qian Ji Ge Dan Ci Bu Jian Zhi ,0Wei Zheng Chang Jian Zhi ,1Wei Bu Jian Zhi ,Mo Ren Wei 1. Zeng Liang Xue Xi Shi Hui Yong Dao ,Zheng Chang Pi Pei Yong Bu Dao
  • match_model 1:Zheng Chang Pi Pei Ri Zhi 2:Dan Tiao Zeng Liang Xue Xi &Pi Pei 3:Pi Liang Zeng Liang Xue Xi &Pi Pei

• Zeng Liang Xue Xi Mo Ban :

  • matchLogsAndLearnTemplateOneByOne()Han Shu Dan Tiao Pi Pei ,Ru Guo Pi Pei Bu Dao ,Ze Xue Xi Xin De Mo Ban . Hui Jiang Xin Xue Dao De Mo Ban Cha Ru Dao Mo Ban Wen Jian De Zui Hou .
  • matchLogsFromFile() Han Shu ,Zheng Chang Pi Pei Ri Zhi ,Ru Guo Pi Pei Bu Dao ,Ze Wei Mo Ban Xu Hao Wei 0
  • LearnTemplateByIntervals()Han Shu , Jiang Yi Shi Duan De Ri Zhi Zuo Wei Shu Ru ,Ji Yu Yi Qian De Mo Ban Zeng Liang Xue Xi ,Xin Tian Jia De Ri Zhi Mo Ban Ye Hui An Zhao She Ding De Yu Zhi Jian Zhi ,Zui Zhong Jiang Xin Xue Dao De Mo Ban Cha Ru Dao Mo Ban Wen Jian De Zui Hou . Li Ru Zai Yang Li Shu Ju Zhong ,Jia She Xin Lai De Ri Zhi Wei newlogs.dat, Yuan Shi De Mo Ban Shu Wei Trace_train.png,Dang Jian Zhi k=6Shi (Ru Tu reBuildTree_k6),Hui Jian Zhi ,Dang Yu Zhi Wei 10Shi (Ru Tu reBuildTree_k10),Hui Bao Liu Yi Xie Bian Liang

Jiang Mo Ban Zhong De Dan Ci An Zhao Yuan Ri Zhi Zhong De Dan Ci Shun Xu Pai Lie ,De Dao Zheng Xu Mo Ban

• Yun Xing Jiao Ben De De Ming Ling :
  • python3 orderWords.py -templates ./output.template -sequences ./output.seq -rawlog ./training.log -order_templates ./output.template_order

An Zhao Ri Zhi Yuan Xian De Dan Ci Shun Xu Pi Pei

• Yun Xing Jiao Ben De De Ming Ling :
  • python3 matchTemplate.py -short_threshold 5 -leaf_num 6 -template_path ./output.template_order -log_path ./training.log -out_seq_path ./output2.seq -plot_flag 1 -CUTTING_PERCENT 0.3 -NO_CUTTING 1 -match_model 4

Mo Ban Fen Xi :Qie Fen Shi Jian Chuang Kou ,Ran Hou Tong Ji Zheng Chang Shi Duan , Yi Chang Shi Duan , Quan Bu Shi Duan Zhong Chu Xian top10De Mo Ban ,Bing Qie Hua Tu

Mo Ban Fen Xi :Shu Chu Qian 10Ge Chang Chu Xian De Mo Ban ,Yi Ji Mei Ge Mo Ban Dui Ying De Ri Zhi

This code was completed by @Weibin Meng.