SkyEye
Dui java, scalaDeng Yun Xing Yu jvmDe Cheng Xu Jin Xing Shi Shi Ri Zhi Cai Ji , Suo Yin He Ke Shi Hua ,Dui Xi Tong Jin Xing Jin Cheng Ji Bie De Jian Kong ,Dui Xi Tong Nei Bu De Cao Zuo Jin Xing Ce Lue Xing De Bao Jing , Dui Fen Bu Shi De rpcDiao Yong Jin Xing traceGen Zong Yi Bian Yu Jin Xing Xing Neng Fen Xi
Jiao Liu Fang Shi
- QQQun : 624054633
- Email: leviqian@sina.com
- blog: blog
Jia Gou
- APP: Jie Ru skyeye-clientDe Xi Tong Hui Tong Guo kafkaAppenderXiang kafkaXie Ru Ri Zhi
- es-indexer-group: kafkaDe esXiao Fei Zu ,Du Qu kafkaDe Shu Ju Bing Pi Liang bulkDao es
- monitor-group: kafkaDe Jian Kong Xiao Fei Zu ,appZai Ri Zhi Zhong Jin Xing Ge Chong eventMai Dian (Ru :Di San Fang Yi Chang Bao Jing , Qing Qiu Hao Shi Yi Chang Bao Jing Deng )
- business-group: kafkaDe Ye Wu Xiao Fei Zu
- trace-group: Tong Guo Ri Zhi Jin Xing rpcDiao Yong traceGen Zong (dapperLun Wen )
- es: Ri Zhi Cun Chu db,Bing Jian Li Xiang Guan Suo Yin
- zookeeper: appZhu Ce Zhong Xin
- monitor: Jian Kong Zhong Xin ,Jian Ting zookeeperZhu Ce Zhong Xin Zhong Xiang Ying De Jie Dian Bian Hua Jin Xing Jian Kong Bao Jing
- rabbitmq: Jian Kong Bao Jing Huan Chong Dui Lie
- alert: Ju Ti Bao Jing Shou Duan ,Bao Gua You Jian He Wei Xin
Xiang Mu Jie Shao
Dui java, scalaDeng Yun Xing Yu jvmDe Cheng Xu Jin Xing Shi Shi Ri Zhi Cai Ji , Suo Yin He Ke Shi Hua ,Dui Xi Tong Jin Xing Jin Cheng Ji Bie De Jian Kong ,Dui Xi Tong Nei Bu De Cao Zuo Jin Xing Ce Lue Xing De Bao Jing , Dui Fen Bu Shi De rpcDiao Yong Jin Xing traceGen Zong Yi Bian Yu Jin Xing Xing Neng Fen Xi
- Ri Zhi Shi Shi Cai Ji (Zhi Chi log4j, logbackHe log4j2)
- Ri Zhi Shi Shi Ye Mian Shi Shi Zhan Shi (Zhi Chi Guan Jian Zi Guo Lu )
- Li Shi Ri Zhi Cha Xun (Zhi Chi Duo Chong Tiao Jian Guo Lu ,Zhi Chi sqlYu Ju Cha Xun )
- appShi Shi Bu Shu Wei Zhi Zhan Shi (Ji Qi He Wen Jian Jia )
- appShi Shi Ri Zhi Cai Ji Zhuang Tai Zhan Shi
- appLi Shi Bu Shu Wei Zhi Zhan Shi
- apiQing Qiu Shi Shi Tong Ji He Li Shi Tong Ji
- Di San Fang Qing Qiu Shi Shi Tong Ji He Li Shi Tong Ji
- Ji Yu dubboxDe rpcDiao Yong Shu Ju Shou Ji He Diao Yong Lian Zhan Shi (Zhi Chi Duo Chong Tiao Jian Jian Suo )
- Xi Tong Shang Xia Xian Bao Jing
- Xi Tong Nei Qian Cai Ji Qi Bao Jing
- Zhong Jian Jian , api, Di San Fang , jobZhi Xing Yi Chang Bao Jing (Ce Lue Bao Jing He Yi Chang Bao Jing )
Bu Shu Bu Zou
Xiu Gai Gen Mu Lu gradleWen Jian Zhong De Si Fu Di Zhi (Zhe Yang Cai Neng Da Bao deployDao Zi Ji De Ben Di Si Fu ) Da Bao :gradle clean install upload -x test
Rong Qi Bu Shu
Xu Yao Zi Ji Xiu Gai Mei Ge Xiang Mu Xia De imageXia De DockerfileWen Jian
PS: rancherYi Jian Bu Shu skyeyeHou Qi Chu Jiao Cheng ,Ji Ben Fu He Chi Xu Jiao Fu De Chang Jing .
skyeye-base
Ben Xiang Mu Mei You Ju Ti De Ye Wu Luo Ji ,Zhu Yao Shi Ge Ge Mo Kuai Tong Yong De Lei Ding Yi ,Ru :Chang Liang , dto, dapperXiang Guan , Gong Yong util,Suo Yi Gai Xiang Mu Wu Xu Bu Shu ,Zhi Xu Yao Da Bao .
skyeye-client
Ben Xiang Mu Zhu Yao Shi Ti Gong Gei Dui Jie De Xiang Mu Shi Yong ,Bao Han Liao log4jHe logbackDe Zi Ding Yi appenderHe Xiang Mu Zhu Ce Xiang Guan ,Suo Yi Gai Xiang Mu Wu Xu Bu Shu ,Zhi Xu Yao Da Bao Ti Gong Gei Dui Jie Fang Dui Jie .
skyeye-data
Ben Xiang Mu Zhu Yao Shi Yong Lai Ti Gong He Shu Ju Cao Zuo Xiang Guan De Zhong Jian Jian ,Ju Ti Fen Wei Yi Xia 5Ge Zi modoule. Ben Xiang Mu Wu Xu Bu Shu ,Zhi Xu Yao Da Bao .
skyeye-data-dubbox
Gai Xiang Mu Zhu Yao Shi Zi Ding Yi De spring-bootDe dubbox starter,Wei spring-bootXiang Guan De Xiang Mu Shi Yong dubboxTi Gong Jian Yi De Fang Shi Bing Ji Cheng spring-bootDe auto configuration,Jian Wo De Ling Yi Ge Kai Yuan Xiang Mu :spring-boot-starter-dubbox
skyeye-data-hbase
Gai Xiang Mu Zhu Yao Shi Zi Ding Yi De spring-bootDe hbase starter,Wei hbaseDe queryHe Geng Xin Deng Cao Zuo Ti Gong Jian Yi De apiBing Ji Cheng spring-bootDe auto configuration,Jian Wo De Ling Yi Ge Kai Yuan Xiang Mu :spring-boot-starter-hbase
skyeye-data-httpl
Gai Xiang Mu Zhu Yao Shi Yong Lian Jie Chi Jian Dan Feng Zhuang Liao httpDe Qing Qiu ,Ru Guo Xiang Mu Zhong Shi Yong De springBan Ben Jiao Gao Ke Yi Shi Yong RestTemplateDai Ti .
skyeye-data-jpa
Gai Xiang Mu Zhu Yao Shi jpaXiang Guan De Ding Yi ,Bao Han domain, repository, dtoXiang Guan De Ding Yi ,Zhu Yao Yong Lai Cao Zuo mysqlDe Cha Xun .
skyeye-data-rabbitmq
Gai Xiang Mu Zhu Yao Feng Zhuang Liao Bao Jing Mo Kuai Zhong Cun Qu rabbitmqZhong Xiao Xi De Xiang Guan Dai Ma .
skyeye-trace
Gai Xiang Mu Feng Zhuang Liao Suo You rpc traceXiang Guan De Dai Ma ,Bao Han rpcShu Ju Cai Ji Qi , Fen Bu Shi Wei Yi IDSheng Cheng , Fen Bu Shi Di Zeng IDSheng Cheng , Zhu Ce Zhong Xin , Cai Yang Qi , Gen Zong Qi Deng Gong Neng ,Gai Xiang Mu Wu Xu Bu Shu ,Zhi Xu Yao Da Bao .
dubbox
You Yu Shi Yong dubbox,Wei Liao Neng Gou Cai Ji Dao dubboxLi Mian De rpcShu Ju ,Xu Yao Xiu Gai dubboxDe Yuan Ma ,Jian Wo Xiu Gai De dubboxXiang Mu :dubbox,Gai Xiang Mu Zhu Yao Shi Xian Liao rpcGen Zong De Ju Ti Shi Xian ,Xu Yao Dan Du Da Bao .
cd dubbox
git checkout skyeye-trace-1.3.0
Xiu Gai Xiang Guan pomZhong De Si Fu Di Zhi
mvn clean install deploy -Dmaven.test.skip=true
Ruan Jian An Zhuang
Ru Guo Ruan Jian Ban Ben He Yi Xia Suo Lie Bu Yi Zhi ,Xu Yao Xiu Gai gradleZhong De Yi Lai Ban Ben ,Bing Qie Xu Zi Xing Ce Shi Ke Yong Xing (hadoop, hbase, sparkDeng Xiang Ying De Ban Ben Ke Yi Zi Ji Lai Zhi Ding ,Dai Ma Ceng Mian Wu Xu Xiu Gai ,Xu Yao Xiu Gai Yi Lai ).
| Ruan Jian Ming | Ban Ben | Bei Zhu |
|---|---|---|
| mysql | 5.5+ | |
| elasticsearch | 2.3.3 | Wei Ce Shi 5.xBan Ben (Kai Fa De Shi Hou Zui Xin Ban Ben Zhi You 2.3.x),Xu Yao Jia She sqlYin Qing ,Jian : elasticsearch-sql,Xu Yao An Zhuang IKFen Ci Bing Qi Dong ,Jian : es ikFen Ci |
| kafka | 0.10.0.1 | Ru Guo sparkDe Ban Ben Jiao Di ,Na Yao Xu Yao Jiang kafkaDe Ri Zhi De Ge Shi Jiang Di ,Ju Ti Zai kafkaDe Pei Zhi Xiang Jia Ru :log.message.format.version=0.8.2,Gai Xiang An Xu Pei Zhi |
| jdk | 1.7+ | |
| zookeeper | 3.4.6 | |
| rabbitmq | 3.5.7 | |
| hbase | 1.0.0-cdh5.4.0 | Bu Zhi Chi 1.xYi Xia De Ban Ben ,Bi Ru 0.9x.x |
| gradle | 3.0+ | |
| hadoop | 2.6.0-cdh5.4.0 | |
| spark | 1.3.0-cdh5.4.0 | |
| redis | 3.x | Dan Ji Ban Ji Ke |
Chu Shi Hua
mysql
source skyeye-data/skyeye-data-jpa/src/main/resources/sql/init.sql
hbase
Chuang Jian San Zhang Biao ,Yong Lai Bao Cun rpcDe Shu Ju (Yi Zhang Shu Ju Biao ,Liang Zhang Er Ji Suo Yin Biao )
Zhi Xing skyeye-collector/skyeye-collector-trace/src/main/resources/s hell/hbaseZhe Ge Wen Jian Li Mian De Nei Rong
elasticsearch
Shou Xian An Zhuang Xiang Ying De es pythonDe module,Ran Hou Zai Chuang Jian Suo Yin ,Gen Ju Xu Yao Xiu Gai esDe De ip, Duan Kou
./install.sh
bash start.sh app-log http://192.168.xx.xx:9200,http://192.168.xx.xx:9200,......
cd skyeye-collector/skyeye-collector-metrics/src/main/resources/shell
bash start.sh event-log http://192.168.xx.xx:9200,http://192.168.xx.xx:9200,......
Zhu Yi Dian :Ru Guo esBan Ben Wei 5.x,Na Yao Xu Yao Xiu Gai skyeye-collector/src/main/resources/shell/es/app-log/create- index.pyDe 49He 50Xing Wei Xia Mian Nei Rong :
'messageSmart': { 'type': 'text', 'analyzer': 'ik_smart', 'search_analyzer': 'ik_smart', 'include_in_all': 'true', 'boost': 8},
'messageMax': { 'type': 'text', 'analyzer': 'ik_max_word', 'search_analyzer': 'ik_max_word', 'include_in_all': 'true', 'boost': 8}
kafka
Chuang Jian Xiang Ying De topic,Gen Ju Xu Yao Xiu Gai --partitionsHe zkDe ip, Duan Kou De Zhi ,Ru Guo Ri Zhi Liang Te Bie Da Ke Yi Gua Dang Ti Gao Zhe Ge Zhi
zookeeper
Chu Shi Hua Zhu Ce Zhong Xin De Jie Dian Xin Xi
Zhi Xing skyeye-monitor/src/main/resources/shell/zkZhe Ge Wen Jian Li Mian De Nei Rong
rabbitmq
Xiang Guan Xiang Mu Qi Dong De Shi Hou Hui Zi Dong Chuang Jian Xiang Guan De Dui Lie
skyeye-alarm
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian
mkdir -p /opt/jthink/jthink-config/skyeye/alarm
vim alarm.properties
# log_mailer request queue
rabbit.request.addresses=localhost:5672
rabbit.request.username=jthink
rabbit.request.password=jthink
rabbit.request.vhost=/dev
rabbit.request.channelCacheSize=50
rabbit.request.queue=log_mailer
rabbit.request.exchange=direct.log
rabbit.request.routingKey=log.key
mail.jthink.smtphost=smtp.xxx.com
mail.jthink.port=25
mail.jthink.from=xxx@xxx.com
mail.jthink.cc=xxx@xxx.com
mail.jthink.password=jthink_0926
Xu Yao Xiu Gai rabbitmqHe You Jian Xiang Guan De Pei Zhi
Da Bao Bu Shu
gradle clean distZip -x test
cd target/distributions
unzip skyeye-alarm-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-alarm-x.x.x
nohup bin/skyeye-alarm &
skyeye-collector
Ben Xiang Mu Cong v1.0.0Ban Ben Kai Shi An Bu Tong De kafkaXiao Fei groupZu Zhi Zi moduleYi Shi Xian Ke Cha Ba De Gong Neng Mo Kuai ,Zhu Yao Bao Han Ru Xia 5Ge module:
- skyeye-collector-core: Shou Ji Xiang Mu De Suo You Gong Yong De Pei Zhi He Gong Yong Dai Ma ,Gai moduleBu Xu Yao Bu Shu
- skyeye-collector-backup: Dui Cai Ji De Suo You Ri Zhi Jin Xing Bei Fen
- skyeye-collector-indexer: Dui Cai Ji De Suo You Ri Zhi Jin Xing Suo Yin Cun Ru es
- kyeye-collector-metrics: Dui Shi Jian Ri Zhi Jin Xing meta dataDe Cai Ji He Xiang Guan Bao Jing metricsJin Xing Suo Yin Cun Ru es
- skyeye-collector-trace: Dui rpcGen Zong Shu Ju Jin Xing Cai Ji Ru hbase
Da Bao
gradle clean build -x test
skyeye-collector-backup
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian ,Gen Ju Dui Jie Xi Tong De Ge Shu He Chan Sheng Ri Zhi De Liang Jin Xing Bu Shu ,Zui Hao Bu Shu 3Ge Jie Dian (Mei Ge Jie Dian Xiao Fei 3Ge partitionDe Shu Ju )
mkdir -p /opt/jthink/jthink-config/skyeye/collector
vim collector-backup.properties
# kafka config
kafka.brokers=riot01:9092,riot02:9092,riot03:9092
kafka.topic=app-log
kafka.consume.group=log-backup-consume-group
kafka.poll.timeout=100
# hdfs
hadoop.hdfs.namenode.port=8020
hadoop.hdfs.namenode.host=192.168.88.131
hadoop.hdfs.user=xxx
hadoop.hdfs.baseDir=/user/xxx/JThink/
hadoop.hdfs.fileRoot=/tmp/monitor-center/
upload.log.cron=0 30 0 * * ?
Bu Shu
Duo Ge Jie Dian Bu Shu Xu Yao Bu Shu Duo Ci
unzip skyeye-collector-backup-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-collector-backup-x.x.x
nohup bin/skyeye-collector-backup &
skyeye-collector-indexer
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian ,Gen Ju Dui Jie Xi Tong De Ge Shu He Chan Sheng Ri Zhi De Liang Jin Xing Bu Shu ,Zui Hao Bu Shu 3Ge Jie Dian (Mei Ge Jie Dian Xiao Fei 3Ge partitionDe Shu Ju )
mkdir -p /opt/jthink/jthink-config/skyeye/collector
vim collector-indexer.properties
# kafka config
kafka.brokers=riot01:9092,riot02:9092,riot03:9092
kafka.topic=app-log
kafka.consume.group=es-indexer-consume-group
kafka.poll.timeout=100
# es config
es.ips=riot01,riot02,riot03
es.cluster=mondeo
es.port=9300
es.sniff=true
es.index=app-log
es.doc=log
Bu Shu
Duo Ge Jie Dian Bu Shu Xu Yao Bu Shu Duo Ci
unzip skyeye-collector-indexer-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-collector-indexer-x.x.x
nohup bin/skyeye-collector-indexer &
skyeye-collector-metrics
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian ,Gen Ju Dui Jie Xi Tong De Ge Shu He Chan Sheng Ri Zhi De Liang Jin Xing Bu Shu ,Zui Hao Bu Shu 3Ge Jie Dian (Mei Ge Jie Dian Xiao Fei 3Ge partitionDe Shu Ju )
mkdir -p /opt/jthink/jthink-config/skyeye/collector
vim collector-metrics.properties
# kafka config
kafka.brokers=riot01:9092,riot02:9092,riot03:9092
kafka.topic=app-log
kafka.consume.group=info-collect-consume-group
kafka.poll.timeout=100
# es config
es.ips=riot01,riot02,riot03
es.cluster=mondeo
es.port=9300
es.sniff=true
es.index=event-log
es.doc=log
# redis config
redis.host=localhost
redis.port=6379
redis.password=
# mysql config
database.address=localhost:3306
database.name=monitor-center
database.username=root
database.password=root
# log_mailer request queue
rabbit.request.addresses=localhost:5672
rabbit.request.username=jthink
rabbit.request.password=jthink
rabbit.request.vhost=/dev
rabbit.request.channelCacheSize=50
rabbit.request.queue=log_mailer
rabbit.request.exchange=direct.log
rabbit.request.routingKey=log.key
# zk
zookeeper.zkServers=riot01:2181,riot02:2181,riot03:2181
zookeeper.sessionTimeout=60000
zookeeper.connectionTimeout=5000
Bu Shu
Duo Ge Jie Dian Bu Shu Xu Yao Bu Shu Duo Ci
unzip skyeye-collector-metrics-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-collector-metrics-x.x.x
nohup bin/skyeye-collector-metrics &
skyeye-collector-trace
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian ,Gen Ju Dui Jie Xi Tong De Ge Shu He Chan Sheng Ri Zhi De Liang Jin Xing Bu Shu ,Zui Hao Bu Shu 3Ge Jie Dian (Mei Ge Jie Dian Xiao Fei 3Ge partitionDe Shu Ju )
mkdir -p /opt/jthink/jthink-config/skyeye/collector
vim collector-trace.properties
# kafka config
kafka.brokers=riot01:9092,riot02:9092,riot03:9092
kafka.topic=app-log
kafka.consume.group=rpc-trace-consume-group
kafka.poll.timeout=100
# redis config
redis.host=localhost
redis.port=6379
redis.password=
# mysql config
database.address=localhost:3306
database.name=monitor-center
database.username=root
database.password=root
# hbase config
hbase.quorum=panda-01,panda-01,panda-03
hbase.rootDir=hdfs://panda-01:8020/hbase
hbase.zookeeper.znode.parent=/hbase
Bu Shu
Duo Ge Jie Dian Bu Shu Xu Yao Bu Shu Duo Ci
unzip skyeye-collectortracemetrics-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-collector-trace-x.x.x
nohup bin/skyeye-collector-trace &
skyeye-monitor
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian
mkdir -p /opt/jthink/jthink-config/skyeye/monitor
vim monitor.properties
# zk
zookeeper.zkServers=riot01:2181,riot02:2181,riot03:2181
zookeeper.sessionTimeout=60000
zookeeper.connectionTimeout=5000
zookeeper.baseSleepTimeMs=1000
zookeeper.maxRetries=3
# log_mailer request queue
rabbit.request.addresses=localhost:5672
rabbit.request.username=jthink
rabbit.request.password=jthink
rabbit.request.vhost=/dev
rabbit.request.channelCacheSize=50
rabbit.request.queue=log_mailer
rabbit.request.exchange=direct.log
rabbit.request.routingKey=log.key
# mysql config
database.address=localhost:3306
database.name=monitor-center
database.username=root
database.password=root
Xu Yao Xiu Gai Xiang Guan De Pei Zhi (rabbitmqDe Pei Zhi Xu He alarmYi Zhi ,zkYe Xu Yao Qian Hou Yi Zhi )
Da Bao Bu Shu
gradle clean distZip -x test
cd target/distributions
unzip skyeye-monitor-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-monitor-x.x.x
nohup bin/skyeye-monitor &
skyeye-web
Pei Zhi Wen Jian
Pei Zhi Wen Jian Wai Bu Hua ,Xu Yao Zai Ji Qi Shang Chuang Jian Pei Zhi Wen Jian
mkdir -p /opt/jthink/jthink-config/skyeye/web
vim web.properties
# server
serverAddress=0.0.0.0
serverPort=8090
# mysql config
database.address=localhost:3306
database.name=monitor-center
database.username=root
database.password=root
# es sql url
es.sql.url=http://riot01:9200/_sql?sql=
es.sql.sql=select * from app-log/log
es.query.delay=10
es.sql.index.event=event-log/log
# log_mailer request queue
rabbit.request.addresses=localhost:5672
rabbit.request.username=jthink
rabbit.request.password=jthink
rabbit.request.vhost=/dev
rabbit.request.channelCacheSize=50
rabbit.request.queue=log_mailer
rabbit.request.exchange=direct.log
rabbit.request.routingKey=log.key
# monitor
monitor.es.interval=0 */1 * * * ? # Jian Kong Dai Ma Zhi Xing De Zhou Qi ,Jian Yi Bu Xiu Gai
monitor.es.mail=leviqian@sina.com
# hbase config
hbase.quorum=panda-01,panda-01,panda-03
hbase.rootDir=hdfs://panda-01:8020/hbase
hbase.zookeeper.znode.parent=/hbase
Xu Yao Xiu Gai Xiang Guan De Pei Zhi (rabbitmqDe Pei Zhi Xu He alarmYi Zhi ,esYe Xu Yao Qian Hou Yi Zhi ),Zhu Shi Guo De Shi Yao Zhu Yi De
Da Bao Bu Shu
gradle clean distZip -x test
cd target/distributions
unzip skyeye-web-x.x.x.zip(Ti Huan Xiang Ying De xWei Zi Ji De Ban Ben )
cd skyeye-web-x.x.x
nohup bin/skyeye-web &
Xiang Mu Dui Jie
Xu Yao Jin Xing Ri Zhi Cai Ji De Xiang Mu Xu Yao An Zhao Ru Xia Cao Zuo
logback
Yi Lai
gradleHuo Zhe pomZhong Jia Ru skyeye-clientDe Yi Lai
Pei Zhi
Zai logback.xmlZhong Jia Ru Yi Ge kafkaAppender,Bing Zai propertiesZhong Pei Zhi Hao Xiang Guan De Zhi ,Ru Xia (rpcZhe Ge Xiang Mu Qian Zhi Chi noneHe dubbo,Suo Yi Ru Guo Xiang Mu Zhong You dubboFu Wu De Pei Zhi Cheng dubbo,Mei You dubboFu Wu De Pei Zhi Cheng none,Yi Hou Hui Zhi Chi Qi Ta De rpcKuang Jia ,Ru :thrift, spring cloudDeng ):
<appender name="kafkaAppender" class="com.jthink.skyeye.client.logback.appender.KafkaAppender">
<encoder class="com.jthink.skyeye.client.logback.encoder.KafkaLayoutEncoder">
<layout class="ch.qos.logback.classic.PatternLayout">
<pattern>%d{yyyy-MM-dd HH:mm:ss.SSS};${CONTEXT_NAME};HOSTNAME;%thread;%-5level;%logger{96};%line;%msg%npattern>
layout>
encoder>
<topic>app-logtopic>
<rpc>nonerpc>
<zkServers>riot01.jthink.com:2181,riot02.jthink.com:2181,riot03.jthink.com:2181zkServers>
<mail>xxx@xxx.commail>
<keyBuilder class="com.jthink.skyeye.client.logback.builder.AppHostKeyBuilder" />
<config>bootstrap.servers=riot01.jthink.com:9092,riot02.jthink.com:9092,riot03.jthink.com:9092config>
<config>acks=0config>
<config>linger.ms=100config>
<config>max.block.ms=5000config>
appender>
log4j
Yi Lai
gradleHuo Zhe pomZhong Jia Ru skyeye-clientDe Yi Lai
Pei Zhi
Zai log4j.xmlZhong Jia Ru Yi Ge kafkaAppender,Bing Zai propertiesZhong Pei Zhi Hao Xiang Guan De Zhi ,Ru Xia (rpcZhe Ge Xiang Mu Qian Zhi Chi noneHe dubbo,Suo Yi Ru Guo Xiang Mu Zhong You dubboFu Wu De Pei Zhi Cheng dubbo,Mei You dubboFu Wu De Pei Zhi Cheng none,Yi Hou Hui Zhi Chi Qi Ta De rpcKuang Jia ,Ru :thrift, spring cloudDeng ):
<param name="topic" value="app-log"/>
<param name="zkServers" value="riot01.jthink.com:2181,riot02.jthink.com:2181,riot03.jthink.com:2181"/>
<param name="app" value="xxx"/>
<param name="rpc" value="dubbo"/>
<param name="mail" value="xxx@xxx.com"/>
<param name="bootstrapServers" value="riot01.jthink.com:9092,riot02.jthink.com:9092,riot03.jthink.com:9092"/>
<param name="acks" value="0"/>
<param name="maxBlockMs" value="2000"/>
<param name="lingerMs" value="100"/>
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern" value="%d{yyyy-MM-dd HH:mm:ss.SSS};APP_NAME;HOSTNAME;%t;%p;%c;%L;%m%n"/>
layout>
appender>
log4j2
Yi Lai
gradleHuo Zhe pomZhong Jia Ru skyeye-clientDe Yi Lai
Pei Zhi
Zai log4j2.xmlZhong Jia Ru Yi Ge KafkaCustomize,Bing Zai propertiesZhong Pei Zhi Hao Xiang Guan De Zhi ,Ru Xia (rpcZhe Ge Xiang Mu Qian Zhi Chi noneHe dubbo,Suo Yi Ru Guo Xiang Mu Zhong You dubboFu Wu De Pei Zhi Cheng dubbo,Mei You dubboFu Wu De Pei Zhi Cheng none,Yi Hou Hui Zhi Chi Qi Ta De rpcKuang Jia ,Ru :thrift, spring cloudDeng ):
mail="qianjc@unionpaysmart.com" rpc="none" app="${APP_NAME}">
<ThresholdFilter level="info" onMatch="ACCEPT" onMismatch="DENY"/>
<PatternLayout pattern="%d{yyyy-MM-dd HH:mm:ss.SSS};${APP_NAME};HOSTNAME;%t;%-5level;%logger{96};%line;%msg%n"/>
<Property name="bootstrap.servers">riot01.jthink.com:9092,riot02.jthink.com:9092,riot03.jthink.com:9092Property>
<Property name="acks">0Property>
<Property name="linger.ms">100Property>
KafkaCustomize>
Zhu Yi Dian
logback
- logbackZai Dui Jie kafkaDe Shi Hou You Ge bug,jira bug,Suo Yi Xu Yao Jiang root levelShe Zhi Wei INFO(Bu Neng Shi DEBUG)
log4j
You Yu log4jBen Shen De appenderBi Jiao Fu Za Nan Xie ,Suo Yi Zai Wen Ding Xing He Xing Neng Shang Mei You logbackZhi Chi De Hao ,Ying Yong Neng Shi Yong logbackQing Jin Liang Shi Yong logback
rpc trace
Shi Yong Zi Ji Da Bao De dubbox(dubbox),Zai soaZhong Jian Jian dubboxZhong Feng Zhuang Liao rpcDe Gen Zong
compile ("com.alibaba:dubbo:2.8.4-skyeye-trace-1.3.0") {
exclude group: 'org.springframework', module: 'spring'
}
spring boot
Ru Guo Xiang Mu Shi Yong De Shi spring-boot+logback,Na Yao Xu Yao Jiang spring-bootDui logbackDe Chu Shi Hua Qu Diao ,Fang Zhi Chu Shi Hua De Shi Hou Zai zkZhu Ce Liang Ci Er Bao Cuo ,Ju Ti Jian Wo De Ji Pian Bo Ke Jiu Ke Yi Jie Jue :
http://blog.csdn.net/jthink_/article/details/52513963
http://blog.csdn.net/jthink_/article/details/52613953
http://blog.csdn.net/jthink_/article/details/73106745
Mai Dian
Ri Zhi Lei Xing
| Ri Zhi Lei Xing | Shuo Ming |
|---|---|
| normal | Zheng Chang Ru Ku Ri Zhi |
| invoke_interface | apiDiao Yong Ri Zhi |
| middleware_opt | Zhong Jian Jian Cao Zuo Ri Zhi (Mu Qian Jin Zhi Chi hbaseHe mongo) |
| job_execute | jobZhi Xing Ri Zhi |
| rpc_trace | rpc traceGen Zong Ri Zhi |
| custom_log | Zi Ding Yi Mai Dian Ri Zhi |
| thirdparty_call | Di San Fang Xi Tong Diao Yong Ri Zhi |
Zheng Chang Ri Zhi
apiRi Zhi
LOGGER.info(ApiLog.buildApiLog(EventType.invoke_interface, "/app/status", "800001", 100, EventLog.MONITOR_STATUS_SUCCESS, "Wo Shi mock apiCheng Gong Ri Zhi ").toString());
LOGGER.info(ApiLog.buildApiLog(EventType.invoke_interface, "/app/status", "800001", 10, EventLog.MONITOR_STATUS_FAILED, "Wo Shi mock apiShi Bai Ri Zhi ").toString());
Zhong Jian Jian Ri Zhi
LOGGER.info(EventLog.buildEventLog(EventType.middleware_opt, MiddleWare.HBASE.symbol(), 100, EventLog.MONITOR_STATUS_SUCCESS, "Wo Shi mock middle wareCheng Gong Ri Zhi ").toString());
LOGGER.info(EventLog.buildEventLog(EventType.middleware_opt, MiddleWare.MONGO.symbol(), 10, EventLog.MONITOR_STATUS_FAILED, "Wo Shi mock middle wareShi Bai Ri Zhi ").toString());
jobZhi Xing Ri Zhi
// jobZhi Xing Jin Jin Chu Li Shi Bai De Ri Zhi (Cheng Gong De Bu Zuo Chu Li ,Suo Yi Zhi Xu Yao Gou Zao Shi Bai De Ri Zhi ), Can Shu Yi Ci Wei EventType(Shi Jian Lei Xing ), job De idHao , Cao Zuo Hao Shi , Shi Bai , Ju Ti Zi Ding Yi De Ri Zhi Nei Rong
LOGGER.info(EventLog.buildEventLog(EventType.job_execute, "application_1477705439920_0544", 10, EventLog.MONITOR_STATUS_FAILED, "Wo Shi mock job execShi Bai Ri Zhi ").toString());
Di San Fang Qing Qiu Ri Zhi
// Can Shu Yi Ci Wei EventType(Shi Jian Lei Xing ), Di San Fang Ming Cheng , Cao Zuo Hao Shi , Cheng Gong Huan Shi Shi Bai , Ju Ti Zi Ding Yi De Ri Zhi Nei Rong
LOGGER.info(EventLog.buildEventLog(EventType.thirdparty_call, "xx1", 100, EventLog.MONITOR_STATUS_FAILED, "Wo Shi mock third Shi Bai Ri Zhi ").toString());
LOGGER.info(EventLog.buildEventLog(EventType.thirdparty_call, "xx1", 100, EventLog.MONITOR_STATUS_SUCCESS, "Wo Shi mock third Cheng Gong Ri Zhi ").toString());
LOGGER.info(EventLog.buildEventLog(EventType.thirdparty_call, "xx2", 100, EventLog.MONITOR_STATUS_SUCCESS, "Wo Shi mock third Cheng Gong Ri Zhi ").toString());
LOGGER.info(EventLog.buildEventLog(EventType.thirdparty_call, "xx2", 100, EventLog.MONITOR_STATUS_FAILED, "Wo Shi mock third Shi Bai Ri Zhi ").toString());