Prometheus鎶€鏈垎浜€斺€攑rometheus鐨勫嚱鏁颁笌璁＄畻鍏紡璇﹁В鏈€鍏堝嚭鐜板湪涔愮淮瀹樼綉銆侟/p> ]]> Prometheus涓巣abbix鐩告瘮锛屽畠鐨勫己澶т箣澶勫氨鍦ㄤ簬鍙互瀹冨彲浠ヤ娇鐢ㄧ殑寰堝璁＄畻鍏紡鍘昏幏鍙栬嚜宸遍渶瑕佺殑鏁版嵁銆傚綋鐒讹紝杩欓噷鎵€娑夊強鍒扮殑璁＄畻鍏紡锛屼篃鏄垜浠櫘閬嶈涓虹殑闅剧偣鎵€鍦ㄣ€傛瘮濡傦紝鎴戜滑瑕佽幏鍙朇PU浣跨敤鐜囷紝浣跨敤zabbix灏卞彲浠ヨ交鏄撹幏寰楋紝浣嗘槸鍦≒rometheus涓嵈闇€瑕侀€氳繃璁＄畻鍏紡鏉ュ畬鎴怌PU浣跨敤鐜囩殑璁＄畻銆侟/p>

濡傛灉瑕佺粺璁PU鐨勪娇鐢細node_exporter浼氭姄鍙朇PU甯哥敤浣犵殑8绉嶇姸鎬佺殑绱宸ヤ綔鏃堕棿锛岀劧鍚庡啀鐢紙鎵€鏈夐潪绌洪棽鐘舵€佺殑CPU鏃堕棿鎬诲拰锛?锛堟墍鏈夌姸鎬佺殑CPU鏃堕棿鎬诲拰锛堼 CPU浣跨敤鐜囥€傝€屽鏋滄兂瑕佽幏鍙栦腑闂存煇涓€鍒嗛挓鐨凜PU浣跨敤鏃堕棿杩橀渶瑕佺敤鍒癈ounter鏁版嵁绫诲瀷銆傜敱浜嶤ounter鐨勬暟鎹竴鑷存槸澧為噺锛屾墍浠ラ渶瑕佹埅鍙栧叾涓竴娈靛閲忓€硷紝鐒跺悗鍐嶆嬁杩欎釜鍊煎幓濂楃敤鍏紡杩涜璁＄畻銆侟/p>

涓€銆佸父鐢ㄥ嚱鏁?/h2>

Prometheus涓轰笉鍚岀殑鏁版嵁鎻愪緵浜嗛潪甯稿鐨勮绠楀嚱鏁帮紝鍏朵腑鏈変釜灏忔妧宸у氨鏄亣鍒癱ounter鏁版嵁绫诲瀷锛屽湪鍋氫换浣曟搷浣滀箣鍓嶏紝鍏堝涓婁竴涓猺ate()鎴栬€卛ncrease()鍑芥暟銆備笅闈㈡槸涓€浜涙瘮杈冨父鐢ㄧ殑鍑芥暟锛欬/p>

1銆乺ate鍑芥暟

rate() 鍑芥暟鏄笓闂ㄦ惌閰峜ounter鏁版嵁绫诲瀷浣跨敤鍑芥暟锛屽姛鑳芥槸鍙朿ounter鍦ㄨ繖涓椂闂存涓钩鍧囨瘡绉掔殑澧為噺銆侟/p>

渚嬪锛氳幏鍙杄th0缃戝崱1m鍐呮瘡绉掓祦閲忕殑骞冲潎鍊稽/p>

rate(node_network_receive_bytes_total{device="eth0"}[1m])

2銆乮ncrease鍑芥暟

increase() 鍑芥暟琛ㄧず鏌愭鏃堕棿鍐呮暟鎹殑澧為噺

rate() 鍑芥暟鍒欒〃绀烘煇娈垫椂闂村唴鏁版嵁鐨勫钩鍧囧€稽/p>

涓や釜鍑芥暟濡備綍閫夊彇浣跨敤锛烖/p>

褰撴垜浠幏鍙栨暟鎹瘮杈冪簿缁嗙殑鏃跺€ 绫讳技浜?m鍙栨牱鎺ㄨ崘浣跨敤rate()

褰撴垜浠幏鍙栨暟鎹瘮杈冪矖绯欑殑鏃跺€ 绫讳技浜?m锛?0m鐢氳嚦鏇撮暱鏃堕棿鍙栨牱鎺ㄨ崘浣跨敤increase()

渚嬪锛氳幏鍙杄th0缃戝崱1m鍐呮祦閲忕殑澧為噺

increase(node_network_receive_bytes_total{device="eth0"}[1m])

3銆乻um鍑芥暟

sum()鍑芥暟灏辨槸姹傚拰鍑芥暟,娉ㄦ剰鐐规槸褰撲綘浣跨敤sum鍚庢槸灏嗘墍鏈夌殑鐩戞帶鐨勬湇鍔″櫒鐨勫€艰繘琛屽彇鍜岋紝鎵€浠ュ綋鎴戜滑鍙湅鏌愪竴鍙版椂闇€瑕佽繘琛屾媶鍒咟/p>

鎷嗗垎甯哥敤鏂规硶锛欬/p>

by increase()
2 by (cluster_name) 灞炰簬鑷畾涔夋爣绛句笉鏄爣鍑嗘爣绛撅紝鎴戜滑鍙互鎵嬪姩灏嗕笉鐥涘姛鑳界殑鏈嶅姟鍣ㄨ繘琛屽垎缁勫睍绀裹br>渚嬪锛氳幏鍙栨墍鏈変富鏈篹th0缃戝崱1m鍐呮瘡绉掓祦閲忕殑骞冲潎鍊肩殑鍜孅/p>

sum(rate(node_network_receive_bytes_total{device="eth0"}[1m]))

4銆乼opk鍑芥暟

topk() 鍑芥暟鐨勫畾涔夋槸锛氬彇鍓嶉潰x浣嶇殑鏈€楂樺€?鏈€绠€鍗曠悊瑙ｅ氨鏄暟瀛︾殑top3 锛屽綋鎴戜滑鏈夊緢澶氭湇鍔″櫒鎴戜滑鎯宠鑾峰彇鏌愪釜key鐨勬暟鎹帓鍦ㄥ墠3浣嶇殑鏈嶅姟鍣ㄣ€侟/p>

Gauge绫诲瀷浣跨敤鏂瑰紡锛欬/p>

topk(3,key)

Counter绫诲瀷浣跨敤鏂瑰紡

topk(3,rate(key[1m]))

娉ㄦ剰锛氭绉嶅嚱鏁拌幏寰楁暟鎹苟涓嶆槸寰堥€傜敤鍥惧舰鍖栧睍绀裹/p>

5銆乧ount鍑芥暟

count() 鏄壘鍑哄綋鍓嶆垨鑰呭巻鍙叉暟鎹腑鏌愪釜key鐨勬暟鍊煎ぇ浜庢垨灏忎簬鏌愪釜鍊肩殑缁熻锛孅/p>

渚嬪锛欬/p>

count(node_netstat_Tcp_CurrEstab >50)

6銆乮rate鍑芥暟

irate(v range-vector)璁＄畻鑼冨洿鍚戦噺涓椂闂村簭鍒楃殑姣忕鍗虫椂澧為暱鐜囥€傝繖鍩轰簬鏈€鍚庝袱涓暟鎹偣銆傚崟璋冩€т腑鏂紙渚嬪鐢变簬鐩爣閲嶅惎鑰屽鑷寸殑璁℃暟鍣ㄩ噸缃級浼氳嚜鍔ㄨ皟鏁滁/p>

渚嬪锛?m鍐卙ttp璇锋眰鐨勬瘡绉掗€熺巼

irate(http_requests_total{job=”linux-01″}[5m])

irate鍙簲鍦ㄧ粯鍒舵槗澶辨€у揩閫熺Щ鍔ㄨ鏁板櫒鏃朵娇鐢ㄣ€備娇鐢╮ate璀︽姤鍜岀紦鎱㈢Щ鍔ㄧ殑鏌滃彴锛屽洜涓哄湪鎴夸环鐭殏鍙樺寲鍙互閲嶈FOR鏉℃鍜屽浘琛ㄥ畬鍏ㄧ敱缃曡灏栧嘲闅句互闃呰銆侟/p>

娉ㄦ剰锛屽綋irate()涓 鑱氬悎杩愮畻绗︼紙渚嬪sum()锛夋垨闅忔椂闂磋仛鍚堢殑鍑芥暟锛堜互浠讳綍缁撳熬鐨勫嚱鏁癬over_time锛夌粍鍚堟椂锛屾€绘槸鍏堝彇irate()绗竴涓紝鐒跺悗鑱氬悎銆傚惁鍒檌rate()鍦ㄧ洰鏍囬噸鍚椂鏃犳硶妫€娴嬪埌璁℃暟鍣ㄩ噸缃€侟/p>

浜屻€丆PU浣跨敤鐜囩殑璁＄畻鏂规硶

1銆丆PU妯″紡
涓€棰桟PU瑕侀€氳繃鍒嗘椂澶嶇敤鐨勬柟寮忚繍琛屼簬涓嶅悓鐨勬ā寮忎腑锛岃繖浜涙ā寮忓彲浠ョ敤鎴戜滑甯哥敤鐨則op鍛戒护杩涜鏌ョ湅锛屽叾涓寘鎷細

us锛氱敤鎴疯繘绋嬩娇鐢╟pu鐨勬椂闂滁br>sy锛氬唴鏍歌繘绋嬩娇鐢╟pu鐨勬椂闂滁br>ni锛氱敤鎴疯繘绋嬬┖闂村唴鏀瑰彉杩囦紭鍏堢骇鐨勮繘绋嬩娇鐢ㄧ殑cpu鏃堕棿
id锛氱┖闂诧紙娌′汉鐢級鐨刢pu鏃堕棿
wa锛氱瓑寰卛o鐨刢pu鏃堕棿
hi锛氱‖涓柇鐨刢pu鏃堕棿
si锛氳蒋涓柇鐨刢pu鏃堕棿
st锛氳櫄鎷熸満绠＄悊绋嬪簭浣跨敤鐨刢pu鏃堕棿
杩欎簺鏃堕棿鍔犲湪涓€璧锋槸鎬荤殑cpu鏃堕棿銆侟/p>

2銆丆PU鏃堕棿
閫氳繃node-exporter鎶撳彇鐨勬寚鏍囦腑cpu鐩稿叧涓昏鏄悇涓猲ode_cpu_seconds_total锛屽彲浠ラ€氳繃濡備笅鐨勬柟寮忔煡鐪嬫墍鏈夌殑metrics銆侟/p>

curl http://localhost:9100/metrics

鍦ㄨ姹備箣鍚庯紝浼氳繑鍥炲悇绉嶇洃鎺х殑鍐呭锛岃繖閲屽彧鎴彇鍑篶pu鐩稿叧鐨勯儴鍒嗐€侟/p>

# HELP node_cpu_seconds_total Seconds the cpus spent in each mode.
# TYPE node_cpu_seconds_total counter
node_cpu_seconds_total{cpu="0",mode="idle"} 26659.41
node_cpu_seconds_total{cpu="0",mode="iowait"} 4.79
node_cpu_seconds_total{cpu="0",mode="irq"} 0
node_cpu_seconds_total{cpu="0",mode="nice"} 0
node_cpu_seconds_total{cpu="0",mode="softirq"} 2.69
node_cpu_seconds_total{cpu="0",mode="steal"} 0
node_cpu_seconds_total{cpu="0",mode="system"} 31.65
node_cpu_seconds_total{cpu="0",mode="user"} 8.67
node_cpu_seconds_total{cpu="1",mode="idle"} 26634.43
node_cpu_seconds_total{cpu="1",mode="iowait"} 54.14
node_cpu_seconds_total{cpu="1",mode="irq"} 0
node_cpu_seconds_total{cpu="1",mode="nice"} 0.02
node_cpu_seconds_total{cpu="1",mode="softirq"} 1.23
node_cpu_seconds_total{cpu="1",mode="steal"} 0
node_cpu_seconds_total{cpu="1",mode="system"} 34.07
node_cpu_seconds_total{cpu="1",mode="user"} 9
node_cpu_seconds_total{cpu="2",mode="idle"} 26629.89
node_cpu_seconds_total{cpu="2",mode="iowait"} 6.57
node_cpu_seconds_total{cpu="2",mode="irq"} 0
node_cpu_seconds_total{cpu="2",mode="nice"} 0
node_cpu_seconds_total{cpu="2",mode="softirq"} 1.95
node_cpu_seconds_total{cpu="2",mode="steal"} 0
node_cpu_seconds_total{cpu="2",mode="system"} 24.66
node_cpu_seconds_total{cpu="2",mode="user"} 7.2
node_cpu_seconds_total{cpu="3",mode="idle"} 26699.96
node_cpu_seconds_total{cpu="3",mode="iowait"} 5.72
node_cpu_seconds_total{cpu="3",mode="irq"} 0
node_cpu_seconds_total{cpu="3",mode="nice"} 0.01
node_cpu_seconds_total{cpu="3",mode="softirq"} 1.27
node_cpu_seconds_total{cpu="3",mode="steal"} 0
node_cpu_seconds_total{cpu="3",mode="system"} 22.32
node_cpu_seconds_total{cpu="3",mode="user"} 7.33

涓婇潰鐨勬煇涓€琛屽氨鏄煇涓€鏍竎pu鐨勬煇涓ā寮忕殑杩愯鏃堕棿锛屽崟浣嶆槸绉扅/code>銆傛妸鏌愪竴鏍稿悇涓ā寮忕殑cpu鏃堕棿鍔犺捣鏉ュ氨鏄墽琛寀ptime寰楀埌鐨勭郴缁熷紑鏈轰互鏉ヨ繍琛岃繍琛岀殑鎬荤殑绉掓暟浜嗐€備緥濡傦細