Prometheus鎶€鏈垎浜€斺€攑rometheus鑷畾涔夊憡璀﹁鍒欒В鏋愬拰閰嶇疆鏈€鍏堝嚭鐜板湪涔愮淮瀹樼綉銆侟/p> ]]> 涓婁竴鏈熶箰缁村悰璺熷ぇ瀹跺凡缁忎粙缁嶄簡prometheus鐨勫畨瑁呬笌閰嶇疆锛屽浜嶞a href="/index.php/7829-2">杩愮淮鐩戞帶鑰岃█锛岄櫎浜嗙洃鎺у睍绀轰互澶栵紝鍙︿竴涓噸瑕佺殑闇€姹傛棤鐤戝氨鏄憡璀︿簡銆傝壇濂界殑鍛婅鍙互甯姪杩愮淮浜哄憳鍙婃椂鐨勫彂鐜伴棶棰橈紝澶勭悊闂骞堕槻鑼冧簬鏈劧锛屾槸杩愮淮宸ヤ綔涓笉鍙垨缂虹殑閲嶈鎵嬫銆傛湰鏈熶箰缁村悰灏嗘暀澶у濡備綍prometheus鑷畾涔夊憡璀﹁鍒欒В鏋愬拰閰嶇疆銆侟/p>

1. 鏍囧噯鍛婅瑙勫垯鏍蜂緥浠ュ強鍚勭粍浠朵綔鐢?/h2>

浠ｇ爜濡備笅

groups:

– name: example

rules: – alert: HighErrorRate

expr: job:request_latency_seconds:mean5m{job=”myjob”} > 0.5

for: 10m

labels:

severity: page

annotations:

summary: High request latency description: description info

鍦ㄥ憡璀﹁鍒欐枃浠朵腑锛屾垜浠彲浠ュ皢涓€缁勭浉鍏崇殑瑙勫垯璁剧疆瀹氫箟鍦ㄤ竴涓猤roup涓嬨€傚湪姣忎竴涓猤roup涓垜浠彲浠ュ畾涔夊涓憡璀﹁鍒?rule)銆備竴鏉″憡璀﹁鍒欎富瑕佺敱浠ヤ笅鍑犻儴鍒嗙粍鎴愶細 alert锛氬憡璀﹁鍒欑殑鍚嶇О銆

expr锛氬熀浜嶱romQL琛ㄨ揪寮忓憡璀﹁Е鍙戞潯浠讹紝鐢ㄤ簬璁＄畻鏄惁鏈夋椂闂村簭鍒楁弧瓒宠鏉′欢銆侟/p>

for锛氳瘎浼扮瓑寰呮椂闂达紝鍙€夊弬鏁般€傜敤浜庤〃绀哄彧鏈夊綋瑙﹀彂鏉′欢鎸佺画涓€娈垫椂闂村悗鎵嶅彂閫佸憡璀︺€傚湪绛夊緟鏈熼棿鏂颁骇鐢熷憡璀︾殑鐘舵€佷负pending銆 labels锛氳嚜瀹氫箟鏍囩锛屽厑璁哥敤鎴锋寚瀹氳闄勫姞鍒板憡璀︿笂鐨勪竴缁勯檮鍔犳爣绛俱€侟/p>

2. 妯℃澘鍖栧憡璀﹁鍒橖/h2>

涓€鑸潵璇达紝鍦ㄥ憡璀﹁鍒欐枃浠剁殑annotations涓娇鐢╯ummary鎻忚堪鍛婅鐨勬瑕佷俊鎭紝description鐢ㄤ簬鎻忚堪鍛婅鐨勮缁嗕俊鎭€傚悓鏃禔lertmanager鐨刄I涔熶細鏍规嵁杩欎袱涓爣绛惧€硷紝鏄剧ず鍛婅淇℃伅銆備负浜嗚鍛婅淇℃伅鍏锋湁鏇村ソ鐨勫彲璇绘€э紝Prometheus鏀寔妯℃澘鍖杔abel鍜宎nnotations鐨勪腑鏍囩鐨勫€笺€傞€氳繃
$ labels. 1

鍙橀噺鍙互璁块棶褰撳墠鍛婅瀹炰緥涓寚瀹氭爣绛剧殑鍊笺€

$value 1

鍒欏彲浠ヨ幏鍙栧綋鍓峆romQL琛ㄨ揪寮忚绠楃殑鏍锋湰鍊笺€侟/p>

浠ｇ爜濡備笅

# To insert a firing element's label values:
2
{{ $labels. }}
3
# To insert the numeric expression value of the firing element:
4
{{ $value }}

渚嬪锛屽彲浠ラ€氳繃妯℃澘鍖栦紭鍖杝ummary浠ュ強description鐨勫唴瀹圭殑鍙鎬э細

浠ｇ爜濡備笅锛欬/p>

groups:
- name: example
rules:

# Alert for any instance that is unreachable for >5 minutes.
- alert: InstanceDown
expr: up == 0
for: 5m
labels:
severity: page
annotations:
summary: "Instance {{ $labels.instance }} down"
description: "{{ $labels.instance }} of job {{ $labels.job }} has been down for more than 5 minutes."

# Alert for any instance that has a median request latency >1s.
- alert: APIHighRequestLatency
expr: api_http_request_latencies_second{quantile="0.5"} > 1
for: 10m
annotations:
summary: "High request latency on {{ $labels.instance }}"
description: "{{ $labels.instance }} has a median request latency above 1s (current value: {{ $value }}s)"

3. 淇敼Prometheus閰嶇疆鏂囦欢prometheus.yml

rule_files:
- /etc/prometheus/rules/*.rules

鍦ㄧ洰褰?etc/prometheus/rules/涓嬪垱寤哄憡璀︽枃浠秇oststats-alert.rules鍐呭濡備笅锛欬/p>

浠ｇ爜濡備笅

groups:
- name: hostStatsAlert
rules:
- alert: hostCpuUsageAlert
expr: sum(avg without (cpu)(irate(node_cpu{mode!='idle'}[5m]))) by (instance) > 0.85
for: 1m
labels:
severity: page
annotations:
summary: "Instance {{ $labels.instance }} CPU usgae high"
description: "{{ $labels.instance }} CPU usage above 85% (current value: {{ $value }})"
- alert: hostMemUsageAlert
expr: (node_memory_MemTotal - node_memory_MemAvailable)/node_memory_MemTotal > 0.85
for: 1m
labels:
severity: page
annotations:
summary: "Instance {{ $labels.instance }} MEM usgae high"
description: "{{ $labels.instance }} MEM usage above 85% (current value: {{ $value }})"

鎬荤粨

浠ヤ笂灏辨槸prometheus鑷畾涔夊憡璀﹁鍒欒В鏋愬拰閰嶇疆鐨勫叏閮ㄥ唴瀹癸紝濡傛灉瀵逛綘鏈夋墍甯姪鐨勮瘽璇锋寔缁叧娉?a href="">涔愮淮瀹樼綉锛屼箰缁村悰浼氬畾鏈熸洿鏂版妧鏈垎浜紝鏇村寮€婧愮洃鎺ф妧鏈篃鍙互鍏虫敞涔愮淮绀惧尯锛坔ttps://forum.lwops.cn/锛堻/p>

Prometheus鎶€鏈垎浜€斺€攑rometheus鑷畾涔夊憡璀﹁鍒欒В鏋愬拰閰嶇疆鏈€鍏堝嚭鐜板湪涔愮淮瀹樼綉銆侟/p> ]]>