Prometheus metrics export

Metarank exports a set of internal metrics you can use to monitor its health. See the /metrics endpoint description for details on how to access them.
Application metrics
All application metrics have a common metarank_ prefix:
1.metarank_rank_requests: counter, number of requests received by the /rank endpoint. This metric also counts requests by model name.
metarank_rank_requests_total{model="model_name",} 5.0
1.metarank_feedback_events: counter, number of feedback events received both from API and any other connector (like kafka/pulsar/kinesis).
metarank_feedback_events_total 58441.0
1.metarank_rank_latency_seconds, histogram, latency distribution for /rank requests, scoped by a model. Percentiles tracked: 50%, 80%, 90%, 95%, 98%, 99%.
metarank_rank_latency_seconds{model="xgboost",quantile="0.5",} 0.011451508
metarank_rank_latency_seconds{model="xgboost",quantile="0.8",} 0.014340056
metarank_rank_latency_seconds{model="xgboost",quantile="0.9",} 0.119447575
metarank_rank_latency_seconds{model="xgboost",quantile="0.95",} 0.119447575
metarank_rank_latency_seconds{model="xgboost",quantile="0.98",} 0.119447575
metarank_rank_latency_seconds{model="xgboost",quantile="0.99",} 0.119447575
metarank_rank_latency_seconds_count{model="xgboost",} 5.0
metarank_rank_latency_seconds_sum{model="xgboost",} 0.16446094099999997
JVM metrics
Metarank also exports a set of default JVM metrics, related to buffers, classloaders, GC, allocation and threadpools.
All the JVM metrics have common jvm_ prefix.
Grafana dashboard
coming soon.

Last modified 3mo ago