Improving the performance of Grafana Dashboards

Monitoring and Observability Grafana
#1

Hello, How to improve the performance of grafana dashboards? Is there any caching which could be implemented? Thanks.

#2

What data source(s) are you using?

#3

Pulling the data from prometheus servers which are pulling the metrics from all datasources , collecting metrics from unix servers, db servers, windows servers etc.

#4

The slowness might be on those data sources.

#5

Best way to test performance is to run those same queries in querying tool(s) for those data sources. or to examine network tab in dev tools in your browser to see which part takes long time

#6

What kind of web server grafana uses under the hood?

#7

Not sure. good question

#8

Ok, let me post it on the main channel

#9

Not sure how that helps with your performance

#10

So like understanding if any caching can be configured

#11

Goal is to render the grafana dashboard faster. Grafana is pulling the data from load balanced prometheus servers which are pulling the metrics from from unix servers, db servers, windows servers etc. CPU/memory utilization are all good on the grafana server and the prometheus servers. 1) What could be done to improve the performance the Grafana dashboard? 2) What kind of web server it is using? 3) Any caching can be configured grafana web server?

#12

In some data sources there is setting for caching.

#13

But not all data sources might have it

#14

https://grafana.com/blog/2021/09/02/reduce-costs-and-increase-performance-with-query-caching-in-grafana-cloud/

#15

And also depends on version of grafana

#16

Hi, I am using default SQLlite database with Grafana. Can that cause performance issue in dashboard rendering? Shall i migrate SQLlite to MariaDB ?

#17

It could. but that might not be the issue. you need to vet things out with your data sources as mentioned before but doesn’t seem you are interested in investigating those recommendations.

#18

Caching is also not necessarily a silver bullet. many people think it is without addressing other issues

#19

I already did that analysis and data sources metrics are coming up quick on prometheus servers. so data sources is not a problem. Grafana is pulling the metrics from prometheus servers.

#20

And what are the stats/metrics for running the query in prometheus? What is the performance in grafana? in seconds ?