Questions tagged [graphite]
Graphite is a highly scalable real-time graphing system. As a user, you write an application that collects numeric time-series data that you are interested in graphing, and send it to Graphite's processing backend, carbon, which stores the data in Graphite's specialized database. The data can then be visualized through graphite's web interfaces.
91
questions
28
votes
2
answers
21k
views
What is the difference between OpenTSDB and Graphite?
As far as I can tell, here are the main differences:
OpenTSDB does not deteriorate data over time, unlike Graphite where the size of the database is pre-determined.
OpenTSDB can store metrics per ...
- 382
17
votes
1
answer
1k
views
Highly-available, Web-accessible and scalable deployment of statsd and graphite
I'd like to setup statsd/graphite so that I can log JS apps running on HTML devices (ie. not in a contained LAN environment, and possibly with a large volume of incoming data that I don't directly ...
- 353
16
votes
4
answers
23k
views
Getting client denied when accessing a wsgi graphite script
I'm trying to set up graphite on my Mac OS X 10.7 lion, i've set up apache to call the python graphite script via WSGI, but when i try to access it, i get a forbiden from apache and in the error log.
...
- 231
15
votes
4
answers
11k
views
Disk Capacity Planning for Whisper / Graphite
Does anyone have any formulas, or maybe some sample data from their environment that can help me estimate how much disk space will be used by graphite per datapoint?
- 84.6k
14
votes
4
answers
2k
views
tcpdump increases udp performance
I'm running a set of load tests to determine the performance of the following setup:
Node.js test suite (client) --> StatsD (server) --> Graphite (server)
In short, the node.js test suite ...
- 149
14
votes
5
answers
13k
views
How do you delete a counter in graphite whisper?
I have a counter at stats.message.foo and want to move it to stats.messages.foo.
I've updated my code to populate the new counter, however the old one still exists.
I've read all I need to do to ...
- 762
12
votes
2
answers
5k
views
Ext4 usage and performance
I've got a cluster of machines running Carbon and Graphite that I need to scale for more storage, but I'm not sure if I need to scale up or out.
The cluster is currently comprised of:
1 Relay Node: ...
- 2,161
10
votes
3
answers
7k
views
calculating days until disk is full
We use graphite to track history of disk utilisation over time. Our alerting system looks at the data from graphite to alert us when the free space falls below a certain number of blocks.
I'd like to ...
- 859
9
votes
3
answers
1k
views
Load avg weirdness on Linux Ubuntu
In past few days I've been trying to understand the weirdness which is happening in our infrastructure but I haven't been able to figure it our so I'm turning to you guys to give me some hints.
I've ...
- 1,908
8
votes
2
answers
15k
views
Graphite shows "None" for all data points even though I send it data
I have installed Graphite via Puppet (https://forge.puppetlabs.com/dwerder/graphite) with nginx and PostgresSQL. When I send it data manually, it creates the metric but all its data points are "None" (...
- 393
8
votes
1
answer
40k
views
How to change grafana units of measurement on Y-axis? [closed]
I am gathering data from servers by collectd and store it in the graphite.
I want to use grafana dashboards. I am trying to create visualisation for memory plugin. In graphite I am seeing data in Mb, ...
- 91
8
votes
2
answers
3k
views
Graphite stops collecting data randomly
We have a Graphite server to collect data through collectd, statsd, JMXTrans ... Since a few days, we frequently have holes in our data. Digging through the data we still have, we can see an increase ...
- 1,063
7
votes
1
answer
1k
views
The benefits of using statsd?
So I've been playing around with graphite for the past few days and I can see the potential there and why it is so powerful.
My main question is why should I use statsd in front of it like esty and ...
- 22.5k
6
votes
3
answers
12k
views
How To Tell Puppet To Only Install Using Pip If A File Doesn't Exist
I am using Puppet to install some Python packages using pip. I'm using Puppet 2.7, so my package declarations look something like this:
package { "carbon":
require => Class["graphite::prereqs:...
- 549
6
votes
2
answers
2k
views
VM CPU usage at 100%
CPU usage on our metrics box is at 100% intermittently causing:
'Internal server error' when rendering Grafana dashboards
The only application running on our machine is Docker with 3 subcontainers ...
- 61
6
votes
1
answer
5k
views
Secure Graphite installation
I think I misunderstand something here. I've installed Graphite with Docker (sitespeedio/graphite) and set a Basic Auth for the Web-Panel. I opened the Firwall for Port 2003 to get in datapoints from ...
- 1,233
5
votes
3
answers
18k
views
Graphite SNMP Counter transforms
I'm using graphite version 0.9.10 to read ifHCInOctets and ifHCOutOctets, which I'm polling with the collectd snmp and graphite_write plugins; I'm using collectd version 5.1.0.
Data arrives into ...
- 8,379
4
votes
1
answer
1k
views
Graphite data disappears if period greater than 30 minutes requested
This is a fairly new Graphite installation on CentOS 6.5. It's receiving metrics via AMQP (RabbitMQ) from Sensu.
As a proof-of-concept, I have a load-average monitor reporting data to sensu/graphite ...
- 965
4
votes
1
answer
3k
views
Statsd, Graphite and graphs
I've setup Graphite and statsd and both are running well. I'm using the example-client.py from graphite/examples to measure load values and it's OK.
I started doing tests with statsd and at first it ...
- 1,164
4
votes
1
answer
5k
views
How to display a graphite graph of used memory when you have total memory and free memory
My servers send mem_total and mem_free metrics to Graphite, but I'd like to display mem_used on my dashboard. I'm currently solving the problem by doing:
offset(scale(servers.foo.*.mem_free,-1),...
- 41
4
votes
4
answers
2k
views
LDAP authentication with Graphite
I have setup Graphite Web 0.9.9 on CentOS 6.2 x86_64 at EC2 and I'm trying to get LDAP authentication to work against 389 Directory Server. I have configured local_settings.py with:
USE_LDAP_AUTH
...
- 1,071
4
votes
0
answers
303
views
How does one publish statsd stats for consumption by graphite?
We're just now getting to grips with statsd+graphite, and we (think we) want to look at graphs sliced differently. For example, say we have a website foo that is multi-tenanted to 3 customers and ...
- 1,273
3
votes
2
answers
3k
views
Graphite/Carbon cluster returning incomplete data
Trying to setup a Graphite/Carbon cluster. I have an elastic load balancer that directs traffic between two nodes in my cluster, each with one web app, relay, and cache.
In this example, I sent 1000 ...
- 363
3
votes
1
answer
3k
views
What's the safest way to backup a graphite whisper database?
What's the safest way to backup a graphite whisper database, is it safe to just use tar or is there another method required to prevent corruption?
- 774
3
votes
1
answer
806
views
How to read back collectd and write_kafka plugin
I want to use kafka as a transport layer for collectd. I found that there is a write_kafka plugin for collectd, which sends all the gathered metrics to a kafka topic.
My intention was to have a few ...
- 1,406
3
votes
1
answer
3k
views
Graphite SQLite3 DatabaseError: database is locked
While going through the initial installation and set up of Graphite on CentOS 6.4 using Apache mod_wsgi via the stock graphite-web rpm, I'm getting the following "DatabaseError: database is locked" ...
- 153
3
votes
1
answer
2k
views
Graphite not running
I'm currently trying to install graphite 0.9.9 on a gentoo box using these instructions from the graphite wiki. Essentially, it fronts graphite using apache and mod_wsgi.
Everything seems to have ...
- 143
2
votes
2
answers
10k
views
Graphite SQLite3 DatabaseError: attempt to write a readonly database
Running graphite under apache httpd, with slqite database, I have the correct folder permissions
[root@liaan55 httpd]# ls -ltr /var/lib | grep graphite
drwxr-xr-x. 2 apache apache 4096 ...
- 537
2
votes
1
answer
2k
views
Can Graphite chart an average value from multiple sources?
Let's say, we collect NTP-offset statistics from 500 servers. Each is known to Graphite as stats.hostname.ntpstats.offset.
I'd like my chart to show two curves:
A particular host's offset (easy)
The ...
- 2,411
2
votes
1
answer
3k
views
Icinga2 perfdata directory is overflowed
I`ve installed icinga2 on a virtual machine for monitoring 5 other ones with graphite support for the graphics and icingaweb2 as an interface. Recently on my web interface I got the follow:
Fatal ...
- 33
2
votes
2
answers
2k
views
Should logs for /opt go in /var/opt or /var/log?
A package I'm using (Graphite) insists on installing into /opt/graphite.
Should logs go into /var/opt/graphite/log, or /var/log/graphite?
Presume we want to be as FHS as possible. I'm using CentOS ...
- 185
2
votes
1
answer
5k
views
Collectd and graphite imports data every 5 minutes, rather than 1 minute
I'm a bit new to graphite, so bear with me on this. I'm looking into alternatives for a large and fairly unwieldy cacti installation, so I've been playing with graphite. We pull a lot of data via SNMP,...
- 8,060
2
votes
1
answer
3k
views
Statsd messages not showing up in Graphite dashboard
Ubuntu 11.10
Everything worked when I first setup statsd and graphite. Once I rebooted, it no longer works, which makes me think something about graphite or carbon needs to be started.
Now that I'...
- 375
2
votes
1
answer
542
views
Graphite (or carbon) seems to be overwriting data and not aggregating
I have reinstalled from the ground up our Graphite server to begin automating it.
I don't know what but I must have forgotten some kind of configuration because now our data only shows the latest ...
- 185
2
votes
1
answer
649
views
Graphite: aggregation method for counters
I am going to put an ever increasing counter value into Graphite. I'm not sure what I should use for the aggregation method. I think it would either be "min" or "max". The default of "average" ...
- 511
2
votes
2
answers
2k
views
Graphite is plotting increments from Logstash in float
I was trying to mimic this logstash.net/docs/1.1.0/tutorials/metrics-from-logs
I have following setup
nginx(app server) ==sends the increment==>Etsy statsD=====>Graphite
This setup is working fine ...
- 2,558
2
votes
1
answer
891
views
Graphite Clustered Webapp - Not Sharing Data
I have Graphite setup on three instances on EC2:
carbon-relay - relay1.graphite.prod.example.ec2
carbon-cache + webapp - cache3.graphite.prod.example.ec2
carbon-cache + webapp - cache4.graphite.prod....
- 1,071
2
votes
2
answers
4k
views
Collectd write_graphite plugin - multiple/different prefixes?
I'm using collectd with the snmp and write_graphite plugins. I want certain metrics to go to Graphite with prefix A, and others to go with prefix B, to keep the data in Graphite/Whisper organized.
...
- 21
2
votes
0
answers
620
views
How do I prevent graphite from filling up my primary disk on ubuntu in EC2?
I am running graphite (per reading this blog by Etsy) on an Ubuntu 10.10 linux install on EC2. Basically it works, except that my server is constantly exhausting reported free disk space. I say ...
- 335
1
vote
2
answers
1k
views
New Graphite installation doesn't render fonts in graphs (except Courier)
I've been studying this problem for a couple of days now without success ...
I've configured and deployed Graphite (with carbon and whisper) using the Puppet Graphite module on a CentOS 6.5 server. ...
- 965
1
vote
1
answer
3k
views
Multiple wildcards with asPercent in Graphite
I have multiple series for stats.counters.app.view.isbn.fetch.found.{yes,no}.$service. I want to calculate the failure rate per $service.
#A reduceSeries(mapSeries(group(#B, #C), 0), 'asPercent', 1, '...
- 203
1
vote
1
answer
87
views
Move series up in grafana dashboard
I would like to move series up and down in Grafana / Graphite dashboard.
I'm aware to the special button "move up" and "move down", but I need for example to move 4 rows from the bottom to the top in ...
- 11
1
vote
1
answer
342
views
hardening graphite (Carbon)
I would like to use graphite to collect metrics from different servers.
By default, carbon listens on 2003 on all interfaces, which is fine with me.
Now anyone could theoretically send metric data ...
- 541
1
vote
1
answer
80
views
Aggregating stats from events old and new
We'd like to feed CDN logs into Graphite and aggregate numbers found in there (rate of different HTTP status-codes, average response sizes, average cache-hit ratio, etc.)
However, the logs are only ...
- 2,411
1
vote
1
answer
7k
views
How can I calculate bandwidth usage per day or hour with Grafana, graphite and collectd?
I'd like to collect the bytes sent and received per day or per hour of a server, so I can collect bandwidth requirements.
I figured setting up grafana, graphite and collectd to collect bandwidth ...
- 4,043
1
vote
1
answer
1k
views
Is Ganglia's RRD module a bottleneck?
I want to monitor a LOT of metrics on a lot of machines, and from Graphite website, I noticed that ganglia's RRD compoent probably impose scalability issue from the following FAQ explaining why ...
- 339
1
vote
1
answer
3k
views
How to sum three metrics for each host given a wildcard list of hosts in Graphite Web?
I've got three metrics "memoryFree", "memoryBuffered", "memoryCached". These metrics appear under each of the ec2 hosts in the following metric tree:
system.radar123.collectd.ec2*_com.memory.
For each ...
- 2,755
1
vote
1
answer
48k
views
grafana: how to sum values from query into a singlestat or other plugin?
Is it possible to make a sum of values - depending on multi-selections in query (templating) - and showing those in a singlestat plugin in grafana?
setup:
grafana 3.1.1
datatsource: graphite
Use ...
- 91
1
vote
1
answer
1k
views
Grafana: ip and port of your graphite-web or graphite-api install
Trying to connect graphite with grafana. The manual says:
Url The http protocol, ip and port of your graphite-web or
graphite-api install.
Where I can find either of them? I grep-ed /opt/...
- 2,347
1
vote
1
answer
699
views
Aggregate Disks in Collectd or Graphite/Grafana
I have multiple nodes, each with multiple disks of the same size. I'd like for either
collectd to report a single used/free metric that is the aggregate of these multiple disks
construct a grafana ...
- 135