Compatability with RRD Data Sources?

Asked by Joel

Since earlier versions of the code were based on RRD, would it be possible to allow reading of RRD data?

Many users will have years of old RRD data that they'd like to try with the Graphite front end.

If you aren't interested in supporting both data storage mechanisms, do you provide a simple "convert from RRD to Graphite"
technique?

Thanks,

--Joel

Question information

Language:
English Edit question
Status:
Answered
For:
Graphite Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
chrismd (chrismd) said :
#1

Your absolutely right, we even have a lot of RRD data of our own and since Graphite originally used RRD the support is still there for reading RRD files. In the Graphite storage directory there is an empty rrd/ subdirectory. Copy or symlink any directories containing your existing RRD files to be underneath this directory and they will become available in Graphite transparently. The only caveat is that you must have the python rrdtool bindings installed (test by running 'import rrdtool' from a python prompt). Note however that it is not possible to update RRD files with Graphite, as all updates are done to whisper database files.

Revision history for this message
Joel (jkrauska-gmail) said :
#2

Awesome, got an rrddump recipe for converting a rrd data store to whisper?

Revision history for this message
chrismd (chrismd) said :
#3

Not currently but I will add that to my list. I'm making a handful of scripts to make working with whisper files easier (basic create/update/fetch operations, resize, etc). It should make it into the next release probably.

Revision history for this message
bruno marcondes (bmarcondes) said :
#4

Hey Joel, Chris

I'm trying to make the RRD files from collectd work on graphite without success, it seems that the web front-end recognizes the rrd files as directories in the path instead of graphing it, the logs didn't help much, no errors .... :-(

Any ideas?

Revision history for this message
chrismd (chrismd) said :
#5

Are they empty directories? The reason Graphite shows RRD files as directories when you are browsing is because each RRD file contains one or more data sources, so the RRD file itself is represented as a folder and the datasources are represented as files. If it is empty when you try to open it, then it is having a problem reading the RRD files. Do you have the rrdtool python module installed?

Revision history for this message
Cristian Leonte (cristian-leonte) said :
#6

Hi i have a problem with showing rrds too, trying to see rrds from ganglia, and i get this message:

RRDDataSource instance has no attribute 'real_metric'
Request Method: GET
Request URL: http://localhost:8000/render/?width=300&height=205&target=alias(ToraCluster.__SummaryInfo__.bytes_in.sum%2C'Bytes%20In')&target=alias(ToraCluster.__SummaryInfo__.bytes_out.sum%2C'Bytes%20Out')&vtitle=packets&title=ToraCluster&from=1292931725&yMin=0&bgcolor=FFFFFF&fgcolor=000000
Exception Type: AttributeError
Exception Value:
RRDDataSource instance has no attribute 'real_metric'
Exception Location: /opt/graphite/webapp/graphite/render/datalib.py in fetchData, line 205
Python Executable: /usr/bin/python
Python Version: 2.4.3

Revision history for this message
chrismd (chrismd) said :
#7

Thanks for the details Cristian, this was a simple bug and I just committed a fix to trunk. This will be in the upcoming release in the next few days.

Can you help with this problem?

Provide an answer of your own, or ask Joel for more information if necessary.

To post a message you must log in.