Can Graphite be used in low resolution time series?

Asked by Eric

I have a stream of different metrics that will only be supplied once per day. For example, I will receive 'clicks per day' or 'accounts added per day'. Can graphite handle this? I've tried to implement something like this in graphite, but the graphs show that one point and is then disconnected when I put the next point in 24 hours later. They don't connect. It's as if Graphite was expecting a stream of constant data, which I won't be using it for.

Can someone provide an example for the scheme config file or a metric that will only be input once per day? I'd like for this data to never really be deleted.

I tried something like this:

[cdr]
pattern = ^cdr\.
retentions = 1d:6y

Also, if there is another technology that may be better for this resolution, please let me know.

Question information

Language:
English Edit question
Status:
Answered
For:
Graphite Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Jason Dixon (jason-dixongroup) said :
#1

You can do this but the timing might be weird. Better to probably do something like 1h:6y and set your xFilesFactor to 0.0.

Revision history for this message
Eric (ercmilla) said :
#2

Thanks for the response, Jason.

I confused because the XFilesFactor for [count] is already set to 0.

so if I enter the following: echo "cdr.count ${daily_cdr_value} `date +%s`" | nc -q0 127.0.0.1 2003
... I get the same problem where the data doesn't connect.

Revision history for this message
Jason Dixon (jason-dixongroup) said :
#3

Do you see any data with whisper-fetch.py?

Revision history for this message
Eric (ercmilla) said :
#4

sorry - what directory is that file in?

Revision history for this message
Jason Dixon (jason-dixongroup) said :
#5

By default it's installed at /usr/local/bin/whisper-fetch.py but it may differ on your system.

Revision history for this message
Eric (ercmilla) said :
#6

Another question for you: I see the usage ( Usage: whisper-fetch.py [options] path). What path do I need to pass to the program to get the data results you recommended that I check?

Thanks for all your help by the way!

Revision history for this message
Jason Dixon (jason-dixongroup) said :
#7

The whisper file that you're trying to debug.

Revision history for this message
Eric (ercmilla) said :
#8

Ah, got it. I ran it and here's a excerpt:

1421274360 None
1421274420 None
1421274480 None
1421274540 None
....

All were 'None'. The numbers appear to be seconds since epoch and 'None' means no data was received (educated guess).

Revision history for this message
Jason Dixon (jason-dixongroup) said :
#9

Ok, so it seems to me like your data simply isn't being accepted. You need to troubleshoot that.

Revision history for this message
Eric (ercmilla) said :
#10

So I just input data via the following command: echo "test.count 4 `date +%s`" | nc -q0 127.0.0.1 2003

the data showed up actually, so I don't think I have that issue:
1421362500 None
1421362560 1500.00000
1421362620 None

It's like the dates are going to fast for the amount of data I'm sending. I only want to input one data point per day.

Can you help with this problem?

Provide an answer of your own, or ask Eric for more information if necessary.

To post a message you must log in.