Graphite storing only 24hours data in whisper files

Asked by Madhurranjan

Hi,

We've a rule in the configuration file that looks like this :

[everything_5min_13months]
priority = 100
pattern = ^B\.Met\.*
retentions = 600:395d

We expect this to hold so many data points in the wsp file . When we do a whisper-info.py on the file , we get

whisper-info.py Passed.wsp
maxRetention: 34128000
xFilesFactor: 0.0
aggregationMethod: average
fileSize: 1365148

Archive 0
retention: 34128000
secondsPerPoint: 300
points: 113760
size: 1365120
offset: 28

We see above that there should be 113760 points overall in the whisper file but what we're noticing is that the number of data points in that file when I do a " whisper-fetch.py < > | wc -l " gives exactly 288 points , which at a 5 minute interval is exactly 1 day. Graphite shows the related graphing for previous days but another tool that we're using in order to query Graphite gets information for just the last day because of whisper .

How do we make sure it stores all the points and not just the last 24 hours inspite of whisper-info showing the correct information?

Thanks
Madhurranjan

Question information

Language:
English Edit question
Status:
Solved
For:
Graphite Edit question
Assignee:
No assignee Edit question
Solved by:
Madhurranjan
Solved:
Last query:
Last reply:
Revision history for this message
Michael Leinartas (mleinartas) said :
#1

whisper-fetch.py will by default only fetch the last 24 hours worth of points. You can fetch a different range by specifying --from and --to

In your case, to get the entire archive you can use:
whisper-fetch.py --from $(($(date '+%s')-1312149104)) <file>
Where 1312149104 is the maxRetention above. You may also be interested in looking at whisper-dump.py which gives a raw dump of the file's data.

Revision history for this message
Madhurranjan (mohanma) said :
#2

Thanks for the answer! Definitely very helpful.