Graphite

I cannot get the graphs to display more than a 24 hour period

Asked by Gabe Harriman

There is plenty of data in the system now, but the graph will not show a date range of more than 24 hours (any 24 hour period - not just the last 24 hours).

Changing the "Recent Time Range" to anything more than 1 day will only show the past 24 hours of data.

Changing the "Time Range" using the calendar, I can select previous days and the graph will seem to render correctly, but if I choose anything more than 1 day it seems to only render the last 24 hours.

Here's my schema:

[securities]
priority = 100
pattern = ^securities\.
retentions = 1:2592000,3600:157680000

I think the retention I have is overkill, but I wanted to weed out the possibility that the data wasn't being stored long enough.

Am I doing something wrong?

Here's data for a given date range of more than 24 hours (using rawdata=true):

/render/?width=1061&height=576&_salt=1286555252.643&target=securities.x.events_per_hour&from=-36hours

securities.x.events_per_hour,1286468880,1286555280,60|19.0,19.0,19.0,19.0,20.0,19.0,19.0,18.0,18.0,19.0,18.0,18.0,16.0,16.0,15.0,15.0,None,15.0,15.0,15.0,14.0,14.0,14.0,14.0,14.0,14.0,14.0,13.0,13.0,12.0,11.0,11.0,12.0,12.0,12.0,12.0,11.0,11.0,10.0,10.0,10.0,9.0,9.0,8.0,8.0,8.0,7.0,8.0,9.0,10.0,10.0,11.0,15.0,16.0,16.0,16.0,15.0,15.0,15.0,15.0,15.0,15.0,15.0,16.0,16.0,16.0,16.0,17.0,17.0,17.0,17.0,16.0,16.0,16.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,16.0,16.0,16.0,16.0,16.0,16.0,18.0,18.0,18.0,18.0,18.0,18.0,18.0,17.0,17.0,16.0,15.0,14.0,14.0,14.0,10.0,10.0,9.0,9.0,9.0,9.0,9.0,10.0,11.0,11.0,11.0,10.0,9.0,9.0,9.0,8.0,7.0,7.0,8.0,8.0,9.0,9.0,9.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,9.0,9.0,9.0,9.0,9.0,9.0,9.0,9.0,9.0,10.0,10.0,10.0,10.0,9.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,7.0,7.0,7.0,7.0,7.0,7.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,6.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,5.0,5.0,4.0,4.0,3.0,3.0,3.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,5.0,5.0,5.0,7.0,8.0,9.0,9.0,9.0,9.0,9.0,8.0,8.0,8.0,9.0,9.0,9.0,9.0,9.0,9.0,9.0,9.0,9.0,10.0,10.0,10.0,10.0,11.0,11.0,11.0,12.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,13.0,12.0,12.0,13.0,13.0,15.0,15.0,15.0,14.0,14.0,14.0,14.0,14.0,14.0,13.0,13.0,12.0,12.0,9.0,9.0,8.0,8.0,8.0,8.0,8.0,9.0,9.0,8.0,8.0,9.0,9.0,9.0,9.0,9.0,10.0,10.0,9.0,9.0,9.0,9.0,9.0,8.0,8.0,7.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,8.0,7.0,7.0,7.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,5.0,4.0,4.0,4.0,4.0,3.0,3.0,3.0,3.0,4.0,4.0,4.0,4.0,4.0,5.0,4.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,3.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,4.0,6.0,8.0,7.0,8.0,9.0,9.0,11.0,11.0,11.0,12.0,13.0,15.0,16.0,18.0,17.0,18.0,18.0,18.0,18.0,18.0,17.0,17.0,17.0,18.0,18.0,18.0,22.0,22.0,23.0,23.0,23.0,23.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,24.0,25.0,25.0,25.0,26.0,26.0,27.0,28.0,29.0,29.0,29.0,30.0,28.0,27.0,28.0,28.0,27.0,26.0,26.0,25.0,26.0,27.0,26.0,26.0,25.0,22.0,22.0,22.0,22.0,22.0,22.0,23.0,23.0,25.0,25.0,24.0,25.0,25.0,24.0,22.0,22.0,21.0,21.0,21.0,20.0,20.0,20.0,20.0,20.0,20.0,20.0,21.0,21.0,21.0,21.0,22.0,23.0,24.0,24.0,24.0,23.0,23.0,22.0,22.0,23.0,21.0,21.0,20.0,21.0,20.0,20.0,22.0,20.0,22.0,23.0,24.0,25.0,24.0,23.0,24.0,23.0,23.0,21.0,22.0,23.0,23.0,23.0,23.0,23.0,23.0,22.0,20.0,20.0,21.0,20.0,20.0,20.0,20.0,21.0,21.0,22.0,23.0,23.0,23.0,23.0,23.0,24.0,26.0,26.0,24.0,25.0,25.0,27.0,26.0,28.0,26.0,26.0,26.0,26.0,27.0,27.0,28.0,28.0,28.0,30.0,30.0,29.0,29.0,29.0,27.0,27.0,25.0,24.0,24.0,24.0,23.0,24.0,23.0,23.0,23.0,24.0,23.0,23.0,22.0,22.0,21.0,21.0,21.0,21.0,21.0,21.0,20.0,20.0,20.0,20.0,19.0,18.0,18.0,18.0,17.0,17.0,17.0,17.0,17.0,17.0,15.0,14.0,14.0,14.0,13.0,13.0,12.0,10.0,10.0,11.0,12.0,12.0,11.0,12.0,11.0,12.0,11.0,10.0,12.0,12.0,12.0,12.0,12.0,12.0,12.0,12.0,14.0,13.0,13.0,13.0,12.0,12.0,13.0,14.0,14.0,14.0,14.0,15.0,15.0,15.0,15.0,15.0,16.0,17.0,17.0,17.0,17.0,17.0,17.0,18.0,19.0,19.0,18.0,18.0,20.0,20.0,20.0,20.0,20.0,20.0,21.0,21.0,21.0,20.0,20.0,20.0,20.0,22.0,21.0,20.0,21.0,21.0,20.0,19.0,19.0,19.0,18.0,18.0,18.0,20.0,21.0,22.0,23.0,24.0,23.0,23.0,23.0,23.0,24.0,24.0,24.0,23.0,22.0,22.0,22.0,21.0,21.0,21.0,21.0,22.0,22.0,20.0,20.0,20.0,20.0,20.0,20.0,20.0,20.0,20.0,21.0,21.0,21.0,19.0,19.0,20.0,21.0,21.0,21.0,22.0,22.0,22.0,22.0,22.0,23.0,21.0,21.0,22.0,22.0,22.0,25.0,26.0,26.0,28.0,28.0,27.0,27.0,26.0,25.0,24.0,23.0,23.0,25.0,24.0,24.0,24.0,24.0,23.0,23.0,24.0,25.0,26.0,26.0,27.0,29.0,30.0,31.0,30.0,31.0,31.0,32.0,32.0,32.0,32.0,32.0,32.0,33.0,34.0,33.0,33.0,33.0,35.0,37.0,39.0,37.0,37.0,38.0,38.0,40.0,40.0,40.0,41.0,41.0,42.0,43.0,42.0,42.0,42.0,41.0,39.0,38.0,36.0,35.0,35.0,35.0,35.0,35.0,35.0,34.0,33.0,33.0,31.0,31.0,31.0,31.0,31.0,32.0,31.0,30.0,30.0,28.0,27.0,25.0,25.0,24.0,23.0,24.0,23.0,24.0,24.0,26.0,27.0,27.0,27.0,28.0,25.0,26.0,26.0,27.0,26.0,23.0,21.0,23.0,23.0,23.0,22.0,18.0,19.0,19.0,18.0,18.0,16.0,15.0,15.0,15.0,15.0,14.0,14.0,14.0,14.0,15.0,17.0,17.0,17.0,18.0,18.0,18.0,18.0,19.0,19.0,20.0,20.0,21.0,21.0,22.0,23.0,23.0,23.0,24.0,24.0,24.0,25.0,25.0,25.0,24.0,24.0,23.0,23.0,20.0,20.0,19.0,19.0,17.0,17.0,17.0,16.0,16.0,15.0,15.0,15.0,13.0,13.0,13.0,13.0,13.0,15.0,16.0,16.0,16.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,17.0,16.0,17.0,17.0,18.0,17.0,17.0,17.0,17.0,17.0,16.0,16.0,15.0,14.0,14.0,14.0,12.0,11.0,12.0,12.0,11.0,11.0,11.0,13.0,13.0,15.0,15.0,15.0,15.0,15.0,17.0,19.0,19.0,20.0,20.0,20.0,21.0,21.0,21.0,21.0,21.0,21.0,23.0,24.0,24.0,24.0,24.0,22.0,21.0,21.0,20.0,20.0,20.0,21.0,21.0,21.0,21.0,22.0,22.0,23.0,21.0,21.0,20.0,20.0,20.0,20.0,21.0,21.0,21.0,21.0,22.0,22.0,22.0,22.0,23.0,24.0,23.0,23.0,23.0,23.0,24.0,23.0,24.0,24.0,23.0,24.0,24.0,24.0,24.0,22.0,20.0,20.0,19.0,19.0,19.0,18.0,19.0,19.0,19.0,19.0,17.0,16.0,16.0,17.0,17.0,17.0,16.0,16.0,16.0,16.0,17.0,16.0,16.0,17.0,17.0,18.0,18.0,19.0,19.0,19.0,19.0,19.0,19.0,20.0,21.0,21.0,22.0,22.0,22.0,24.0,24.0,24.0,25.0,25.0,25.0,25.0,26.0,27.0,26.0,26.0,24.0,23.0,23.0,24.0,25.0,26.0,26.0,26.0,26.0,26.0,26.0,26.0,28.0,28.0,27.0,28.0,28.0,29.0,29.0,29.0,29.0,28.0,29.0,29.0,29.0,29.0,29.0,29.0,29.0,29.0,29.0,29.0,28.0,27.0,26.0,25.0,24.0,24.0,28.0,28.0,30.0,29.0,27.0,28.0,27.0,28.0,27.0,27.0,25.0,25.0,24.0,24.0,23.0,23.0,24.0,23.0,23.0,23.0,23.0,23.0,25.0,23.0,22.0,22.0,22.0,22.0,22.0,22.0,22.0,23.0,22.0,24.0,26.0,29.0,30.0,34.0,40.0,44.0,49.0,50.0,50.0,50.0,54.0,55.0,56.0,59.0,60.0,59.0,60.0,63.0,66.0,71.0,72.0,72.0,73.0,74.0,76.0,71.0,70.0,69.0,69.0,68.0,70.0,70.0,69.0,69.0,70.0,71.0,71.0,72.0,72.0,74.0,73.0,72.0,72.0,72.0,72.0,72.0,72.0,71.0,72.0,72.0,75.0,75.0,75.0,75.0,75.0,76.0,75.0,73.0,71.0,68.0,65.0,63.0,59.0,51.0,49.0,47.0,46.0,48.0,46.0,44.0,44.0,42.0,40.0,41.0,42.0,43.0,40.0,36.0,35.0,36.0,38.0,37.0,37.0,38.0,41.0,41.0,41.0,42.0,41.0,40.0,41.0,41.0,42.0,41.0,41.0,40.0,40.0,39.0,40.0,40.0,41.0,42.0,41.0,41.0,41.0,41.0,41.0,41.0,38.0,39.0,41.0,41.0,42.0,43.0,43.0,43.0,44.0,48.0,50.0,50.0,50.0,51.0,50.0,50.0,49.0,48.0,46.0,47.0,47.0,50.0,50.0,50.0,50.0,48.0,47.0,47.0,49.0,50.0,49.0,49.0,48.0,52.0,52.0,52.0,52.0,51.0,51.0,53.0,52.0,53.0,52.0,52.0,53.0,54.0,54.0,55.0,55.0,55.0,54.0,61.0,61.0,61.0,62.0,61.0,60.0,59.0,60.0,60.0,59.0,59.0,58.0,56.0,57.0,57.0,56.0,56.0,52.0,52.0,52.0,53.0,52.0,53.0,53.0,53.0,53.0,52.0,52.0,49.0,48.0,47.0,47.0,45.0,45.0,44.0,42.0,40.0,39.0,38.0,38.0,32.0,32.0,29.0,29.0,29.0,29.0,29.0,28.0,29.0,28.0,29.0,28.0,28.0,28.0,27.0,27.0,26.0,27.0,25.0,20.0,19.0,18.0,20.0,21.0,23.0,23.0,22.0,21.0,21.0,21.0,21.0,20.0,21.0,22.0,21.0,21.0,20.0,21.0,20.0,21.0,20.0,20.0,22.0,23.0,24.0,25.0,25.0,25.0,26.0,26.0,27.0,29.0,29.0,30.0,31.0,33.0,33.0,33.0,33.0,33.0,33.0,35.0,35.0,36.0,39.0,38.0,37.0,36.0,36.0,37.0,36.0,36.0,35.0,35.0,35.0,35.0,34.0,34.0,34.0,34.0,33.0,32.0,31.0,31.0,30.0,33.0,33.0,34.0,35.0,36.0,35.0,35.0,36.0,35.0,36.0,37.0,37.0,36.0,36.0,37.0,40.0,41.0,41.0,43.0,46.0,46.0,49.0,48.0,49.0,46.0,46.0,46.0,45.0,45.0,47.0,47.0,48.0,49.0,49.0,49.0,50.0,50.0,50.0,49.0,51.0,54.0,56.0,56.0,56.0

Question information

Language:
English Edit question
Status:
Solved
For:
Graphite Edit question
Assignee:
No assignee Edit question
Solved by:
chrismd
Solved:
Last query:
Last reply:
Revision history for this message
Best chrismd (chrismd) said : 		#1

Hi Gabe. The storage schemas configuration only applies when metrics are first sent to Graphite as it is used to pre-allocate the space for them. If you sent your data, then noticed the 24-hour retention issue, then changed the storage-schemas.conf, the wsp files themselves would not be changed. I'd recommend deleting the files and then sending more data. You can look at the carbon-cache/creates.log file to see what storage schema the wsp files get created with.

In general you can resize wsp files with the whisper-resize.py script that should come bundled with whisper. You can also verify the configuration of the files as they are on disk with the whisper-info.py script, but the quickest fix is probably to verify your storage-schemas.conf and delete the wsp files.

Revision history for this message
Gabe Harriman (r-launchpad-mynameisgabe-com) said : 		#2

ok! I think that's working. It's still building the files so I can't really tell for sure, but the correct schema has definitely taken effect. My storage files went from 17k to 1.8G! =)

The docs should be updated with the correct schema file (http://graphite.wikidot.com/getting-your-data-into-graphite):

"Once you have picked your naming scheme and answered all of the retention questions, you need to create a schema by creating/editing the /usr/local/graphite/storage/schemas file."

Revision history for this message
Gabe Harriman (r-launchpad-mynameisgabe-com) said : 		#3

Thanks chrismd, that solved my question.