Summarize and sumSeries returning null values

Asked by Jeff Escamilla

I have a weird issue when using summarize with an embedded sumSeries function. For whatever reason it will not display more than 5 results (the rest are returned as nulls). Additionally, I can start "walking back" my time frame and it will reduce the number of results it returns by 1 each time until I am left with one value and the rest null.

Dataset examples:
group.type1.site1.subsite1.totalcount
group.type2.site1.subsite1.totalcount
group.type1.site2.subsite2.totalcount
group.type2.site2.subsite2.totalcount
...
group.type3.site3.subsite3.totalcount

Query being used:
/render?target=summarize(sumSeries(group.*.*.*.totalcount),'1w','max','true')&from=20130201&until=20130331&format=json

My return is as follows:
[{"target": "summarize(sumSeries(group.*.*.*.totalcount), \"1w\")", "datapoints": [[479782.0, 1359702000], [480935.0, 1360306800], [482104.0, 1360911600], [482619.0, 1361516400], [482712.0, 1362121200], [null, 1362726000], [null, 1363330800], [null, 1363935600], [null, 1364540400]]}]

If I start walking back the until date by a week at a time (in keeping with the grouping otherwise I get an invalid time format) I get the following:

until=20130324 - [{"target": "summarize(sumSeries(group.*.*.*.totalcount), \"1w\")", "datapoints": [[479780.0, 1359702000], [480934.0, 1360306800], [482104.0, 1360911600], [482097.0, 1361516400], [null, 1362121200], [null, 1362726000], [null, 1363330800], [null, 1363935600]]}]

until=20130317 - [{"target": "summarize(sumSeries(group.*.*.*.totalcount), \"1w\")", "datapoints": [[479780.0, 1359702000], [480934.0, 1360306800], [481223.0, 1360911600], [null, 1361516400], [null, 1362121200], [null, 1362726000], [null, 1363330800]]}]

until=20130310 - [{"target": "summarize(sumSeries(group.*.*.*.totalcount), \"1w\")", "datapoints": [[479780.0, 1359702000], [480053.0, 1360306800], [null, 1360911600], [null, 1361516400], [null, 1362121200], [null, 1362726000]]}]

until=20130303 - [{"target": "summarize(sumSeries(group.*.*.*.totalcount), \"1w\")", "datapoints": [[478670.0, 1359702000], [null, 1360306800], [null, 1360911600], [null, 1361516400], [null, 1362121200]]}]

It seems to be counting and creating the correct number of "buckets" for the number of weeks, but it doesn't seem like it's summarizing for the full amount of time.

I am using a 1 hour retention for 7 days, and then 1 day for a year (just realized I need to up that). So I wouldn't think it's a data collection issue. Additionally if I remove either the sumSeries or summarize and use them separately they both return all of their intended values.

It does this if I am using alignToFrom or not, doesn't matter if I use sum,max,last or avg or my methods either. Additionally, I can get this to happen on a monthly interval as well. The odd thing is, it doesn't happen if I specify a date range shorter than 5 weeks at first.

I'm thinking this could potentially be a bug between the interaction of the two. Can anyone offer any insight?

Thanks!
Jeffe

Question information

Language:
English Edit question
Status:
Solved
For:
Graphite Edit question
Assignee:
No assignee Edit question
Solved by:
Jeff Escamilla
Solved:
Last query:
Last reply:
Revision history for this message
Jeff Escamilla (jeff-escamilla) said :
#1

Okay, looks like we managed to fix it with the help of another co-worker. I was summarizing about 20-30 different data streams, and one (1) of them happened to have a different retention interval (1 minute as opposed to 1 hour) and a different overall retention (on the order of a month, not years).

We managed to find this by changing around the *.*.* in the middle to each of its groups and we kept finding one that would trigger it. Went in, did a whispher-resize to match all of the rest, and all is well.