Events (comments) timeline to go with graph

Asked by Carolyn Bray

We are trying to move to Graphite for monitoring our system performance. We'd like to have an event graph where the data points have viewable comments. Circonus offers this sort of thing. They have a timeline that runs separately from the dataline. It allows for entries that have a title section (so you can give a brief description of the event), a category (planned/unplanned/anomoly), a start and stop time and a section for details. You can hover over the datapoint and see what happened.
It makes for a nice way to track network/server/system events to data changes.
Is there a way to do the same in graphite - short of making a graph for every scenario? I saw one answer that suggested it for events like full moons, but I'm talking about unplanned events that impact performance and it would be nice to have them displayed together.
Anyone have a suggestion?

Question information

Language:
English Edit question
Status:
Answered
For:
Graphite Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:

This question was reopened

Revision history for this message
Abe Stanway (abestanway) said :
#1

We (at Etsy) are working on this tool. It is a couple months out. It will allow you the machine monitor your systems for anomalies in real time, and it will group together graphs that are anomalous in similar ways for easy problem diagnoses.

Revision history for this message
Carolyn Bray (cbray) said :
#2

That will be good for troubleshooting, but I'd like a problem log that can be displayed on a timeline that matches the graph. . So, if we have an event (external data source loss) that impacts our performance, I can note that on the timeline, so if the same data change/problem re-occurs, we can use the log as a starting point for troubleshooting.

Revision history for this message
Carolyn Bray (cbray) said :
#3

That will be good for troubleshooting, but I'd like a problem log that can be displayed on a timeline that matches the graph. . So, if we have an event (external data source loss) that impacts our performance, I can note that on the timeline, so if the same data change/problem re-occurs, we can use the log as a starting point for troubleshooting.

Revision history for this message
Dieter P (dieter-plaetinck) said :
#4

graphite is a system for storing time series data, doing math on it, and returning it on request.
an events system with structured text is not in its scope; that's why I wrote a tool with a very similar API and usage as graphite, but specifically for structured text: http://dieter.plaetinck.be/anthracite-event-database-enrich-monitoring-dashboards-visual-numerical-analysis-events-business-impact.html you can query it in various formats (raw,json, html, ...) to integrate with your dashboard.

Abe, do you have a link to your tool? cause that sounds interesting too.

Revision history for this message
Abe Stanway (abestanway) said :
#5

@carolyn, I suppose I left out the part that concerns you - in our comparison tool will be snapshots of anomalies that get indexed, and if a similar anomaly appears, it will alert the engineer with what happened last time and how it was fixed.

@dieter, no links yet, but I will announce to the list when it is ready. Again, we're at least a couple months out before we've got something we're comfortable shipping. Internally, though, it's really shaping up.

Revision history for this message
Daniel Schauenberg (mrtazz) said :
#6

Hey Carolyn,

as far as I know there is no such thing as graph annotations directly in graphite. We use drawasinfinite() a lot to mark events in our infrastructure (see also http://obfuscurity.com/2012/04/Unhelpful-Graphite-Tip-1), it's not as good as a real log but can give some log like insights.

Cheers,
Daniel

On Dec 20, 2012, at 8:21 PM, Carolyn Bray <email address hidden> wrote:

> New question #217295 on Graphite:
> https://answers.launchpad.net/graphite/+question/217295
>
> We are trying to move to Graphite for monitoring our system performance. We'd like to have an event graph where the data points have viewable comments. Circonus offers this sort of thing. They have a timeline that runs separately from the dataline. It allows for entries that have a title section (so you can give a brief description of the event), a category (planned/unplanned/anomoly), a start and stop time and a section for details. You can hover over the datapoint and see what happened.
> It makes for a nice way to track network/server/system events to data changes.
> Is there a way to do the same in graphite - short of making a graph for every scenario? I saw one answer that suggested it for events like full moons, but I'm talking about unplanned events that impact performance and it would be nice to have them displayed together.
> Anyone have a suggestion?
>
> --
> You received this question notification because you are a member of
> graphite-dev, which is an answer contact for Graphite.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~graphite-dev
> Post to : <email address hidden>
> Unsubscribe : https://launchpad.net/~graphite-dev
> More help : https://help.launchpad.net/ListHelp

Can you help with this problem?

Provide an answer of your own, or ask Carolyn Bray for more information if necessary.

To post a message you must log in.