Can Salt (Saltstack) gather and relay data for Graphite, Ganglia, or Zenoss?
Solution 1:
i used salt-stack for over 6 Month now to manage 40+ nodes.
in My current setup i use:
- Icinga as Monitoring Server
- NRPE for executing the checks on the Nodes
- graphite collects the data from the collectd nodes
- collectd for collecting and pushing metrics to graphite
- gdash for a nice Dashboard to visualize the grahite metrics
- salt-stack and finally salt-stack to roll out the configs for NRPE / Collectd on each node
als this runs under CentOS 6.x
my expierience so far is that salt-stack is good to enroll everything. But as long term runing Daemon on the nodes, its not stable.
i have often problems with not reaching the master or memory bloating of on the salt-minions. This can be fixed with and easy workaround that you restart every 24hours/onceaweek the salt-minions.
but this problem in salt-minion makes it not usable to collect data over the 0mq Framework.
my current setup runs safe. I can enroll changes pretty quick with salt-stack and collectd on the nodes does the trick.
Solution 2:
I think Salt or Ansible are not created for that task and I think they cannot be used to that purpose.
I am using Salt for several months and I didn't noticed of options of functions you want (in configs nor documentation). But I think you can "add" your requirements as Salt is written in python - if it is an option.
The easiest way is to order salt to install collectd which can collect data about the system (and has connectors to graphite)
EDIT: I found a project which implements monitoring using salt - salmon - take a look.
Solution 3:
You may want to take a look at Sensu, it's a monitoring solution pluggable with a lots of community plugins, including graphite among others.
However Sensu uses another messaging queue to deliver messages, RabbitMQ. Maybe some coding work is needed, but you can try to replace one of the two messaging queue, since both of them should be using the AMQ protocol to exchange messages.
Solution 4:
I recommend you look into two things: Salt Mine - http://docs.saltstack.com/topics/mine/ Salt Events - http://docs.saltstack.com/topics/event/index.html
If you combine these with your own returner configuration setup to store results in graphite, or any of the others you listed. You could conceivably use Salt to handle top down 'probing' and bottom up 'eventing'. I wouldn't be able to comment on the effectiveness of such a system, but in principle there appears to be the possibility.