Is there a powerful database system for time series data? [closed]

Solution 1:

Most other answers seem to mention SQL based databases. NoSQL based databases are far superior at this kind of thing.

Some Open source time-series databases:

  • https://prometheus.io - Monitoring system and time series database
  • http://influxdb.com/ - time series database with no external dependencies (only basic server is open-source)
  • http://square.github.io/cube/ - Written ontop of MongoDB
  • http://opentsdb.net/ - Written on top of Apache HBase
  • https://github.com/kairosdb/kairosdb - A rewrite of OpenTSDB that also enables using Cassandra instead of Hadoop
  • http://www.gocircuit.org/vena.html - A tutorial on writing a substitute of OpenTSDB using Go-circuits
  • https://github.com/rackerlabs/blueflood - Based on Cassandra
  • https://github.com/druid-io/druid - Column oriented & hadoop based distributed data store

Cloud-based:

  • https://www.tempoiq.com

Solution 2:

influxdb :: An open-source distributed time series database with no external dependencies.

  • http://influxdb.org/

Solution 3:

Consider IBM Informix Dynamic Server with the TimeSeries DataBlade.

That is, however, an extreme data rate that you are working with. (Not quite up to sub-atomic physics at CERN, but headed in that general direction.)


Fair disclosure: I work for IBM on the Informix DBMS, though not on the TimeSeries DataBlade per se.

Solution 4:

SQL Server StreamInsight

Microsoft StreamInsight BOL

Solution 5:

You can try HDF5 for time series data. It is extremely fast for such applications.