Database Families

databasepython

Time Series Oriented Databases (TSDB)

InfluxDB

InfluxDB - Scalable datastore for metrics, events, and real-time analytics

TimescaleDB

TimescaleDB - Time-series database built on PostgreSQL

Timescale DB claims to be a horizontally scalable TSDB bundled as a PostgreSQL extension, allowing to not run another database for timestamped data.

OpenTSDB

OpenTSDB - Distributed, scalable Time Series Database on top of HBase

Graphite

Graphite - Scalable real-time graphing system

  • Whisper - Fixed-size database for storing time-series data
  • Carbon - Backend data caching and persistence daemon

RRDtool

RRDtool - Round Robin Database for time series data

ELK Stack

  • Elasticsearch - Distributed, RESTful search and analytics engine
  • Logstash - Server-side data processing pipeline
  • Kibana - Analytics and visualization platform

Alternatives:

  • Solr - Enterprise search platform
  • SILK - SOLR + Logstash + Banana (Kibana fork)

Other Time Series Databases

  • Prometheus - Monitoring system and time series database
  • KairosDB - Time series database on top of Cassandra
  • Druid - Real-time analytics database
  • VictoriaMetrics - Fast, cost-effective time series database
  • QuestDB - High-performance time series database

Geographic Information Systems

  • PostGIS - Spatial database extender for PostgreSQL
  • MongoDB - Document database with geospatial queries support

Tiles & Web

  • Awesome Vector Tiles - Curated list of vector tiles resources
  • GeoDjango - Django’s geographic web framework
  • TileLive - Map tile server and utilities
  • Tessela - Lightweight Node.js Mapbox Vector Tiles server
  • Tippecanoe - Build vector tilesets from large GeoJSON features

Coordinates

  • EPSG.io - Coordinate systems worldwide
  • PyProj - Python interface to PROJ (cartographic projections library)

Maps

  • Folium - Python data to Leaflet.js maps (works in Jupyter)

Miscellaneous

  • WGS 84 (World Geodetic System 1984): the standard default (EPSG:4326).
  • Lambert II: a French coordinate system (EPSG:27572).

Lots of resources: GovHack Toolkit - Geographic Data

GeoFree - Coordinate Converter

Key-Value Stores

  • LevelDB - Fast key-value storage library by Google
  • Redis - In-memory data structure store, used as database, cache, and message broker
  • MemcacheDB - Distributed key-value storage system designed for persistence
  • Couchbase - Distributed NoSQL cloud database

Document-Oriented Databases

  • Couchbase - Distributed NoSQL cloud database
  • CouchDB - Seamless multi-master sync, scales from mobile to global clusters
  • Elasticsearch - Distributed, RESTful search and analytics engine
  • MongoDB - The most popular NoSQL database
  • RethinkDB - The open-source database for the realtime web
  • Solr - Blazing-fast, open source enterprise search platform

Semantic Web

Not a database family for real, but did not find a good place for it (yet). See also Graph Oriented Databases (should we group both entries at some point?)

Standards

RDF uses subject–predicate–object triples.

Exemple RDF data as JSON, about Wayne Shorter : Wayne Shorter - DBpedia

SPARQL

Python tools & guides

Databases

Scientific papers

Misc

Related