Hacker Newsnew | past | comments | ask | show | jobs | submit | j1897's commentslogin

Directly related to your question:

Both victoria metrics and questdb are compatible (ingestion-wise) with the InfluxDB Line protocol, so migration would be smoother than with other databases. Just point the old ingestion script to the new server URL, and data will start flowing in.

Taking a broader view, the time series database landscape is split into three categories (sorry for adding complexity!):

1. Observability (metrics from your hardware): Prometheus, and other engines that work well with Prometheus such as Victoria Metrics. I think their language is tightly coupled with PromQL. InfluxDB 1.X and 2.X used to be in this camp and were the market-leading solution for observability before Prometheus came along and got incredible adoption. Chronosphere built with m3db is also a big name in this category.

2. General purpose: TimescaleDB is built on top of Postgres, and is now seen increasingly as a super postgres that can also deal with time series data, amongst other things (now focusing on vectors as well).

3. Specialized: kdb+, QuestDB, some OLAP databases that can also do time series (Clickhouse & Druid), and perhaps InfluxDB 3.0 even though it's not OSS yet. Here the focus is on performance, and the data loads tend to be more significant. Industries and use cases often paired with demanding data loads, such as financial services, often require such specialized databases. Some have their prop language (kdb+ with Q), some are closed source (kdb+), and others are OSS & use SQL (questdb, clickhouse, druid). InfluxDB 3.0 also uses SQL (from DataFusion's query engine) but is not OSS yet.


I would use a slightly different classification:

  - general purpose - OLTP
  - general purpose - OLAP
  - specialized:
    - Internet analytics / clickstream data / adtech
    - financial timeseries
    - monitoring/observability
    - IoT/sensors 
    - IIoT/manufacturing/process


Thanks for your insight, it looks like you've come basically to the same conclusions that I found during my own research as well, which is reassuring

For us it seems VictoriaMetrics is the most logical replacement at the moment, as like you say it supports line protocol as well


Super cool! Visually dazzling.

If you want to build something similar on a raspberry pi, here is a tutorial: https://questdb.io/blog/create-flight-radar-raspberry-pi-que...


Thanks for the kind words and your perspective !


Have you checked questdb [1]? the data structure is arrays with data that lands in order and SQL queries on top. The fallback was that it was difficult to deal with out of order data, but we have just solved this by re-ordering data on the fly in memory before it hits the disk. Performance wise probably not far from kdb itself (will be sharing some bench results soon vs open source tsdbs)

NB: I'm one of the co-founder of questdb [1] https://www.questdb.io


QuestDB (YCS20) | Remote | Full-time| Senior Cloud Engineer

Hi all! At QuestDB, we have built the fastest open source time series database from the ground up to offer breakthrough performance for real-time analytics using SQL. We bring experience and technical approaches from low-latency trading to leverage real-time data processing in various use cases and industries. Our users deploy QuestDB to make time series analysis fast, efficient, and convenient in financial services, IoT, application monitoring, and machine learning.

We are a remote-first company based in London and SF, backed by leading venture capital firms and Y Combinator. We are hiring for the following roles:

Senior cloud engineer: https://questdb.io/careers/senior-cloud-engineer/ Head of Developer Relations: https://questdb.io/careers/head-of-developer-relations/ Front end engineer: https://questdb.io/careers/front-end-engineer/


QuestDB is open source and will remain so forever. You will be able to scale with it. Our commercial product, Pulsar, uses QuestDB as a library and will offer enterprise integration and monitoring features, which are typically required for massive enterprise deployment.

To answer your question, it will depend how big of a scale we are looking into. If you are a large company running questdb throughout the organization and need a specific feature set to do so, you will probably be looking to get our paid offering.


When I read Pulsar I think Apache Pulsar.


Sure could you join our slack ? Top right of our website www.questdb.io


Unable to join your slack here...Slack is stating: "Contact the workspace administrator for an invitation"


Head of DevRel for QuestDB here drop me an email at davidgs(at)questdb(dot)io and I'll make sure you get invited.


Hey, one of the key differences here is that Clickhouse is owned by a large corporation, Yandex (the Google of Russia) and seems to drive its roadmap in function of the needs of the company. We are committed to our community and driving our roadmap based on their needs rather than having to fulfill needs of a parent company.

Ultimately as a result we think that questDB will be a better fit for your community. We acknowledge that Clickhouse has lot more features as of now being a more mature product.


if you click on join slack top right of our website you'll be joining our public channels!


Unable to join your slack here...Slack is stating: "Contact the workspace administrator for an invitation"


Not yet - there is a bench vs clickhouse that has been done by one of their contributor though see below in the comments.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: