Tech
Feeding the OLAP beast: ClickHouse massive bulk ingestion steps.
Feeding the OLAP beast: ClickHouse massive bulk ingestion steps.
ClickHouse is a columnar beast, but treating it like MySQL by inserting row-by-row will bring your cluster to its knees. ClickHouseBulkStep packages optimal bulk buffering into a reusable step.
Here is how you use ClickHouseBulkStep & OLAP Pipelines in a production pipeline with wpipe-steps :
from wpipe import Pipeline
from wpipe_steps.database import ClickHouseBulkStep
pipeline = Pipelin...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to