Tech
PDF, ZIP and binary files streaming over Kafka with names intact.
PDF, ZIP and binary files streaming over Kafka with names intact.
Day 07 of the WKafka Open-Source Engineering Series.
Don't provision a cloud bucket when all you need is sending small PDFs and ZIPs down your pipeline. WKafka supports format='file' out of the box.
The Pain Points We Faced
Building S3/MinIO upload/download pipelines just to move 500KB report files
Lost original filenames and mime-types when converting files to raw bytes
High latency polling for cl...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to