0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-25 11:17:50 +01:00
Commit Graph

6 Commits

Author SHA1 Message Date
Xavier Vello
3414f8ebbc
chore(ingestion): re-introduce rdkafka consumer alongside kafkajs (#16048) 2023-06-20 14:29:26 +02:00
Xavier Vello
bece269c32
perf(ingestion): revert rdkafka consumer for both ingestion queues (#15711)
* Revert "perf(ingestion): use rdkafka consumer for both ingestion queues (#15695)"

This reverts commit fea9e4d77c.

* format

* fix split test

* no really, fix the test

---------

Co-authored-by: Harry Waye <harry@posthog.com>
2023-05-30 17:02:11 +01:00
Xavier Vello
fea9e4d77c
perf(ingestion): use rdkafka consumer for both ingestion queues (#15695) 2023-05-25 10:42:55 +02:00
Harry Waye
616389713b
revert: use rdkafka consumer for analytics ingestion and onEvent (#15469)
Revert "chore: use rdkafka consumer for analytics ingestion and onEvent (#15432)"

This reverts commit 85bb582cee.
2023-05-10 12:22:38 +00:00
Harry Waye
85bb582cee
chore: use rdkafka consumer for analytics ingestion and onEvent (#15432)
This _should_ give us better performance and reliability, but it's
hard to tell without a lot of testing. Will monitor closely on rollout.

Note that this will require a delete on the old consumer members as they
are using round eager robin partition strategy, whereas this is using
the cooperative sticky partition strategy. librdkafka doesn't support
mixing the two, unlike the Java Kafka Client.

---------

Co-authored-by: Tiina Turban <tiina303@gmail.com>
2023-05-10 11:15:02 +00:00
Harry Waye
cff0dab1ee
fix(plugin-server): send headers as well with KafkaProducerWrapper (#15382)
I forgot to pass this through. I think we nuked the buffer tests so was
only apparent in production :grimace:
2023-05-04 15:28:53 +00:00