0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-29 03:04:16 +01:00
Commit Graph

228 Commits

Author SHA1 Message Date
Ben White
16870d63fc
feat: Plugin server services refactor - take 2 (#24737) 2024-09-03 11:00:50 +02:00
Ben White
3f56346512
chore: Reverts "Plugin server services refactor (#24638)" (#24733) 2024-09-02 08:43:52 +00:00
Ben White
4684a2bc0d
chore: Plugin server services refactor (#24638) 2024-09-02 09:56:13 +02:00
Ben White
fdccd710bc
feat: Blobby always use offset store (#23881) 2024-07-23 10:06:59 +02:00
Tiina Turban
54875e188a
fix: Webhooks groups properties (#23822) 2024-07-22 14:21:46 -06:00
Paul D'Ambra
02b97d953a
fix: remove logging changes (#23637) 2024-07-11 17:36:59 +01:00
Paul D'Ambra
85a2b944ab
fix: heartbeat less (#23546) 2024-07-09 06:45:41 +01:00
Paul D'Ambra
6f72d696d8
fix: blobby internal kafka queueing (#23539) 2024-07-09 01:26:24 +01:00
Robbie
01dabd04d8
fix: Fix bug that assumes that 2 months are 61 days apart (#23368)
Fix bug that assumes that 2 months are 61 days apart
2024-07-01 15:51:39 +00:00
Paul D'Ambra
0a52d303a6
feat: message too large ingestion warning (#23315)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-28 12:13:11 +01:00
Ben White
595bae0081
feat(cdp): HogWatcher (#23286) 2024-06-27 17:25:26 +02:00
Tiina Turban
23acd142d6
fix: plugin-server normalizeEvent types (#22892) 2024-06-12 12:13:51 +00:00
Brett Hoerner
2e0406a551
chore(plugin-server): change captureIngestionWarning to not await acks (#22850)
* chore(plugin-server): change captureIngestionWarning to not await acks

* chore(plugin-server): move person kafka ack awaits to the batch-level… (#22772)

chore(plugin-server): move person kafka ack awaits to the batch-level await
2024-06-10 09:39:51 -06:00
Ben White
76ddfec198
feat: Add plugin config filtering (#22469) 2024-05-30 10:23:03 +01:00
Bianca Yang
9dd22a3757
feat: Deprecate available_features pt 2 (#22373)
* everything except plugin server and sync_available_features

* sync_available_features_done, some plugin_server done?

* and a tiny bit more

* linting

* try to fix some tests

* more test fixes/

* clean up typos

* weed wacking bugs

* more test shenanigans

* fix plugin server

* actually fix plugin server test?

* still fixing tests

* another attempt

* some pr feedback

* small fix

* fix database query accessor

* fix functional tests

* fix tests

* Update query snapshots

* Update query snapshots

* Update query snapshots

* update some comments and fxn names

* fix plugin server test

* Update query snapshots

* Update query snapshots

* Update query snapshots

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-28 17:29:24 -07:00
Ben White
2fcf68be8f
feat: Support groups in webhook formatting (#22065) 2024-05-28 12:19:22 +01:00
Ben White
c4fee6fc83
feat: Action filtering for webhook apps (#22056) 2024-05-28 10:21:38 +01:00
Xavier Vello
c2a5d6162a
chore(blobby): penalize non-batched traffic for overflow detection (#21607) 2024-05-06 14:54:24 +02:00
Ben White
ee7ac6489f
feat: Refactor processing to allow lazy loading of elementsList (#21983) 2024-05-06 10:47:24 +02:00
Ben White
1323449293
chore: Remove experimental replay ingester (#21969) 2024-05-06 09:15:25 +02:00
Xavier Vello
e7d3a8d0a7
perf(blobby): improve message parsing performance (#21445) 2024-04-15 13:34:07 +02:00
timgl
9f68d554c0
fix: Add where predicate to alter table query (#21382)
* fix: Fix deletion job by using join tables

* fix tests

* Update query snapshots

* drop table

* fix

* Update query snapshots

* remove te4st files

* fix

* Update query snapshots

* Update posthog/models/async_deletion/delete_events.py

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: James Greenhill <fuziontech@gmail.com>
2024-04-09 01:31:36 +00:00
ted kaemming
091e7251ea
feat(plugin-server): Preserve distinct ID locality on overflow rerouting (#21358) 2024-04-08 09:49:44 -07:00
ted kaemming
7e9d67130d
test(plugin-server): Improve the robustness of overflow handling tests (#21315) 2024-04-04 07:58:36 -07:00
ted kaemming
4457dd5396
revert: "feat(plugin-server): Support preserving distinct ID locality on overflow rerouting (#20945)" (#21279)
This reverts commit 85ef237459.
2024-04-02 16:39:45 +00:00
ted kaemming
85ef237459
feat(plugin-server): Support preserving distinct ID locality on overflow rerouting (#20945)
Turned off by default for backwards compatibility for now.
2024-04-02 10:56:29 -05:00
Xavier Vello
db30cd2e33
feat(blobby): add new recordings-blob-ingestion-overflow role (#21161) 2024-04-02 13:20:35 +02:00
Paul D'Ambra
3b6798963e
fix: versions are not numbers, when will I ever learn (#21228)
* fix: parsing versions but not stupid

* update tests

* unknown for safety
2024-03-28 20:18:39 +00:00
Paul D'Ambra
02c596c569
feat: ingestion warning on old version (#21025)
* feat: ingestion warning on old version

* and some tests

* deprecate old body parsing method for reading the token

* add a counter too so we can see this in grafana dashboard

* typo

* fix v3 consumer to ignore ingestion warning

* fix

* fix

* fix

* add comment

* disconnect producer

* inject main cluster produer as a dependency from the recording consumer into its children

* inject main cluster produer as a dependency from the recording consumer into its children

* void the promises that eslint or prettier keeps clearing the comment from

* does that fix the test

* not safe to call stop twice

* not safe to call stop twice

* remove start and stop

* fix

* the shortest route from a to b

* fix
2024-03-28 18:24:19 +00:00
Paul D'Ambra
ead1438f7b
feat: pass producer into blob ingestion services (#21205) 2024-03-28 13:05:53 +00:00
Paul D'Ambra
ddeedc7d60
feat: remove unused code path (#21200)
* feat: remove unused code path

* fix
2024-03-28 11:44:59 +00:00
Xavier Vello
4edcf1bff8
feat(blobby): overflow detection updates the redis set with keys that trigger (#21154) 2024-03-27 14:47:06 +01:00
Brett Hoerner
30bafdd382
chore(plugin-server): kafka ack cleanup and metric (#21111)
* cleanup: remove unused team arg from registerLastStep

* cleanup: rename promises to ackPromises to make it more clear thats what they are

* cleanup(plugin-server): make waitForAck explicit/required

* add Kafka produce/ack metrics

* Clarify Kafka produce metric/labels
2024-03-25 13:01:15 +00:00
Xavier Vello
6741039ec1
feat(blobby): run overflow detection and report result as a gauge (#21046) 2024-03-21 11:12:29 +01:00
Paul D'Ambra
906737b4ee
feat: blobby ingestion warnings (#20963)
* don't hand your trousers to the shop assistant

* write ingestion warning when timestamp is very invalidd

* reduce amount of skew before we warn and add display code for ingestion warnings

* one week of skew

* is it this triggering linter

* Update UI snapshots for `chromium` (1)

* this is fine

* this is fine

* typo

* fix typo

Co-authored-by: Manoel Aranda Neto <5731772+marandaneto@users.noreply.github.com>

* move limiting into capture ingestion warning

* fix tests

* shared debounce key for person state

* Revert "shared debounce key for person state"

This reverts commit c0d30028ed.

* allow overriding debouncing of capture ingestion warning

* positive not negative

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (2)

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Manoel Aranda Neto <5731772+marandaneto@users.noreply.github.com>
2024-03-19 16:27:33 +00:00
Paul D'Ambra
3b7288f7c7
fix: replay ingestion was ignoring pageview urls (#20883) 2024-03-13 11:42:57 +00:00
David Newell
6d0c0e6026
fix: log level (#20739) 2024-03-07 09:19:52 +00:00
Ben White
57edf362c8
feat: Mr Blobby backported improvements from v3 (#20653) 2024-03-01 13:40:25 +01:00
Ben White
47cf62b7a3
feat: Conditional enabling of replay ingestion (#20614) 2024-02-29 17:05:04 +01:00
Ben White
7cc9076cc1
feat: Batch parallelise flushes with concurrency limit (#20599) 2024-02-28 10:57:56 +01:00
Ben White
ebd92f0913
feat: Added heartbeat check for processing (#20596) 2024-02-28 10:00:24 +01:00
Ben White
12e01a0ede
feat: V3 ingester - perf improvements (#20587) 2024-02-27 21:10:39 +01:00
Ben White
fbe120f87f
fix: Added handling for v3 ingester metadata.json file being corrupted (#20583) 2024-02-27 18:45:19 +01:00
Ben White
f73743091d
feat: Batch replay ingestion writes by session id (#20577) 2024-02-27 16:18:44 +00:00
Ben White
f276ca3547
feat: Enable parallel batch processing for v3 ingester (#20573) 2024-02-27 14:29:27 +01:00
Ben White
ff22a7e680
fix: Loading from new s3 ingestion buckets (#20550) 2024-02-26 16:20:57 +01:00
Ben White
bcbe300c22
feat: Replay ingestion with EFS (#20487) 2024-02-26 09:43:27 +01:00
ted kaemming
66933ca632
refactor(plugin-server): Remove a few layers of passthrough functions in event ingestion (#20540) 2024-02-23 16:19:10 -08:00
Ben White
9d7d0938d8
feat: Added kafka hash to redis watermarks (#20201) 2024-02-12 08:50:57 +00:00
Paul D'Ambra
e049e2c4b6
fix: revert "feat: faster json parsing" (#19838)
Revert "feat: faster json parsing"
2024-01-18 14:25:20 +00:00