0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-29 03:04:16 +01:00
Commit Graph

300 Commits

Author SHA1 Message Date
Ben White
2fcf68be8f
feat: Support groups in webhook formatting (#22065) 2024-05-28 12:19:22 +01:00
Ben White
c4fee6fc83
feat: Action filtering for webhook apps (#22056) 2024-05-28 10:21:38 +01:00
Ben White
224a5d5d0c
feat: Action steps refactor (part 2) (#22092) 2024-05-08 09:46:52 +02:00
Ben White
cc9cb45d58
feat: Action steps refactor (attempt 2) (#22137) 2024-05-07 15:25:19 +02:00
Ben White
0fc2c9eccd
revert: "feat: Action steps refactor (part1) (#22091)" (#22136) 2024-05-07 12:32:41 +02:00
Ben White
776298d2a8
feat: Action steps refactor (part1) (#22091) 2024-05-07 12:08:13 +02:00
Xavier Vello
c2a5d6162a
chore(blobby): penalize non-batched traffic for overflow detection (#21607) 2024-05-06 14:54:24 +02:00
Ben White
ee7ac6489f
feat: Refactor processing to allow lazy loading of elementsList (#21983) 2024-05-06 10:47:24 +02:00
Ben White
1323449293
chore: Remove experimental replay ingester (#21969) 2024-05-06 09:15:25 +02:00
Xavier Vello
e7d3a8d0a7
perf(blobby): improve message parsing performance (#21445) 2024-04-15 13:34:07 +02:00
timgl
9f68d554c0
fix: Add where predicate to alter table query (#21382)
* fix: Fix deletion job by using join tables

* fix tests

* Update query snapshots

* drop table

* fix

* Update query snapshots

* remove te4st files

* fix

* Update query snapshots

* Update posthog/models/async_deletion/delete_events.py

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: James Greenhill <fuziontech@gmail.com>
2024-04-09 01:31:36 +00:00
ted kaemming
091e7251ea
feat(plugin-server): Preserve distinct ID locality on overflow rerouting (#21358) 2024-04-08 09:49:44 -07:00
ted kaemming
7e9d67130d
test(plugin-server): Improve the robustness of overflow handling tests (#21315) 2024-04-04 07:58:36 -07:00
ted kaemming
4457dd5396
revert: "feat(plugin-server): Support preserving distinct ID locality on overflow rerouting (#20945)" (#21279)
This reverts commit 85ef237459.
2024-04-02 16:39:45 +00:00
ted kaemming
85ef237459
feat(plugin-server): Support preserving distinct ID locality on overflow rerouting (#20945)
Turned off by default for backwards compatibility for now.
2024-04-02 10:56:29 -05:00
Xavier Vello
db30cd2e33
feat(blobby): add new recordings-blob-ingestion-overflow role (#21161) 2024-04-02 13:20:35 +02:00
Paul D'Ambra
3b6798963e
fix: versions are not numbers, when will I ever learn (#21228)
* fix: parsing versions but not stupid

* update tests

* unknown for safety
2024-03-28 20:18:39 +00:00
Paul D'Ambra
02c596c569
feat: ingestion warning on old version (#21025)
* feat: ingestion warning on old version

* and some tests

* deprecate old body parsing method for reading the token

* add a counter too so we can see this in grafana dashboard

* typo

* fix v3 consumer to ignore ingestion warning

* fix

* fix

* fix

* add comment

* disconnect producer

* inject main cluster produer as a dependency from the recording consumer into its children

* inject main cluster produer as a dependency from the recording consumer into its children

* void the promises that eslint or prettier keeps clearing the comment from

* does that fix the test

* not safe to call stop twice

* not safe to call stop twice

* remove start and stop

* fix

* the shortest route from a to b

* fix
2024-03-28 18:24:19 +00:00
Paul D'Ambra
ead1438f7b
feat: pass producer into blob ingestion services (#21205) 2024-03-28 13:05:53 +00:00
Paul D'Ambra
ddeedc7d60
feat: remove unused code path (#21200)
* feat: remove unused code path

* fix
2024-03-28 11:44:59 +00:00
Xavier Vello
4edcf1bff8
feat(blobby): overflow detection updates the redis set with keys that trigger (#21154) 2024-03-27 14:47:06 +01:00
Brett Hoerner
30bafdd382
chore(plugin-server): kafka ack cleanup and metric (#21111)
* cleanup: remove unused team arg from registerLastStep

* cleanup: rename promises to ackPromises to make it more clear thats what they are

* cleanup(plugin-server): make waitForAck explicit/required

* add Kafka produce/ack metrics

* Clarify Kafka produce metric/labels
2024-03-25 13:01:15 +00:00
Xavier Vello
6741039ec1
feat(blobby): run overflow detection and report result as a gauge (#21046) 2024-03-21 11:12:29 +01:00
Paul D'Ambra
906737b4ee
feat: blobby ingestion warnings (#20963)
* don't hand your trousers to the shop assistant

* write ingestion warning when timestamp is very invalidd

* reduce amount of skew before we warn and add display code for ingestion warnings

* one week of skew

* is it this triggering linter

* Update UI snapshots for `chromium` (1)

* this is fine

* this is fine

* typo

* fix typo

Co-authored-by: Manoel Aranda Neto <5731772+marandaneto@users.noreply.github.com>

* move limiting into capture ingestion warning

* fix tests

* shared debounce key for person state

* Revert "shared debounce key for person state"

This reverts commit c0d30028ed.

* allow overriding debouncing of capture ingestion warning

* positive not negative

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (2)

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Manoel Aranda Neto <5731772+marandaneto@users.noreply.github.com>
2024-03-19 16:27:33 +00:00
Paul D'Ambra
3b7288f7c7
fix: replay ingestion was ignoring pageview urls (#20883) 2024-03-13 11:42:57 +00:00
David Newell
6d0c0e6026
fix: log level (#20739) 2024-03-07 09:19:52 +00:00
Ben White
57edf362c8
feat: Mr Blobby backported improvements from v3 (#20653) 2024-03-01 13:40:25 +01:00
Ben White
47cf62b7a3
feat: Conditional enabling of replay ingestion (#20614) 2024-02-29 17:05:04 +01:00
Ben White
7cc9076cc1
feat: Batch parallelise flushes with concurrency limit (#20599) 2024-02-28 10:57:56 +01:00
Ben White
ebd92f0913
feat: Added heartbeat check for processing (#20596) 2024-02-28 10:00:24 +01:00
Ben White
12e01a0ede
feat: V3 ingester - perf improvements (#20587) 2024-02-27 21:10:39 +01:00
Ben White
fbe120f87f
fix: Added handling for v3 ingester metadata.json file being corrupted (#20583) 2024-02-27 18:45:19 +01:00
Ben White
f73743091d
feat: Batch replay ingestion writes by session id (#20577) 2024-02-27 16:18:44 +00:00
Ben White
f276ca3547
feat: Enable parallel batch processing for v3 ingester (#20573) 2024-02-27 14:29:27 +01:00
Ben White
ff22a7e680
fix: Loading from new s3 ingestion buckets (#20550) 2024-02-26 16:20:57 +01:00
Ben White
bcbe300c22
feat: Replay ingestion with EFS (#20487) 2024-02-26 09:43:27 +01:00
ted kaemming
66933ca632
refactor(plugin-server): Remove a few layers of passthrough functions in event ingestion (#20540) 2024-02-23 16:19:10 -08:00
ted kaemming
05a06d27e4
refactor(plugin-server): Clean up Person Postgres & Kafka code a little bit (#20479) 2024-02-21 11:25:35 -08:00
Ben White
9d7d0938d8
feat: Added kafka hash to redis watermarks (#20201) 2024-02-12 08:50:57 +00:00
Marius Andra
4f50326aec
fix(taxonomy): don't convert numeric strings to numbers (#19774) 2024-01-22 17:58:43 +01:00
Paul D'Ambra
e049e2c4b6
fix: revert "feat: faster json parsing" (#19838)
Revert "feat: faster json parsing"
2024-01-18 14:25:20 +00:00
Paul D'Ambra
972c054274
feat: faster json parsing (#19830)
* feat: faster json parsing

* make a test assertion concrete
2024-01-18 12:38:47 +00:00
Brett Hoerner
49d6ebebcc
feat(plugin-server): Use rusty-hook for non-plugin webhooks/resthooks (#19749)
* Extract enqueueInRustyHook and metric to their own files

* Use raiseIfUserProvidedUrlUnsafe in enqueueInRustyHook, like trackedFetch does

* Extract rusty-hook bits to a single object, so its easier to pass around

* Weave RustyHook object into HookCommander

* Use rusty-hook for non-plugin webhooks/resthooks

* Fix imports and tests
2024-01-16 05:26:06 -07:00
Paul D'Ambra
d39e2c5c5e
fix: activity detection for rrweb data (#19621)
* fix: activity detection for rrweb data

* move tests out of process event - they don't need any of the setup there

* Add tests

* fix test name

* fix test name

* fix
2024-01-08 09:01:40 +00:00
Paul D'Ambra
fbb93232c4
feat: ingest with snapshot source (#19260)
* feat: ingest with snapshot source

* add replay events ingester tests

* fix test data insertion

* add test

* Update query snapshots

* fix test

* fix test

* fix test

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-12-15 12:21:23 +00:00
Paul D'Ambra
6cf979ecb2
fix: debug partition parsing for recordings consumer (#19254)
* fix: debug partition parsing for recordings consumer

* better typing for test setup

* fix copy pasta
2023-12-12 10:54:38 +00:00
Paul D'Ambra
061bfa249b
feat: debug logging for lagging partitions (#19195)
* feat: debug logging for lagging partitions

* a little more

* add more

* remove some debug logs that we have no way of showing

* remove mock assertion
2023-12-08 09:54:39 +00:00
Brett Hoerner
1f6ce77e66
chore(plugin-server): remove statsd (#19027) 2023-12-05 11:47:12 -07:00
Tiina Turban
8f81c31d21
chore: Nuke promiseManager (#19094) 2023-12-05 16:47:41 +01:00
Brett Hoerner
f470984976
chore(plugin-server): add prometheus metrics to match statsd ones, remove unused metrics (#19000) 2023-12-01 08:01:45 -07:00