* Swapped to use KAFKA_HOSTS everywhere
* Fixed up type of kafka config options and setup separate kafka hosts for blob consumer
* allow session recordings to have its own kafka security protocol
* remove slash commands from this pr
* syntax must be obeyed
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* fix
* Update query snapshots
* no empty strings in kafka hosts
* fix snapshot
* fix test
---------
Co-authored-by: Paul D'Ambra <paul@posthog.com>
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* ci: fix waiting for temporal to be up in backend tests
I think it got merged before because we weren't running the backend
tests on these script changes so I've also added them to the list of
paths to watch for changes.
* increase timeout to 180 seconds
* Try a different fix
* Test on PR
* Fix commit SHA
* Hard-code commit ref
* Update `EndBug/add-and-commit`
* Don't run on PRs
This was just for testing.
* Use v3 of PostHog/git-sync
* chore: Remove ClickHouse 22.8 and settle on 23.4.2.11
* snuck a ci change in there - removed
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* adjust service version requirements for clickhouse
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* feat(batch_exports): add backend API and S3 temporal workflow
This adds the backend API for batch exports, which will handle reverse
ETL exports to e.g. S3, Snowflake etc.
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
If you only change the plugin server you spend a long time waiting for e2e CI to run.
It doesn't use the plugin server (I don't think)
So, don't run it...
* Show Cohort name instead of id in pie and horizontal bar chart
* Try to use fork's GHCR
* Don't run OptiPNG if not needed
* Fix fork detection
* Revert workflow changes
This didn't really work.
---------
Co-authored-by: Michael Matloka <dev@twixes.com>
* feature: bump clickhouse version to 23.4 for really exciting features
* remove default for kafka table
* Update query snapshots
* don't use defaults on kafka tables
* Update query snapshots
* clickhouse formatDateTime string has changed
* run both 22.8 and 23.4 for now
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* chore: worrying at why the blob ingester gets unhappy
* log when file deletion succeeds
* can you wait for e2e ci step without a specified build name
* wait on build posthog cloud?
* disable the step for now
* rugh
Problem
see #15200 (comment)
When we store session recording events we materialize a lot of information using the snapshot data column.
We'll soon not be storing the snapshot data so won't be able to use that to materialize that information, so we need to capture it earlier in the pipeline. Since this is only used for searching for/summarizing recordings we don't need to store every event.
Changes
We'll push a summary event to a new kafka topic during ingestion. ClickHouse can ingest from that topic into an aggregating merge tree table. So that we store (in theory, although not in practice) only one row per session.
add config to turn this on and off by team in plugin server
add code behind that to write session recording summary events to a new topic in kafka
add ClickHouse tables to ingest and aggregate those summary events
* Use proper beta tag for sampling
* Auto scroll to selected item in menu
* Revamp support modal
* Add file uploads
* Fix modal footer alignment
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update toast message
* Update kea-typegen to fix logic type
* Update frontend/src/lib/components/Support/supportLogic.ts
Co-authored-by: Tiina Turban <tiina303@gmail.com>
* Try to fix pnpm cache in CI
* Fix typing
* Refactor away nonsense selectors in `experimentsLogic`
* Refactor away more selectors with empty deps
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Tiina Turban <tiina303@gmail.com>
