0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-22 08:40:03 +01:00
Commit Graph

741 Commits

Author SHA1 Message Date
ted kaemming
1ed9426eb7
refactor: Remove legacy overrides handling from plugin-server (#23616) 2024-07-11 08:24:54 -07:00
Xavier Vello
14bf5a8d06
chore(CI): add heathcheck to kafka & redis container, wait before tests (#23639) 2024-07-11 15:11:55 +02:00
James Greenhill
c33bdbd259
Set team @PostHog/clickhouse as reviewers for migrations (#23108) 2024-07-08 18:47:32 +00:00
Frank Hamand
5754981a3d
fix: fix bad parsing of pr info for fetching labels (#23509) 2024-07-08 09:40:01 +01:00
Paul D'Ambra
791706ed29
chore: copying strangeness off of the internet (#23468) 2024-07-04 13:34:36 +01:00
Paul D'Ambra
90b59b8437
chore: bring back the migration check (#23475) 2024-07-04 13:26:15 +01:00
danielxnj
a2b85ebf99
chore: convert label to json to handle empties (#23458)
Co-authored-by: xneyder <xneyder@gmail.com>
2024-07-03 15:10:46 -05:00
Tiina Turban
5a4a81006b
chore: Urgent incident follow-ups to sprint planning (#23447) 2024-07-03 17:35:35 +01:00
Edward Hartwell Goose
b51455bb6d
Update bug_report.yml to include link to EU (#22778) 2024-06-28 13:27:51 +00:00
Sandy Spicer
eac199d24a
chore: upgrade python to 3.11 (#23206) 2024-06-27 14:16:27 -07:00
Thomas Obermüller
c0ee9f6af3
chore(deps): upgrade playwright to v1.45.0 (#23280) 2024-06-27 18:08:18 +02:00
Marius Andra
da8565f39c
fix(hog): C++ parser exception (#23232) 2024-06-25 21:52:29 +02:00
Sandy Spicer
6c23c9bd89
revert: "chore: upgrade python to 3.11 🐍" (#23198)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-24 11:50:48 -07:00
Raquel Smith
a21ab359db
fix: handle redirect on org delete properly (#22733)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-24 09:44:15 -07:00
Michael Matloka
077b2759fd
chore(insights): Yeet the unbaked groups-on-events (#22764)
* chore(insights): Yeet the unbaked groups-on-events

* Update TestAutoProjectMiddleware

* Update verifiedDomainsLogic.test.ts.snap

* Update funnel_correlation.py

* Update test_property.py

* Update query snapshots

* Update UI snapshots for `chromium` (2)

* Update query snapshots

* Update UI snapshots for `chromium` (2)

* Update query snapshots

* Update query snapshots

* Update query snapshots

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-24 16:38:42 +02:00
Sandy Spicer
23a789d9fe
chore: upgrade python to 3.11 🐍 (#22932)
🐍
2024-06-21 16:45:42 +00:00
Marius Andra
01a9f360ad
feat(hog): C++ parser (#23100) 2024-06-21 11:22:39 -05:00
Frank Hamand
45d1103564
chore: remove old slack notification (#23090)
remove old slack notification

we now have new and improved ones from posthog/charts
2024-06-19 16:38:07 +02:00
Frank Hamand
be5148915f
feat: add api_token to livestream jwt claims (#23082)
* feat: add api_token to livestream jwt claim

this will allow us to drop the postgres dependency soon

* add continuous deployment for livestream
2024-06-19 14:25:55 +02:00
James Greenhill
59eaa99c14
chore: move livestream to posthog monorepo (#23044)
* 🔥 initial commit

* update readme

* Update README.md

* Update README.md

* deploy scripts

* very basic consumer setup

* add some configs and docker-compose

* formatting for testing

* add tailscale

* flip from dev to prod flag

* set default to be not prod

* default for group_id

* tailscale up

* update gitignore

* basic geolocation

* remove unused localServer

* document mmdb

* just make configs an example

* drop raw print

* add a start script (downloads the mmdb)

* add readme and update configs.example

* ts working

* if in start

* update start script

* fix start

* fix start

* fix more

* add sql endpoints for tokenId and Person lookups

* work towards filter

* sub channel

* fix subChan

* hardcode team2 token

* add cors

* only allow get and head

* add atomicbool

* add channel to kafka

* add logs

* verbose logs

* make array

* drop sub ptrs

* more logs

* helps to loop

* drop some logigng

* move sub branch

* logging

* drop log

* hog

* Deal with numeric distinct ids later

* logs

* api_key

* send 1/1000

* remove log

* remove more logs

* change response payload

* set timestamp if needed

* fill in person_id if team_id is set

* require teamid, convert to token

* clean up subs on disconnect

* log

* check for token in another place

* clean up subs on disconnect

* drop modulo and log

* fix no assign

* don't reuse db conn for now

* drop a log

* add back commented out log

* Don't block on send to client channel

* add geo bool

* only geo events

* use wrapper ip

* don't require team in geo mode

* add an endpoint and stats keeper for teams

* remove stats keeper

* start stats keeper

* wire it up

* change the shape of the response

* omit empty error

* omit empty on the stats as well

* enable logging on back pressure

* add jwt endpoint for testing

* support multiple event types

* Get Auth Setup

* jwt team is float so turn that into int

* logs

* add auth for stats endpoint

* remove tailscale and use autoTLS on public endpoints

* default to :443 for auto tls

* remove un-needed endpoints and handlers

* Use compression because... a lot of data (#9)

* add dockerfile and CI/CD (#10)

* add dockerfile and CI/CD

* Use ubuntu not alpine

couldn't build in alpine :'(

* Add MMDB download to Dockerfile (#11)

* Use clearer name for MMDB

* Don't connect to Kafka over SSL in dev

* Fix JWT token in example config

* Add postgres.url to example config

* Add expected scope

* Fix const syntax

* Put scope validation where claims are known

* Fix audience validation

* moves

* ignore livestream for ci

* main -> master

* move GA to root

* docker lint fix

* fix typo

* fixes for docker builds

* test docker build

* livestream build docker

* dang

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* don't build posthog container when PR is pushed for rust or livestream

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* add a lot of paths-ignore

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* Dorny filters are handling most of what I was trying to do

* remove tailscale to speed up builds

* maybe?

* push container to github.com/posthog/postog

* don't build container on PR

* remove more filters because dorny

---------

Co-authored-by: Brett Hoerner <brett@bretthoerner.com>
Co-authored-by: Zach Waterfield <zlwaterfield@gmail.com>
Co-authored-by: Frank Hamand <frankhamand@gmail.com>
Co-authored-by: Michael Matloka <michal@matloka.com>
Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>
2024-06-18 15:38:53 +00:00
Neil Kakkar
412dc78217
test: Skip docker login for running tests (#23040)
* test: Try no docker login

* Update rust.yml
2024-06-18 12:18:35 +02:00
dependabot[bot]
d645459431
chore(deps): bump docker/metadata-action from 4 to 5 (#23003)
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 4 to 5.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Upgrade guide](https://github.com/docker/metadata-action/blob/master/UPGRADE.md)
- [Commits](https://github.com/docker/metadata-action/compare/v4...v5)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-18 09:21:21 +02:00
dependabot[bot]
b46e97cb70
chore(deps): bump actions/cache from 3 to 4 (#23002)
Bumps [actions/cache](https://github.com/actions/cache) from 3 to 4.
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](https://github.com/actions/cache/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-18 09:21:02 +02:00
dependabot[bot]
f2ff3c58a5
chore(deps): bump docker/setup-qemu-action from 2 to 3 (#23004)
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 2 to 3.
- [Release notes](https://github.com/docker/setup-qemu-action/releases)
- [Commits](https://github.com/docker/setup-qemu-action/compare/v2...v3)

---
updated-dependencies:
- dependency-name: docker/setup-qemu-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-18 09:19:22 +02:00
Frank Hamand
f1be4b2dc7
feat: use new state deployment for posthog cloud (#23014)
use new state deployment for posthog cloud

once https://github.com/PostHog/charts/pull/1343 is merged everything
will be in place to support this (uploading assets)

this should make it significantly easier to do fast rollbacks
2024-06-17 15:46:09 +02:00
Frank Hamand
056ac0be46
chore: use new deploy trigger for ingestion deploys (#23007)
use new deploy trigger for ingestion deploys
2024-06-17 12:38:31 +02:00
Neil Kakkar
3c29351349
chore(ci): Adjust codeQL to only run on appropriate files (#22912) 2024-06-12 15:56:17 +02:00
Neil Kakkar
57647c88e3
chore(ci): Fix hook-migrator CI, better name rust checks (#22905) 2024-06-12 11:57:34 +01:00
Neil Kakkar
ee6cd6d9c2 chore: adjust ci for rust services, merge master 2024-06-11 16:30:21 +01:00
Marius Andra
4d08d7436c
feat(hog): hoge tests, cli and debugger (#22743) 2024-06-07 11:37:53 +02:00
Frank Hamand
653798c7e3
fix: Revert "feat: use new deployment trigger for temporal worker deployments" (#22677)
Revert "feat: use new deployment trigger for temporal worker deployments (#22…"

This reverts commit 0834410018.
2024-06-04 16:52:30 +01:00
Frank Hamand
0834410018
feat: use new deployment trigger for temporal worker deployments (#22668)
use new deployment trigger for temporal worker deployments

these trigger a new workflow in posthog/charts which creates a statefile
commit instead of deploying with manually set values from env vars.

the statefile commit then triggers a deploy - this means 100% of our
deployment state is codified, simplifying rollbacks and deploys
2024-06-04 16:12:54 +01:00
Marius Andra
e6230b4afc
feat(hog): dicts and arrays (#22618) 2024-06-04 12:11:13 +00:00
Eric Duong
75f5c7c4a9
chore(insights): remove flag hogql-insights-preview (#22651)
* remove flag

* cleanup

* killing code

* update image exporter

* mypy baseline

* test_insight_cache

* kill tests that don't work anymore

* remove settings

* test passes

* test pass

* mypy fixes

* remove commented code

* rename and add capture back in

* remove references to feature flag

* remove the falg

* comment out failing test

* Update UI snapshots for `chromium` (1)

* fix jest

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (1)

* Fix storybook test

* Update UI snapshots for `chromium` (2)

---------

Co-authored-by: Alexander Spicer <aspicer@gmail.com>
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Tom Owers <owerstom@gmail.com>
2024-06-04 13:08:32 +01:00
Marius Andra
0198ec7e1d
feat(hog): f-strings (#22577) 2024-05-30 20:32:39 +02:00
Tom Owers
5e00b6b1aa
feat(data-warehouse): Added SSH tunnelling option for postgres syncs (#22511)
* WIP

* SSH tunnel for postgres

* Remove unused class

* Updated mypy

* Tests and security

* Added tests for data import

* Update UI snapshots for `chromium` (2)

* Added upterm to debug CI

* Removed hogvm test

* Update UI snapshots for `chromium` (2)

* Update query snapshots

* Updated requirements

* Update UI snapshots for `chromium` (2)

* Update query snapshots

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (2)

* Use the correct wheel version

* Update query snapshots

* Update query snapshots

* Restore skipped tests in action

* Update query snapshots

* Update UI snapshots for `chromium` (2)

* Skip hogvm tests

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (2)

* Update query snapshots

* Update UI snapshots for `chromium` (2)

* Use ActivityEnvironment for data import tests

* Update query snapshots

* Update UI snapshots for `chromium` (2)

* Move test

* Update query snapshots

* Update UI snapshots for `chromium` (2)

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-29 15:49:53 +01:00
timgl
cd7d9be694
chore: Only fetch master branch in tests (#22524) 2024-05-28 08:48:00 +01:00
Michael Matloka
31f97c118a
chore: Add a few flags to PERSISTED_FEATURE_FLAGS (#22487)
* chore: Add a few flags to `PERSISTED_FEATURE_FLAGS`

* Add `session-table-property-filters`

* Remove `PERSISTED_FEATURE_FLAGS` from PR deploys

* Don't persist `new-experiments-ui`
2024-05-24 18:41:06 +02:00
Michael Matloka
b1cb7458dc
test(insights): Run all tests with filters-based insights using HogQL (#21861)
* ci: Run core backend tests with both HogQL and legacy insights

* Double the number of tests

* Fix env var setting

* Add some HOGQL_INSIGHTS_OVERRIDE overrides in tests

* Mark `Insight.last_refresh` as deprecated

* Fix bad merge

* Update query snapshots

* Update query snapshots

* Update test_team.py

* Actually remove legacy backend from matrix

* Update test_fetch_from_cache.py

* Use `update_cached_state` in `calculate_for_query_based_insight()`

* Clean up CI changes and a comment

* Fix `update_cached_state` typing

* Update test_fetch_from_cache.py

* Update test_insight_cache.py

* Update test_insight_cache.py

* Clarify `generate_insight_cache_key` as legacy function

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-23 21:41:05 +00:00
Thomas Obermüller
6bfbf54b6d
fix(ci): fix storybook deploy (#22451) 2024-05-23 09:43:18 +02:00
Frank Hamand
ef7d9af7dd
chore: Add new deployment for general purpose temporal worker (#22407)
Add new deployment for general purpose temporal worker
2024-05-22 09:24:57 +01:00
dependabot[bot]
18ee601998
chore(deps): bump pnpm/action-setup from 2 to 4 (#22269)
* chore(deps): bump pnpm/action-setup from 2 to 4

Bumps [pnpm/action-setup](https://github.com/pnpm/action-setup) from 2 to 4.
- [Release notes](https://github.com/pnpm/action-setup/releases)
- [Commits](https://github.com/pnpm/action-setup/compare/v2...v4)

---
updated-dependencies:
- dependency-name: pnpm/action-setup
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* Use pnpm version from package.json engines

* Fix a couple of workflows

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Michael Matloka <michal@matloka.com>
2024-05-20 20:03:04 +00:00
Frank Hamand
e48a6de280
Cleanup couple of issues from proxy service PR (#22299)
* fix mypi

* stop saving images on pr builds
2024-05-15 20:18:59 +00:00
David Newell
de69ab884c
feat: Proxy as a Service (#22292)
* frontend form

* list / create records

* move settings

* fix types

* add fields

* new fields & delete

* better states

* Update UI snapshots for `chromium` (1)

* basic task

* background task

* Hide proxy settings behind feature flag

* text color

* Update UI snapshots for `chromium` (1)

* Squash migrations

* Add created_at/update_at/created_by

* form complete state

* move env vars

* cleanup

* Use env var for target cname

* call create in celery task

* fix dns resolver import

* frontend polling

* order queryset

* tweaks

* Only save on change

* Update UI snapshots for `chromium` (1)

* only create proxy task if is_cloud

* hide settings if not cloud

* Update query snapshots

* Update UI snapshots for `chromium` (1)

* cloud or dev

* spacing

* deleting

* save docker images

* add final status

* update manifest

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (2)

* fix celery task

* Fix org_id on proxy record

* isDomain not isUrl

* fix destroy kwargs

* fix help text

* domain check

* frontend form

* list / create records

* move settings

* fix types

* add fields

* new fields & delete

* better states

* Update UI snapshots for `chromium` (1)

* basic task

* background task

* text color

* Hide proxy settings behind feature flag

* form complete state

* Update UI snapshots for `chromium` (1)

* Squash migrations

* Add created_at/update_at/created_by

* move env vars

* cleanup

* frontend polling

* Use env var for target cname

* call create in celery task

* fix dns resolver import

* order queryset

* hide settings if not cloud

* tweaks

* Only save on change

* Update UI snapshots for `chromium` (1)

* only create proxy task if is_cloud

* cloud or dev

* Update query snapshots

* Update UI snapshots for `chromium` (1)

* spacing

* deleting

* add final status

* save docker images

* update manifest

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (2)

* fix celery task

* Fix org_id on proxy record

* isDomain not isUrl

* domain check

* fix destroy kwargs

* fix help text

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (1)

* fix code quality issues

* code quality

* fix merge

* spinner spacing

* remove unused selectors

* Update UI snapshots for `chromium` (1)

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Frank Hamand <frankhamand@gmail.com>
2024-05-15 22:52:58 +03:00
James Greenhill
f1d32e6969
chore: remove 23.11 clickhouse from matrix testing (#22165) 2024-05-07 22:29:03 +00:00
dependabot[bot]
502bbcd582
chore(deps): bump iFaxity/wait-on-action from 1.1.0 to 1.2.1 (#22090)
Bumps [iFaxity/wait-on-action](https://github.com/ifaxity/wait-on-action) from 1.1.0 to 1.2.1.
- [Release notes](https://github.com/ifaxity/wait-on-action/releases)
- [Changelog](https://github.com/iFaxity/wait-on-action/blob/next/release.config.js)
- [Commits](https://github.com/ifaxity/wait-on-action/compare/v1.1.0...v1.2.1)

---
updated-dependencies:
- dependency-name: iFaxity/wait-on-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 09:37:51 +00:00
Nikita Vorobev
0955a0bc52
fix: allow choose another dashboard template after pressing back (#21248) 2024-04-24 14:07:22 +02:00
Ben White
5c273be25e
fix: Remove old cdp files (#21712) 2024-04-23 09:10:42 +02:00
Michael Matloka
233d3a9098
chore(deps): Remove unused Python requirements (#21580)
* chore(deps): Remove unused Python requirements

* Also remove `dnspython`

* Recompile txts

* Revert "Also remove `dnspython`"

This reverts commit 7eaf89979b774808cc0920c34a3a1cf1d75d2f14.

* Re-recompile txts

* Remove more deps based on `deptry`

* Restore `phonenumberslite`

* Restore `geoip2`

* Restore `python3-saml`

* Move `prance` and `openapi-spec-validator` to dev reqs

* Reorder `geoip2`

* Force HTTP 1.1 in downloading MMDB

Should fix CI failures caused by `curl: (92) HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2)` (e.g. https://github.com/PostHog/posthog/actions/runs/8741861825/job/23988870688?pr=21580).
2024-04-22 22:52:47 +02:00
Michael Matloka
0cf2955159
chore(clickhouse): Capture final SQL in Sentry errors, again (#21688)
* Revert "revert: "chore(clickhouse): Capture final SQL in Sentry errors" (#21479)"

This reverts commit 15627818f6.

* Only upgrade `clickhouse-driver` to 0.2.6

* Add "Run migrations for this PR"
2024-04-22 13:56:32 +02:00