0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-25 11:17:50 +01:00
Commit Graph

61 Commits

Author SHA1 Message Date
danielxnj
e4f40cf1ab
chore: update dockerhub token (#25582)
Co-authored-by: xneyder <xneyder@gmail.com>
2024-10-14 22:49:56 -04:00
Eric Duong
e3a5056c00
chore(data-warehouse): update deploy conditions for temporal workers (#24876) 2024-09-10 10:29:20 +02:00
danielxnj
14f44528f8
chore: Add workflow run timestamp (#24618)
Co-authored-by: xneyder <xneyder@gmail.com>
2024-08-27 17:03:01 -04:00
Frank Hamand
7ce9ca4806
fix: re-add logging into docker hub for container-images-cd (#24314) 2024-08-12 16:23:49 +01:00
Frank Hamand
ce575be654
chore: Build images for rust capture and vector capture for multi-arch (#24309) 2024-08-12 14:36:12 +01:00
danielxnj
a2b85ebf99
chore: convert label to json to handle empties (#23458)
Co-authored-by: xneyder <xneyder@gmail.com>
2024-07-03 15:10:46 -05:00
James Greenhill
59eaa99c14
chore: move livestream to posthog monorepo (#23044)
* 🔥 initial commit

* update readme

* Update README.md

* Update README.md

* deploy scripts

* very basic consumer setup

* add some configs and docker-compose

* formatting for testing

* add tailscale

* flip from dev to prod flag

* set default to be not prod

* default for group_id

* tailscale up

* update gitignore

* basic geolocation

* remove unused localServer

* document mmdb

* just make configs an example

* drop raw print

* add a start script (downloads the mmdb)

* add readme and update configs.example

* ts working

* if in start

* update start script

* fix start

* fix start

* fix more

* add sql endpoints for tokenId and Person lookups

* work towards filter

* sub channel

* fix subChan

* hardcode team2 token

* add cors

* only allow get and head

* add atomicbool

* add channel to kafka

* add logs

* verbose logs

* make array

* drop sub ptrs

* more logs

* helps to loop

* drop some logigng

* move sub branch

* logging

* drop log

* hog

* Deal with numeric distinct ids later

* logs

* api_key

* send 1/1000

* remove log

* remove more logs

* change response payload

* set timestamp if needed

* fill in person_id if team_id is set

* require teamid, convert to token

* clean up subs on disconnect

* log

* check for token in another place

* clean up subs on disconnect

* drop modulo and log

* fix no assign

* don't reuse db conn for now

* drop a log

* add back commented out log

* Don't block on send to client channel

* add geo bool

* only geo events

* use wrapper ip

* don't require team in geo mode

* add an endpoint and stats keeper for teams

* remove stats keeper

* start stats keeper

* wire it up

* change the shape of the response

* omit empty error

* omit empty on the stats as well

* enable logging on back pressure

* add jwt endpoint for testing

* support multiple event types

* Get Auth Setup

* jwt team is float so turn that into int

* logs

* add auth for stats endpoint

* remove tailscale and use autoTLS on public endpoints

* default to :443 for auto tls

* remove un-needed endpoints and handlers

* Use compression because... a lot of data (#9)

* add dockerfile and CI/CD (#10)

* add dockerfile and CI/CD

* Use ubuntu not alpine

couldn't build in alpine :'(

* Add MMDB download to Dockerfile (#11)

* Use clearer name for MMDB

* Don't connect to Kafka over SSL in dev

* Fix JWT token in example config

* Add postgres.url to example config

* Add expected scope

* Fix const syntax

* Put scope validation where claims are known

* Fix audience validation

* moves

* ignore livestream for ci

* main -> master

* move GA to root

* docker lint fix

* fix typo

* fixes for docker builds

* test docker build

* livestream build docker

* dang

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* don't build posthog container when PR is pushed for rust or livestream

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* add a lot of paths-ignore

* Update .github/workflows/livestream-docker-image.yml

Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>

* Dorny filters are handling most of what I was trying to do

* remove tailscale to speed up builds

* maybe?

* push container to github.com/posthog/postog

* don't build container on PR

* remove more filters because dorny

---------

Co-authored-by: Brett Hoerner <brett@bretthoerner.com>
Co-authored-by: Zach Waterfield <zlwaterfield@gmail.com>
Co-authored-by: Frank Hamand <frankhamand@gmail.com>
Co-authored-by: Michael Matloka <michal@matloka.com>
Co-authored-by: Neil Kakkar <neilkakkar@gmail.com>
2024-06-18 15:38:53 +00:00
Frank Hamand
f1be4b2dc7
feat: use new state deployment for posthog cloud (#23014)
use new state deployment for posthog cloud

once https://github.com/PostHog/charts/pull/1343 is merged everything
will be in place to support this (uploading assets)

this should make it significantly easier to do fast rollbacks
2024-06-17 15:46:09 +02:00
Frank Hamand
056ac0be46
chore: use new deploy trigger for ingestion deploys (#23007)
use new deploy trigger for ingestion deploys
2024-06-17 12:38:31 +02:00
Neil Kakkar
ee6cd6d9c2 chore: adjust ci for rust services, merge master 2024-06-11 16:30:21 +01:00
Frank Hamand
653798c7e3
fix: Revert "feat: use new deployment trigger for temporal worker deployments" (#22677)
Revert "feat: use new deployment trigger for temporal worker deployments (#22…"

This reverts commit 0834410018.
2024-06-04 16:52:30 +01:00
Frank Hamand
0834410018
feat: use new deployment trigger for temporal worker deployments (#22668)
use new deployment trigger for temporal worker deployments

these trigger a new workflow in posthog/charts which creates a statefile
commit instead of deploying with manually set values from env vars.

the statefile commit then triggers a deploy - this means 100% of our
deployment state is codified, simplifying rollbacks and deploys
2024-06-04 16:12:54 +01:00
Frank Hamand
ef7d9af7dd
chore: Add new deployment for general purpose temporal worker (#22407)
Add new deployment for general purpose temporal worker
2024-05-22 09:24:57 +01:00
Frank Hamand
cfb9519aab
fix: Remove concurrency group from container-images-cd (#21541)
Remove concurrency group from container-images-cd

This can cause deploys to be skipped if another change is merged that doesn't trigger the
same deploys. There's no harm in running this job concurrently as the triggered deploys will
still be in concurrency groups
2024-04-15 15:23:23 +01:00
Frank Hamand
1bd7589c2c
feat: Pass PR labels through to deploy action (#21434)
* Pass PR labels through to deploy action

* Add the get-pr-labels action

* fix syntax error
2024-04-09 12:13:58 +01:00
danielxnj
74c22969cf
chore: Add context to deployment messages (#20911)
Add context to deployment messages

Co-authored-by: xneyder <xneyder@gmail.com>
2024-03-14 08:28:57 -04:00
dependabot[bot]
dd0cc19890
chore(deps): bump docker/setup-qemu-action from 2 to 3 (#20811)
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 2 to 3.
- [Release notes](https://github.com/docker/setup-qemu-action/releases)
- [Commits](https://github.com/docker/setup-qemu-action/compare/v2...v3)

---
updated-dependencies:
- dependency-name: docker/setup-qemu-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-11 17:07:11 +01:00
Ian Woodard
794fffd087
chore: Update getsentry/action-github-app-token to v3 (#20256) 2024-03-01 15:27:42 +00:00
Frank Hamand
72b7077ecf
chore: Replace DOCKERHUB_USERNAME secret with plaintext (#20490)
Replace DOCKERHUB_USERNAME secret with plaintext

This isn't a secret and it causes every instance of "posthog" in the
action logs to be replaced by "***"  because it's the value of a secret
2024-02-21 15:55:27 +00:00
danielxnj
e2819b3abc
chore: Remove deprecated action for triggering PostHog Cloud deployment (#20414)
Remove deprecated action for triggering PostHog Cloud deployment
2024-02-19 08:38:40 -05:00
Michael Matloka
4914341439
fix: Fix baked-in commit SHA in simplified version (#20342)
fix: Fix baked in commit SHA in simplified version
2024-02-14 17:30:18 +01:00
Julian Bez
69823d2a30
fix: Improve label in row for other breakdown (#20276) 2024-02-14 08:31:45 +00:00
danielxnj
81123e0694
chore: Update PostHog Cloud deployment action (#20222)
* Update PostHog Cloud deployment action

* Update dispatch-action to use main branch
2024-02-12 13:04:07 -05:00
Michael Matloka
770b5aa3e1
feat: Add console surprise (#19900)
* feat: Add console surprise

* Fix typing
2024-01-23 18:57:40 +00:00
dependabot[bot]
2a71fa63f3
chore(deps): bump docker/login-action from 2 to 3 (#19893)
Bumps [docker/login-action](https://github.com/docker/login-action) from 2 to 3.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](https://github.com/docker/login-action/compare/v2...v3)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-23 14:13:59 +01:00
Brett Hoerner
3bfd752729
fix(ci): Fix CI changes checks (#19783) 2024-01-16 08:16:35 -07:00
Arun Sathiya
269fa4b4cf
ci: Use GITHUB_OUTPUT envvar instead of set-output command (#19733) 2024-01-12 10:28:08 +01:00
Frank Hamand
636d0c44b3
chore: Remove old dockerfile and only build a single image with unit (#19614)
* Remove old dockerfile and only build a single image with unit

We have migrated over to the `unit` image (instead of gunicorn) but we
were still building both. This could lead to confusion - we have no
plans to move back so let's remove the second image build and only
build the unit based image

* Remove unit build id
2024-01-05 15:06:01 +00:00
dependabot[bot]
26c1dac4f1
chore(deps): bump aws-actions/amazon-ecr-login from 1 to 2 (#19558)
Bumps [aws-actions/amazon-ecr-login](https://github.com/aws-actions/amazon-ecr-login) from 1 to 2.
- [Release notes](https://github.com/aws-actions/amazon-ecr-login/releases)
- [Changelog](https://github.com/aws-actions/amazon-ecr-login/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/amazon-ecr-login/compare/v1...v2)

---
updated-dependencies:
- dependency-name: aws-actions/amazon-ecr-login
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-02 15:27:40 +00:00
dependabot[bot]
a49eda3f50
chore(deps): bump aws-actions/configure-aws-credentials from 1 to 4 (#19557)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1 to 4.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1...v4)

---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-02 15:06:55 +00:00
Eric Duong
2a6a13c578
feat(data-warehouse): DLT + temporal (#18700)
* testing

* draft

* tests

* working rough draft

* split workflow and activity workers

* temp

* split task queues

* add schedule

* working with schedule

* add bucket stitching activity

* sync data steps for pipeline

* add comment

* update default endpoints

* workflow with all steps

* update heartbeat

* update env var, update folders so there are common and specific workflow modules

* update workflow

* update imports

* reformat

* already sync

* format

* adjust async methods

* make it readable

* remove extra

* remove unnecessary config

* add invoices to default endpoint

* change heartbeat name

* remove

* update dev packages

* update migration

* package and tests

* update test import path

* restore task queue env var and remove unnecessary ones, update github action to only trigger deploy for respective worker

* fix tests

* typing

* revert task queue change

* update github action and env vars

* poll reload

* update retry

* change activity stiching function back to sync for now

* typing

* try to import differently

* Update query snapshots

* Update query snapshots

* remap

* move

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (2)

* Update UI snapshots for `chromium` (1)

* sort

* update import

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (1)

* typing

* add notes on logging

* make sure datawarehousetable filtering works right

* update timeout and how datawarehouse tables are linked

* sort

* add delete

* Update UI snapshots for `chromium` (1)

* Update UI snapshots for `chromium` (1)

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-11-29 14:05:24 -05:00
Eric Duong
daac935bf4
chore(data-warehouse): Refactor temporal env var (#18824)
* update env var, update folders so there are common and specific workflow modules

* update workflow

* update imports

* reformat

* already sync

* revert task queue change

* update github action and env vars

* remap

* move
2023-11-29 09:32:38 -05:00
Frank Hamand
8fb7e190e5
Pass in image_tag_unit to cloud deploy (#18825) 2023-11-23 11:31:21 +00:00
Frank Hamand
a381131708
chore: Build unit docker image so we can build on arm (#18492)
Build unit docker image so we can build on arm

We were using the unit 1.28-python3.10 image before. The unit python3.11
image is available on arm but 3.10 only on amd64. Build it ourself so that
we can use arm and also latest unit on 3.10
2023-11-08 17:23:56 +00:00
Tomás Farías Santana
d46fa0840d
feat(temporal-worker): Add steps to trigger deployment (#17881) 2023-10-16 11:28:41 +02:00
Brett Hoerner
e3d7fa9e49
chore: add commit hash file to the built docker image (#17833) 2023-10-06 07:28:25 -06:00
Frank Hamand
3ef42ddd38
feat: Add docker image that uses nginx unit instead of gunicorn (#17573)
* Add docker image that uses nginx unit instead of gunicorn

🦄🔫

* Add unit build to CI

* Fix duplicate id

* try 3.11

* Only build for amd64

need python3.11 for unit image on arm
2023-09-21 16:50:19 +01:00
Paul D'Ambra
9c68581779
fix: container cd (#17570)
* fix: container cd for each sha

* fix: container cd for each sha

* fix
2023-09-21 11:39:05 +01:00
Frank Hamand
78f7d0f563
chore: Tag docker images with git sha (#17569)
Tag docker images with git sha
2023-09-21 11:12:48 +01:00
Michael Matloka
8fd0f7a3f9
ci: Fix CI for forks (#16776)
* ci: Fix CI for forks

* Try updating snapshots on forks

* Try fixing snapshot verification instead

* Consolidate Docker-related workflows

* Run visual regression tests

* Update ci-e2e.yml

* Use fork's GHCR

* Try Depot caching approach instead of GHCR

* Lowercase reference

* Update E2E tests paths filter

* Fix permissions

* Debug .env

* Fix double checkout

* Remove obsolete release workflows

* Fix formatting

* Also run plugin server tests for good measure

* Clarify automerge job name

* Describe action inputs

* Refactor E2E workflow for clarity and comments

* Use project ID from depot.json
2023-07-28 14:23:32 +02:00
Jacob Gillespie
69b7a6578b
fix: remove cache-to: gha when using Depot (#16693)
Remove cache-to: gha when using Depot
2023-07-20 16:44:29 +01:00
Ben White
85c0b33004
feat: Rollout v2 recorder for everyone (#15790) 2023-07-20 12:00:00 +00:00
danielxnj
a2f51c2cbc
chore: Danielj/split plugins helm chart (#16612)
* Trigger plugins deployment when the folder is updated
2023-07-18 14:05:39 -04:00
Paul D'Ambra
a57b22893f
chore: remove more depot build caching in GH Actions (#16621) 2023-07-18 09:28:08 +01:00
Paul D'Ambra
49728fdb28
chore: no depot cache (#16620) 2023-07-18 08:51:43 +01:00
danielxnj
319708a985
chore: Danielj/split plugins helm chart revert (#16466)
* Revert "chore: Danielj/split plugins helm chart (#16459)"

This reverts commit 27574c00a1.

* Enable workflow dispatch
2023-07-10 12:45:30 -04:00
danielxnj
27574c00a1
chore: Danielj/split plugins helm chart (#16459)
* Trigger plugins deployment when folder is updated

* Update repository dispatch

* Use digest as tag

* Remove empty line

* Create a new workflow

* Change concurrency

* Revert "Remove empty line"

This reverts commit b307c50cb0.

* Revert "Change concurrency"

This reverts commit 458597b80b.

* Revert "Create a new workflow"

This reverts commit 4e1eef73f2.

* Remove empty line

* Dummy commit to trigger deploy

* Have a digest per platform

* Revert "Have a digest per platform"

This reverts commit 8276bd20a0.

* Revert "Revert "Have a digest per platform""

This reverts commit bc6527c48f.

* Have a digest per platform

* Add meta

* Update ci workflow

* Add workflow dispatch

* Dummy commit
2023-07-10 12:18:09 -04:00
danielxnj
74c558d66e
chore: Revert "chore: Trigger plugins deployment when folder is updated deploy " (#16437)
Revert "chore: Trigger plugins deployment when folder is updated deploy  (#16141)"

This reverts commit 53e6b7e413.
2023-07-07 11:13:08 -04:00
danielxnj
53e6b7e413
chore: Trigger plugins deployment when folder is updated deploy (#16141)
* Trigger plugins deployment when folder is updated
2023-07-07 09:19:08 -04:00
Xavier Vello
7453c6cd27
ci: deploy master tag on all regions (#16362) 2023-07-05 14:11:35 +02:00