0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-30 19:41:46 +01:00
Commit Graph

33 Commits

Author SHA1 Message Date
PostHog bot
27144478f5
Update plugin server to 0.21.26 (#4809) 2021-06-19 02:40:49 +02:00
Michael Matloka
69afc5abc2
Set PLUGIN_SERVER_ACTION_MATCHING to 0 (#4805) 2021-06-18 15:08:50 +00:00
Michael Matloka
5394533bde
Don't fire webhooks and Zapier in case of PLUGIN_SERVER_ACTION_MATCHING (#4794)
* Don't fire webhooks and Zapier in case of PLUGIN_SERVER_ACTION_MATCHING

* Add PLUGIN_SERVER_ACTION_MATCHING to settings

* Add PLUGIN_SERVER_ACTION_MATCHING to ECS task defs

* Remove leftover print

* Update `AsyncActionMappingNotice`

* Remove stale import
2021-06-18 16:32:29 +02:00
Paolo D'Amico
01b7daacc2
Remove NewRelic from Cloud (#4716)
* remove NR

* remove secret key too
2021-06-14 11:01:57 +02:00
Karl-Aksel Puulmann
030529cfb3
Show internal metrics on /instance/status page (#4366)
* Extract function for capture

* Add capability to capture internal metrics

- This is behind an environment variable, we'll turn this on by default
on clickhouse-based installation.
- A special Org/Team gets created for this lazily, which is not accessible for
anyone. This makes avoiding issues with stats/billing/properties and easier.

* Capture some useful metrics into posthog

* Set up an unique constraint for for_internal_metrics organization

This avoids some nasty race conditions

* internal_metrics fixes

* Extract component OverviewTab

* New tabbing system for system status page

* Embed ClickhouseTab

* Generate a dashboard for internal metrics on demand

* More metrics

* Add more internal metrics, add tests

* Fix migration files

* Adjust copy

* Update task definitions

* Fix a typing issue

* Rename a component

* Migration fixup

* Try reset patch after test ends

* Clear lru_cache between tests
2021-05-20 13:42:39 +03:00
Karl-Aksel Puulmann
f4009c1e16
Allow migrating on a clickhouse cluster (#4197)
* Allow migrating clickhouse on cluster

Context under https://github.com/PostHog/posthog/issues/4090

* Add option to print sql
2021-05-05 14:38:39 +03:00
James Greenhill
b7bc93cfac
Enable cleanup of SSM Task that enables us to exec into containers on ecs (#4096) 2021-05-04 14:22:20 +00:00
Paolo D'Amico
2020c32c66
Add NewRelic to cloud deployment (#4005) 2021-04-15 11:53:19 -07:00
Michael Matloka
286287e8e1
Remove IS_DOCKER env var (#3843) 2021-04-01 17:10:00 +02:00
Paolo D'Amico
433d560b23
Fix proxy config (#3654) 2021-03-23 13:12:06 -07:00
Michael Matloka
6a7cd084fe
Enable PLUGIN_SERVER_INGESTION (#3684) 2021-03-17 16:56:47 +01:00
Michael Matloka
3c0737f0fd
Plugins access control (#3486)
* Add Organization.PluginsAccess

* Rename PluginsAccess to PluginsAccessLevel

* Use Organization.plugins_access_level in can_…_plugins_via_api

* Add migration for Organization.plugins_access_level

* Remove unused PLUGINS_CLOUD_WHITELISTED_ORG_IDS

* Update access.py

* Add OrganizationPluginsAccessLevel TS enum

* Fix merge

* Disable LocalPlugin UI on Cloud

* Move away from PluginAccess interface

* Extend PluginsAccessLevel range

* Refactor PluginsAccessLevel for brevity

* Remove PluginAccess interface completely

* Add plugins managed globally

* Update migration

* Show managing org name in "Managed" plugin tag

* Smoothen some rough edges

* Smoothen more edges

* Restore correct MULTI_TENANCY default

* All the edges

* Fix most existing tests

* Remove PLUGINS_*_VIA_API env var support

* Update pluginsNeedingUpdates

* Remove can_*_plugins_via_api from instance status page

* Add tests and polish permissioning

* Update migration

* Fix typing

* Make plugin drawer UI less intrusive

* Update migration

* Fix Uninstall button condition

* Use unified _preflight status endpoint instead of the custom plugins one

* Fix plugin update label condition

* Fix "Check for updates" button condition

* Explain PluginsAccessLevel choices with comments

* Hide global plugin installation option on self-hosted

* Don't actions.loadRepository() as install org

* Improve permissioning with tests

* Satisfy mypy

* Add plugins access level to admin and fix org admin

* Check plugins access level more

* Rename endWithPeriod

* Refactor FE access control checks to accessControl.ts

* Deduplicate permissioning

* Add exception message

* Align backend and frontend plugins access level helpers

* Add plugins access level helper tests

* Fix ChartFilter
2021-03-17 15:01:55 +01:00
Karl-Aksel Puulmann
591bd65f98
Revert "Revert "Revert "Revert "Disable PLUGIN_SERVER_INGESTION (#3645)" (#3648)" (#3674)" (#3677)" (#3680)
This reverts commit 19e21fa199.
2021-03-17 15:39:50 +02:00
Karl-Aksel Puulmann
19e21fa199
Revert "Revert "Revert "Disable PLUGIN_SERVER_INGESTION (#3645)" (#3648)" (#3674)" (#3677)
This reverts commit cd77cb1b35.
2021-03-17 09:21:01 +02:00
Karl-Aksel Puulmann
cd77cb1b35
Revert "Revert "Disable PLUGIN_SERVER_INGESTION (#3645)" (#3648)" (#3674)
This reverts commit 05abb369ba.
2021-03-16 20:40:40 +02:00
Tim Glaser
e7c0f5f8cf
Enable event property usage env vars (#3664) 2021-03-16 11:27:58 +01:00
Karl-Aksel Puulmann
05abb369ba
Revert "Disable PLUGIN_SERVER_INGESTION (#3645)" (#3648)
This reverts commit 5525a47c15.
2021-03-15 10:46:16 +02:00
Michael Matloka
5525a47c15
Disable PLUGIN_SERVER_INGESTION (#3645) 2021-03-14 19:08:53 +01:00
Michael Matloka
dbbb113428
Make PLUGIN_SERVER_INGESTION True by default (#3485)
* Make PLUGIN_SERVER_INGESTION True by default

* Disable plugin server ingestion in tests by default

This is so that ingestion tests in here, which rely on old ingestion, don't fail. Plugin server ingestion itself is covered well in the plugin server repo.
2021-03-01 22:34:40 +01:00
Marius Andra
33951f0256
Plugin server ingestion again (#3381)
* re-enable cloud ingestion for specific orgs

* update plugin server to 0.9.2

* correctly process the negative if

* enable ingestion in the task
2021-02-18 16:03:22 +01:00
Paolo D'Amico
7c4b7eb811
Cloud billing trial period & free plan (#3259) 2021-02-11 18:42:39 +01:00
Michael Matloka
0f525232ec
Set Cloud PLUGIN_SERVER_INGESTION to false (#3312)
* Set Cloud PLUGIN_SERVER_INGESTION to false

* Update task-definition.plugins.json
2021-02-11 16:17:14 +01:00
Marius Andra
429f3e50dc
filp PLUGIN_SERVER_INGESTION on (#3206) 2021-02-04 20:25:59 +01:00
Michael Matloka
1f3145128c
Enable PLUGIN_SERVER_INGESTION (#3107)
* Enable PLUGIN_SERVER_INGESTION_HANDOFF = get_bool_from_env("PLUGIN_SERVER_INGESTION_HANDOFF

* Don't set PLUGIN_SERVER_INGESTION_HANDOFF in worker

* Add comments

* Remove _HANDOFF from PLUGIN_SERVER_INGESTION

* add stats counter for plugin server handoff, so we can verify events out and events in

* add whitelisted posthog and kea organizations

* disable ingestion this round --> first let's just check the plugin server can talk to kafka & clickhouse before sending real events to it

* enable ingestion in docker-compose.ch.yml

* eliminate bad merge

* async action event matching when using postgres plugin server ingestion (#3182)

* fix org

* remove _HANDOFF from topic

* add plugin_ to plugin server ingestion topic

* update plugin server to 0.7.0

Co-authored-by: Marius Andra <marius.andra@gmail.com>
2021-02-04 16:17:24 +01:00
Tim Glaser
f1f8a0b7f5
Add denormalized prop config (#3009) 2021-01-20 13:53:45 +01:00
Marius Andra
606525644e
Add deployment environment variables (#2874)
* add deployment env to track instances

* Rename Production ECS

Co-authored-by: Karl-Aksel Puulmann <oxymaccy@gmail.com>
2021-01-11 13:25:40 +01:00
Paolo D'Amico
e169a74346
Support different Reply-To header for most emails (#2846)
* adds reply-to support for emails

* add missing from config
2021-01-05 10:48:20 +01:00
Michael Matloka
818576a4d6
Allow Plugins on Cloud (#2783)
* Allow Plugins configuration on Cloud

* Generate UUID in log_event for idempotency

* Make event UUID common for both EE event processing pipelines

* Restore frontend from master for changed direction

* Fix _process_event_ee

* Whitelist PostHog Inc. and KeaJS for Plugins on Cloud

* Test Plugins on Cloud organization whitelisting

* Fix FOSS

* Revert UUID changes (another PR)

* Update posthog-plugin-server to 0.6.0-beta
2020-12-16 16:48:41 +01:00
Michael Matloka
7ba9f7de09
Plugin server ingestion base (#2732)
* Add relevant settings to KEYS in bin/plugins-server

* Log all EE events to events_handoff Kafka topic for plugin server

* Clean up settings

* Fix FOSS

* Don't introduce KAFKA_EVENTS_HANDOFF

* Add cosmetic newline

* Add DEBUG WAL print()
2020-12-14 16:05:18 +01:00
James Greenhill
1ed68dcfb8
Actually set env var for DISABLE_SERVER_SIDE_CURSORS to True (#2692) 2020-12-07 13:35:15 -08:00
James Greenhill
7c90eb64fe
DISABLE_SERVER_SIDE_CURSORS to false for pgbouncer friendship (#2677)
* DISABLE_SERVER_SIDE_CURSORS to false for pgbouncer friendship

* USING_PGBOUNCER
2020-12-04 17:44:02 -08:00
James Greenhill
97280d56fc
update url env var for ECS containers (#2660) 2020-12-03 16:16:32 -08:00
James Greenhill
ed6eb5e796
Setup ecs configs for web, worker, migration tasks and services (#2458)
* add worker to the ecs config and deploy

* for testing

* pull from this branch for testing

* chain config renders

* split out events pipe

* Set is_heroku true because of heroku kafka

* update /e/ service to run on port 8001

* add 8001 to the container definition as well

* simplify

* test migrating w/ ecs task using aws cli

* split services

* typo in task def

* remove networkConfiguration from task definition

* duplicate

* task-def-web specific

* update events service name

* Handle base64 encoded kafka certs

* if it's empty then try to set it for env vars

* fix b64 decode call

* cleanups

* enable base64 encoding of keys for kafka

* depend on kafka-helper for deps

* reformat

* sort imports

* type fixes

* it's late, I can't type. typos.

* use get_bool_from_env

* remove debug bits. Trigger on master/main

* prettier my yaml

* add notes about ref in GA

* up cpu and memory
2020-12-03 15:51:37 -08:00