0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-24 18:07:17 +01:00
Commit Graph

24 Commits

Author SHA1 Message Date
Marius Andra
dfcc9f7fb4
upgrade plugin server to 0.7.4 (#3226) 2021-02-06 10:44:34 +01:00
Marius Andra
eed06ffd59
Upgrade plugin server to 0.7.3 (#3225) 2021-02-06 10:22:11 +01:00
Michael Matloka
e636cbbc49
Bump plugin server to 0.7.2 (#3205) 2021-02-04 17:52:48 +01:00
Marius Andra
d064f8b036
update plugin server to 0.7.1 (#3204) 2021-02-04 17:01:26 +01:00
Michael Matloka
1f3145128c
Enable PLUGIN_SERVER_INGESTION (#3107)
* Enable PLUGIN_SERVER_INGESTION_HANDOFF = get_bool_from_env("PLUGIN_SERVER_INGESTION_HANDOFF

* Don't set PLUGIN_SERVER_INGESTION_HANDOFF in worker

* Add comments

* Remove _HANDOFF from PLUGIN_SERVER_INGESTION

* add stats counter for plugin server handoff, so we can verify events out and events in

* add whitelisted posthog and kea organizations

* disable ingestion this round --> first let's just check the plugin server can talk to kafka & clickhouse before sending real events to it

* enable ingestion in docker-compose.ch.yml

* eliminate bad merge

* async action event matching when using postgres plugin server ingestion (#3182)

* fix org

* remove _HANDOFF from topic

* add plugin_ to plugin server ingestion topic

* update plugin server to 0.7.0

Co-authored-by: Marius Andra <marius.andra@gmail.com>
2021-02-04 16:17:24 +01:00
Michael Matloka
b33734bd89
Update plugin server to 0.6.11 (#3151) 2021-02-01 19:31:31 +01:00
Michael Matloka
0420786607
Make PluginConfig.order mandatory (#3122)
* Make PluginConfig.order mandatory

* upgrade plugin server to 0.6.10

* black

* Ensure no PluginConfig.order collission

* Clean up PluginConfig API

* Revert "Ensure no PluginConfig.order collission"

This reverts commit d8b2c907e4.

* Black

Co-authored-by: Marius Andra <marius.andra@gmail.com>
2021-01-28 17:03:36 +01:00
Marius Andra
0c6682f859
Plugin Server 0.6.8 (#3043)
* living on the edge

* Upgrade to plugin server 0.6.8

Co-authored-by: Michael Matloka <dev@twixes.com>
2021-01-21 23:43:49 +01:00
Marius Andra
b385100a64
plugin server 0.6.6 (#3035) 2021-01-21 16:51:54 +01:00
Marius Andra
c6d3ea5fb0
upgrade to plugin server 0.6.5 (#3003) 2021-01-19 21:53:23 +01:00
Marius Andra
29fa6a8ac9
update to new @posthog/plugin-server package (#2917) 2021-01-12 17:22:36 +01:00
Marius Andra
e3aa8bf31b
upgrade to plugin server 0.6.4 (#2897) 2021-01-08 15:13:19 +01:00
Michael Matloka
ef42e5a914
Update posthog-plugin-server (#2878)
* Use posthog-plugin-server 0.6.2

* Fix bin/plugin-server as docker-compose service
2021-01-07 16:21:16 +01:00
Marius Andra
39239c2780
Upgrade Plugin Server (#2816)
* use KAFKA_ENABLED key

* 0.6.1 plugin server
2020-12-21 21:57:29 +01:00
Michael Matloka
818576a4d6
Allow Plugins on Cloud (#2783)
* Allow Plugins configuration on Cloud

* Generate UUID in log_event for idempotency

* Make event UUID common for both EE event processing pipelines

* Restore frontend from master for changed direction

* Fix _process_event_ee

* Whitelist PostHog Inc. and KeaJS for Plugins on Cloud

* Test Plugins on Cloud organization whitelisting

* Fix FOSS

* Revert UUID changes (another PR)

* Update posthog-plugin-server to 0.6.0-beta
2020-12-16 16:48:41 +01:00
Marius Andra
f3e4cad700
Plugin editor (#2743)
* fix tsc error

* add plugin source, create plugin source version model, add plugin_type

* can create and save source plugins via the api

* make empty source plugins

* message if no config options available

* different image or tag for source plugins

* fix some types

* second drawer

* add fields into drawer

* add monaco editor

* refactor drawer

* save plugin and must be json

* close tab on save

* fix default code

* upgrade to plugin server 0.5.0 - with scheduled plugins

* less height

* upgrade to plugin server 0.5.1 - with posthog.capture

* remove minimap from editor

* upgrade to 0.5.1

* use enum

* reduce quirk

* must enter a name/url

* use the source

* simpler text

* sync image

* add link to docs

* add a link to the documentation inside the source code drawer

* text / ux simplifications

* nicer first plugin experience

* nicer django model choices
2020-12-14 17:11:29 +01:00
Marius Andra
b5b7276ced
Restart plugins on error (#2719)
* export as $CONFIG_JSON

* export as $CONFIG instead

* restart plugin server if killed

* restart plugin server if killed

* update to 0.4.3
2020-12-10 07:29:06 +01:00
Marius Andra
177cee9e38
Set right concurrency for plugin server on Heroku (#2703)
* nodejs worker concurrency on heroku

* upgrade plugin server

* upgrade server

* fix another bug with 0.3.2

* plugin server with resilient redis

* plugin server with more resilient workers

* new plugin server

* update
2020-12-09 18:08:25 +01:00
Eric Duong
7916ceb8ba
Revert "Revert "Plugin Attachments (#2263)" (#2376)" (#2380)
This reverts commit 9ff05e8c53.
2020-11-13 14:15:24 -05:00
Eric Duong
9ff05e8c53
Revert "Plugin Attachments (#2263)" (#2376)
This reverts commit 39c2e5973b.
2020-11-13 12:10:27 -05:00
Marius Andra
39c2e5973b
Plugin Attachments (#2263)
* file uploads for plugins [WIP]

* save plugin attachments

* rename file->attachment, add size

* rename file->attachment, add size

* rename config type "file" to "attachment"

* see already uploaded files

* new config schema, add markdown support, move "disabled/enabled" switch up for visibility

* hints via markdown

* new plugin server

* remove attachments

* fix config serialization due to formdata

* small fixes

* help mypy

* remove `isFormData` argument

* remove debugger

* consistent naming for add/remove attachment

* remove unused params

* extract plugin test http mock, create test for plugin/create, mark most fields as read-only

* update github helloworldplugin zip with JS version of plugin

* upgrade plugins

* add auth test

* test plugin repo and config

* test plugin API attachment uploads

* test plugin server status response

* extract plugin config FormData method

* fix mypy

* use FakeRedis, not FakeStrictRedis

* random try - add REDIS_URL to tests

* try bad github action print debugging

* try bad github action print debugging

* plugin tests under multi tenancy

* add fakeredis to CI FOSS test

* remove prints

* enable plugin tests if in EE
2020-11-13 15:18:12 +01:00
Marius Andra
220ba7777a
Plugins via NPM (#2204)
* support both 1) zip and tgz archives 2) github and npm packages

* revert noisy change in PR

* refactor and add test

* add tests for downloading and extracting archives

* posthog-plugin-server upgrade

* add mode to tarfile.open to force gz

* swap github and npm tgz order

* fix

* remove github tgz because we use the zip there

* fix test
2020-11-05 21:22:49 +01:00
Marius Andra
8600f7e80c
Revert process_event task name (#2179)
* use long process_event task names (as they were before)

* fix task name for EE

* prevent losing tasks on the backwards migration

* Mypy hack
2020-11-02 16:27:40 -08:00
Marius Andra
fce86ef46d
Plugin v8 (#1946)
* plugin progress

* blah

* add posthog config for plugins

* test gitignore

* new functionality for plugins

* support local plugin paths

* also ignore symlinks

* add positional argument

* fixes

* small fixes

* config polish

* config passed to posthog plugin

* ooooooops

* symlink fix

* cleanse dir before loading

* add cache to plugins

* pickle the goods

* unlink symlink

* pass full config

* unlink even if link points to nothing

* fix fix

* return none if value is empty

* plugin model

* plugins scene

* add config schema to plugins

* install plugins

* save descriptions

* show descriptions

* edit plugin

* save plugin config

* plugin modal

* uninstall plugins

* UX cleanup

* add "required" to plugin config

* open plugin modal after install

* split to subcomponents

* install custom plugins

* rework backend for model plugins

* Plugins on models

* simple reload pubsub

* fix apps not installed

* fix master/main issue

* fix reload command

* use the github api to get the default branch

* init plugins only if not running migrate/makemigrations

* store plugins zip archives in postgres

* tag plugins to specific versions

* save plugins in pluginConfig

* update pluginConfigs instead of adding new rows, remove from redux on uninstall

* remove debug

* run plugins from db by team

* reload when deleting

* remove debug

* smarter handling of dynamic plugins, support local plugins again

* improve typings, add some nicer warnings

* yarn lock file after merge

* squash migrations and add "locked" field to plugins

* error if folder not found in zip

* unregister plugins

* skip plugin init in test mode

* basic plugin test

* avoid mutating the same prop hash

* add pip tools to requirements.txt

* fix mypy, fix manage.py script error

* avoid plugins with mypy

* mypy fix

* abstract redis into plugin and add team_id to reload

* refactor and start work on syncing with posthog.json

* start testing plugin loading from json

* test plugin deletion

* test for syncing plugins from config

* complete and then test local json plugin sync

* test converting back and forward between an local and http path

* remove global plugin config from plugins array in posthog.json

* rename configSchema --> config_schema

* fix migration after merge

* rename from_cli to from_json

* mypy

* import pip after plugin loaded

* show error details

* raise exceptions visible to the frontend

* sync plugins on load

* access control to updating plugins from the web

* access control

* remove posthog.json from git

* test config schema from json

* if you can install via the web, you can also configure

* remove separate view access

* title as "Plugins" instead of "Installed Plugins" if we can't install ourselves and don't see the repository

* add self.team to plugin base class

* add instance_init method

* refactor into files

* sync global plugin config from json

* make global plugins work, add test

* global plugins in interface, make them take precedence over local plugins

* add comments to plugin base class

* reload/reset plugins before each test

* add error field to plugins

* add many plugin zips

* add many plugin zips, fix imports

* store errors on plugin object and test them

* fix types

* add null to error

* can be with any team ID in the test

* save problems running plugins in the plugin_config model

* try to create redis connection pool only once

* throw if no redis

* mypy

* get instance inside heartbeat and not top level

* try caching pubsub

* try pip install with -q

* install pip externally

* remove uuid and typing, now in stdlib

* more verbosity

* add pip back

* catch exceptions

* quiet and no input for pip

* check plugin reload every 10sec on new task

* fix type errors

* fix requirements error message

* use repository.json

* only load and reload plugins on workers

* rename task

* support local js plugins via py-mini-racer

* load js plugins from zip files

* extract jsplugin class and convert to syntax that uses global functions instead of initializing a class

* process events via grpc

* process events with the "posthog-plugins" queue to enable plugins

* remove old native python & mini racer plugin code

* default to false

* change env vars

* fix test

* remove grpc tools

* skip plugins in migrate.py scripts

* fix migration

* change output of settings debug banner to STDERR

* start posthog plugin server with worker

* try to fix python 3.7 test

* add fallback for the optional argument

* annoying CI test debug

* try to finally fix python 3.7 test

* here we go again

* move plugins under instance

* move plugins npm start into its own folder

* more console.log debugginf

* and again

* move plugins to separate script

* more prints

* fix test error

* docker config

* small fixes

* dckerfile fix

* reload plugins via pubsub, upgrade version

* plugins that support team setup code

* sync if made changes from config

* move plugins in menu

* require node 14 in heroku for better plugin support (namely ?. support)

* bump node version in dockerfiles

* update node versions for github actions

* update the concurrency for heroku workers

* update the concurrency for heroku workers (add link)

* Fix migrations after merge

* add ignore_result to process_event tasks

* fix: docker-preview run in parallel bug

* change order of commands

* remove separate plugins server conf script

* clarify intent

* revert castaway change

* add context to plugins/sync.py

* change everything to ValidationError

* delegate destroy to super

* no request to repository url if can't install

* make the if cleaner

* add clarifying line

* add clarifying line

* fix url field type

* rename get_redis_instance to get_client, move to posthog.redis

* remove duplicate validation

* flip if around

* simplify api logic

* simplify plugin_config api, fix global_plugin error

* remove unnecessary field rename

* mypy

* Plugins UI (#2090)

* base UI

* more UI

* load plugin image if available

* toggle enabled plugin

* plugin cards for available

* custom plugins

* change plugin configuration to drawer

* asks for confirmation when enabling or disabling a plugin

* loading state

* separation of concerns, leave new styles for separate PR

* general improvements

* remove button when installation is not available

* preemptively avoid merge conflict with #2114

* move papercups widget & hide bottom bar when drawer is open

* allow clicking the entire plugin card

* address all feedback

* move plugins under "project" menu

* Hide "configure" from globally enabled plugins

Co-authored-by: Marius Andra <marius.andra@gmail.com>

* add plugins opt in toggle to project/plugins

* choose pipeline based on team setting

* add "beta"

* plugin opt-in opt-out pages

* adjust install button

* remove tasks that are never called, remove PLUGINS_ENABLED global key

* fix responsive card display

* fix typo and drawer width

* skeleton fixes

* typo

* use "posthog-plugin-server" npm package

* "posthog-plugin-server" doc

* require the plugin server to be online before enabling plugins

* remove a few needeless "?." cases

* add hint for config_schema

* add hint for errors

* show plugin errors

* stop clicks if clicking on error

* show plugin errors

* loading indicators

* reload plugins when opting in/out

* nicer beta tag

* add frontend type

* fix mypy error

* fix test

* disable plugins if MULTI_TENANCY

* upgrade plugin-server version

* save event with plugin error

* upgrade plugin server

* squashed & optimized migrations

* remove unused import

* updates opt-in copy & hides tech details for cloud version

* fix cypress tests

* compare with None

* change plugins url and add redirect

* remove ellipsis

* use code snippet in plugin errors

* change github regex

* fix loading flickering on installing plugins

* add comment to plugin archive

* fix python style

* remove pip-tools (relic from the python plugin era)

* hard pin plugin server version

* remove copying of posthog.json from dev dockerfile (breaks if file doesn't exist, copied later anyway)

* update lockfile

Co-authored-by: James Greenhill <fuziontech@gmail.com>
Co-authored-by: Paolo D'Amico <paolodamico@users.noreply.github.com>
2020-11-02 15:08:30 +01:00