0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-24 18:07:17 +01:00
Commit Graph

10 Commits

Author SHA1 Message Date
Yakko Majuri
b56b141126
Special Migrations Runner (#7054 pt. 4) (#7446)
* add special migration definition and example

* types

* special migrations runner

* fix tests

* fix tests 2

* add clickhouse runner

* add temp fix for tests

* wip

* add special migrations api (#7448)

* wip new structure

* update example sourcing

* Update .gitignore

* yet another wip structure

* code quality

* cypress

* test docker image build

* implement resumable ops

* code quality

* add comments

* add warning

* add conditional requirements for migration

* add comment on is_required

* add dependency map

* wip dependencies and run migration on startup

* code quality

* fix bugs

* fix more bugs

* format

* types

* remove api from this branch

* types

* types

* update clickhouse script

* add is_migration_in_range util

* fix type

* fix runner

* add AUTO_START_SPECIAL_MIGRATIONS env var

* reset migration on start

* cleanup

* wip per op rollback

* prevent accidental status rollback

* add utils and definition test

* update example with rollback per op

* wip test special migration

* add first runner tests

* add runner tests

* add util for code paths

* fix test

* fix types

* fix types again

* cleanup

* cleanup

* add periodic healthcheck task tests

* remove unused imports

* safer row updates

* fix coalescing none checks

* code quality

* add docstrings

* fix

* fix deploys issue

* update scripts

* add delay

* address reviews

* address review comments

* address review comments

* address final comments

* fix import error

* fix tests

* remove unused imports

* fix tests

* fix task test

* remove unused return value

* remove unused special migrations code from migrate_clickhouse

* tweaks to support fresh deployments
2021-12-13 13:00:27 -03:00
Alex Gyujin Kim
f9cd157ca8
Revert "Fix CH no data blocker (#5238)" (#5239)
This reverts commit babf93b413.
2021-07-21 06:38:08 +00:00
Alex Gyujin Kim
babf93b413
Fix CH no data blocker (#5238) 2021-07-21 05:23:35 +00:00
Karl-Aksel Puulmann
fc5c6476a0
Revert "Revert "Add is_deleted column to person_distinct_id"" (#5194)
* Revert "Revert "Add is_deleted column to person_distinct_id (#5151)" (#5193)"

This reverts commit 401268bdba.

* A tweak for docker-compose builds

Co-authored-by: James Greenhill <fuziontech@gmail.com>
2021-07-19 19:47:41 -07:00
Alex Gyujin Kim
d36b15ed0e
Add frontend local dev script for Clickhouse development (#4891)
* add frontend dev script

* some refactoring
2021-06-28 23:02:13 -07:00
James Greenhill
9639361efc
Defer event fields on team model to make grabbing fields a bit more lazy (#4028)
* Defer event fields on team model to make grabbing fields a bit more lazy

* update testing bin for ee

* remove testing change for ee
2021-04-18 16:22:59 -07:00
Adrien Brault
89ed4ce864
Fix docker dev environment (#3861)
* Fix docker dev environment

- Use postgres 12 to fix a failing test
- Leverage a yaml anchor to share worker/web services configuration
- Add psql
- Configure psql

* Don't use :cached

* Use Postgres 12 in docker-compose everywhere

* Use postgresql-client-12

* Remove extraneous whitespace

* Clean up dev.Dockerfile

* Clean up EE dev/test docker-compose

* Simplify docker-compose.ch.test.yml

Co-authored-by: Michael Matloka <dev@twixes.com>
2021-04-03 20:41:47 +02:00
Karl-Aksel Puulmann
24de8b55e4
Run tests via pytest (#3417)
* Compile requirements-dev.txt with latest pip-tools

* Install pytest

* Avoid picking up factories as tests

* New runner

* Always set TEST env variable running tests

Some of our tests rely on it.

* Remove repetition

* Fix a broken test

* Cut down noise from bin/tests

* Rename test factory

* Fix stickiness filter

* Skip a broken test

This has been broken since numpy removal PR. Sadly tests were not
running for this submodule

* Fix import on ee

* Run ee tests properly

The django_db_setup fixture will be automatically run when running ee/
module tests.

* Make tests run on CI

* Include REDIS_URL, fix cloud

* Set TEST env variable

* Hack cloud tests to work

* Attempt at workflow fix

* Import Person model when running ee tests

This module implicitly adds hooks, so this is needed when running tests

* Respect reuse-db for clickhouse

* Add custom markers to avoid warnings

* pytest: use ch test database always

Accidentally wiped by ch setup a few times without this. Oops

* Remove repetition in tests

* Pytest: Always run migrations

Testing a state cleanup fix

* Use same DB in conftest and main code

* Pytest: autoset TEST setting without env variable

* fix broken test

Co-authored-by: eric <eeoneric@gmail.com>
2021-02-24 09:32:44 +02:00
James Greenhill
e8dcf13ad0
Emit timing gauge to statsd for sync_execute on clickhouse (#3209)
* Emit timing gauge to statsd for sync_execute on clickhouse

* take out of block for SHELL_PLUS_PRINT_SQL

* add docker testing for ease

* comment out cypress projectid
2021-02-05 14:13:38 -08:00
Michael Matloka
b39dce42cf
Fix webpack-dev-server inside Docker (#2699) 2020-12-08 11:44:39 +01:00