0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-21 21:49:51 +01:00
Commit Graph

290 Commits

Author SHA1 Message Date
Paul D'Ambra
c88da23201
fix: upgrade script assumes variable presence (#24749) 2024-09-03 14:25:03 +01:00
Marius Andra
00bab5eb34
feat(hog): Hog bytecode function STL (#24653) 2024-08-29 14:28:50 +02:00
Oliver Browne
145cacf60a
feat: cyclotron fetch and janitor run migrations (#24559)
Co-authored-by: Brett Hoerner <brett@bretthoerner.com>
2024-08-23 21:56:36 +03:00
Oliver Browne
9734a40c96
feat: cyclotron (#24228)
Co-authored-by: Brett Hoerner <brett@bretthoerner.com>
Co-authored-by: Ben White <ben@posthog.com>
2024-08-21 12:24:56 -06:00
Michael Matloka
ceecea49f3
feat(lemon-ui): LemonInputSelect 2.0 (#24321)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-08-14 12:15:58 +02:00
Michael Matloka
ceccb49800
feat(insights): Make initial single insight load async v2 (#23978)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Anirudh Pillai <anirudhx5@gmail.com>
2024-08-01 13:03:34 +02:00
Michael Matloka
ac4122ccb9
chore: Remove unused start-https scripts (#23995) 2024-07-26 12:50:45 +01:00
Ben White
b956712cb5
feat(cdp): Oauth refresh flow support (hubspot) (#23811) 2024-07-22 10:15:43 +02:00
Julian Bez
3da4fedefb
feat(queries): Use analytics limited queue for cache warming tasks (#23766) 2024-07-18 11:41:57 +00:00
Brett Hoerner
8f4df45984
feat: make rusty-hook Hog-aware, sending responses back via kafka (#23619)
Co-authored-by: Ben White <ben@posthog.com>
2024-07-16 11:12:48 -06:00
Paul D'Ambra
f079205aeb
fix: hit celery with a hammer (#23340) 2024-06-28 21:42:43 +00:00
Sandy Spicer
eac199d24a
chore: upgrade python to 3.11 (#23206) 2024-06-27 14:16:27 -07:00
Julian Bez
6c95fd18ba
chore(ruff): Add ruff rules for exception handling (#23251) 2024-06-27 12:39:21 +01:00
Paul D'Ambra
99f5a7341a
feat: update for web vitals (#23220) 2024-06-26 11:01:01 +01:00
Sandy Spicer
6c23c9bd89
revert: "chore: upgrade python to 3.11 🐍" (#23198)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-24 11:50:48 -07:00
Raquel Smith
a21ab359db
fix: handle redirect on org delete properly (#22733)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-24 09:44:15 -07:00
Michael Matloka
165ccf4924
chore(schema): Remove Python codegen hack (#23189)
* chore(schema): Remove Python codegen hack

* Make StrEnum hack cross-platform
2024-06-24 17:29:27 +02:00
Sandy Spicer
23a789d9fe
chore: upgrade python to 3.11 🐍 (#22932)
🐍
2024-06-21 16:45:42 +00:00
Sandy Spicer
b5bbc4960e
fix(celery): remove unused queues and add a LONG_RUNNING queue (#22789) 2024-06-13 16:29:24 -07:00
Thomas Obermüller
8ab8741e63
chore(refactor): pythonic schema (#22573) 2024-06-10 15:19:20 +02:00
Marius Andra
4d08d7436c
feat(hog): hoge tests, cli and debugger (#22743) 2024-06-07 11:37:53 +02:00
Sandy Spicer
09b6933032
feat(dev): add xdist for local concurrency in pytest (#22684) 2024-06-05 12:32:02 -07:00
feedanal
9f96b34a7f
fix: enable compression for reverse_proxy responses (#22237)
enable compression for reverse_proxy responses

compression is disabled in caddy by default, rendering frontend PAINFULLY slow (as if Django is not slow enough already)
2024-06-04 11:08:25 +01:00
Thomas Obermüller
f3aab093bf
fix(hogql): derive cache keys from pydantic model_dump (#22465) 2024-06-03 15:34:05 +00:00
Sandy Spicer
9cdbbcfefc
feat: move query performance polling to its own celery task in a performant manner (#22497) 2024-05-30 22:25:08 -07:00
Frank Hamand
87cfc3fae4
feat: add env var for number of nginx unit worker processes (#22567)
add env var for number of nginx unit worker processes

i suspect that with asgi we'll be better off with 1 instead of 4 worker
processes - i'd like us to be able to test this per deployment via an
env var
2024-05-29 12:01:09 +01:00
Marius Andra
45d275c4ee
feat(not-defining): Hog (#22336) 2024-05-28 14:51:45 +02:00
Julian Bez
9576fab1e4
chore: Add Pyupgrade rules (#21714)
* Add Pyupgrade rules
* Set correct Python version
2024-04-25 08:22:28 +01:00
Michael Matloka
d7d03b5985
feat(insights): HogQL calculation of saved legacy insights v4 (#21781)
* Revert "revert(insights): HogQL calculation of saved legacy insights v3 (#21778)"

This reverts commit c0be1d1412.

* Move HogQL in insight serialization to its own flag
2024-04-24 13:39:43 +02:00
Marius Andra
c0be1d1412
revert(insights): HogQL calculation of saved legacy insights v3 (#21778)
Revert "fix(insights): HogQL calculation of saved legacy insights v3 (#21720)"

This reverts commit 3ffa9acd75.
2024-04-23 23:17:47 +02:00
Tom Owers
3a90d82940
fix(celery): Run celery locally as a single worker (#21772)
Run celery locally as a single worker
2024-04-23 23:15:35 +02:00
Michael Matloka
3ffa9acd75
fix(insights): HogQL calculation of saved legacy insights v3 (#21720)
* Revert "revert(insights): HogQL calculation of saved legacy insights v2 (#21718)"

This reverts commit 2f019a39ec.

* Fix `CACHE_ONLY` in place of `CALCULATION_ONLY_IF_STALE`

* Make `ExecutionMode` naming unmistakable

* Reset UI snapshots

* Account for #21707's `apply_dashboard_filters` change

* Make `QueryRunner` generic
2024-04-23 16:50:56 +02:00
Michael Matloka
233d3a9098
chore(deps): Remove unused Python requirements (#21580)
* chore(deps): Remove unused Python requirements

* Also remove `dnspython`

* Recompile txts

* Revert "Also remove `dnspython`"

This reverts commit 7eaf89979b774808cc0920c34a3a1cf1d75d2f14.

* Re-recompile txts

* Remove more deps based on `deptry`

* Restore `phonenumberslite`

* Restore `geoip2`

* Restore `python3-saml`

* Move `prance` and `openapi-spec-validator` to dev reqs

* Reorder `geoip2`

* Force HTTP 1.1 in downloading MMDB

Should fix CI failures caused by `curl: (92) HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2)` (e.g. https://github.com/PostHog/posthog/actions/runs/8741861825/job/23988870688?pr=21580).
2024-04-22 22:52:47 +02:00
Michael Matloka
2f019a39ec
revert(insights): HogQL calculation of saved legacy insights v2 (#21718)
Revert "fix(insights): HogQL calculation of saved legacy insights v2 (#21595)"

This reverts commit 3e2d28f233.
2024-04-22 11:53:04 +02:00
Ben White
a8bcc672a8
feat: Swap ingestion endpoints to new .i.posthog.com ones (#20736) 2024-04-22 11:03:14 +02:00
Michael Matloka
3e2d28f233
fix(insights): HogQL calculation of saved legacy insights v2 (#21595)
* fix(insights): HogQL calculation of saved legacy insights v2

This reverts commit a6314c6bb7.

* Only use cached results in `process_query` for insight serializer

* Fix type of results

* Rename `RecalculationMode` to `ExecutionMode`

* Fix typing more

* Properly support dashboard filters

* Hacky fix for schema.py

* Don't test legacy `generate_insight_cache_key` with `query`

* Fix importing & typing

* Fix typo

* Update test_query_runner.py

* Account for property filter groups in dashboard filters

* Do return stale result in CACHE_ONLY case

* Fix `execute_hogql_query` espionage

Wow, this was a pain to figure out, only was an issue in CI, because the trigger was `TestCohort::test_creating_update_and_calculating_with_new_cohort_query` running prior to `TestInsight:: test_insight_refreshing_query` – had to use trial and error.

* Fix typing even more

* Don't require `pnpm` for `schema:build:python`

Matters in CI.

* Fix `schema:build:python`

* Fix sed usage

* Move `schema:build:python` to a bash script

* Validate cache properly

Clarifies the `cached_response.is_cached = True` situation.

* Fix Python formatting

* Update UI snapshots for `webkit` (2)

* Add test to ensure /query/ and /inisghts/ use the same cache

* Update mypy-baseline.txt

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-04-22 10:30:18 +02:00
Frank Hamand
3f9fd8aec7
feat: allow asgi/wsgi to be configurable by env var (#21635)
allow asgi/wsgi to be configurable by env var

This will let us roll out asgi separate across services as we had
issues with our recordings capture pods on asgi
2024-04-18 10:13:06 +01:00
David Newell
33d13aff4d
chore: remove ingestion experiment (#21583) 2024-04-17 15:12:59 +01:00
Marius Andra
99de66f434
feat(hogql): in cohort joins with version as well (#21552) 2024-04-16 17:51:23 +02:00
Julian Bez
84a098ce64
feat(celery): Add prefetch multiplier to flags (#21399)
Since the env var doesn't make it to the subprocess
2024-04-08 12:22:06 +00:00
Paul D'Ambra
c4cbad4642
chore: make exception autocapture available to CDN (#21225) 2024-04-08 11:33:24 +01:00
James Greenhill
4d75323ac3
chore: tune up the hobby deploy testing (#21142)
* chore: tune up the hobby deploy testing

* quick fix

* put everything in the class

* include release tag in name

* split this out into stages for GA

* test throwing ci off

* fix

* test destroy

* check env

* exit if things don't work out

* debug

* somewhat important to create the dns record here hah

* record name as well

* maybe?

* update user_data

* set dns ttl to 30 sec

* silly dns mistake

* correct DNS error
2024-03-26 09:54:22 -07:00
Frank Hamand
7148e2c884
feat: Allow setting --max-tasks-per-child on celery worker (#21163)
Allow setting --max-tasks-per-child on celery worker

This is so we can try to stop worker memory usage growing over time
2024-03-26 16:34:20 +00:00
PostHog Bot
3d73992761
chore(deps): Update posthog-js to 1.112.1 (#20782) 2024-03-11 07:48:55 -04:00
Ben White
bcbe300c22
feat: Replay ingestion with EFS (#20487) 2024-02-26 09:43:27 +01:00
David Newell
4f6d9c8673
feat: generate recording text embeddings (#20046)
* make migration

* general flow

* abstract shared methods

* generate input

* remove postgres migration

* generate embedding strings

* remove random file

* Update query snapshots

* Update query snapshots

* feat: create periodic replay embedding

* first sketch of table

* batch and flush embeddings

* add default to timestamp generation

* fetch recordings query

* save first embeddings to CH

* dump session metadata into tokens

* fix lint

* brain dump to help th future traveller

* prom timing instead

* fix input concatenation

* add an e :/

* obey mypy

* some time limits to reduce what we query

* a little fiddling to get it to run locally

* paging and counting

* Update query snapshots

* Update query snapshots

* move the AI stuff to EE for now

* Update query snapshots

* kick off the task with interval from settings

* push embedding generation onto its own queue

* on a different queue

* EE to the max

* doh

* fix

* fangling

* Remove clashes so we can merge this into the other PR

* Remove clashes so we can merge this into the other PR

* start wiring up Celery task

* hmmm

* it's a chord

* wire up celery simple version

* rename

* why is worker failing

* Update .run/Celery.run.xml

* update embedding input to remove duplicates

* ttl on the table

* Revert "update embedding input to remove duplicates"

This reverts commit 9a09d9c9f0.

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Paul D'Ambra <paul@posthog.com>
2024-02-14 12:50:42 +00:00
Raquel Smith
51db8afbf1
feat: add separate celery queue for usage reports (#20048) 2024-01-31 10:42:40 +00:00
Julian Bez
6f0233608e
fix: Fix starting local celery worker queues (#19837) 2024-01-18 17:25:43 +00:00
Ben White
7f174faf40
feat: Celery tasks refactor (#19827) 2024-01-18 14:28:10 +01:00
James Greenhill
6b50aff12b
chore: enable gossip for flower and to squelch errors (#19823) 2024-01-18 08:01:02 +00:00