0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-12-01 12:21:02 +01:00
posthog/.run
David Newell 4f6d9c8673
feat: generate recording text embeddings (#20046)
* make migration

* general flow

* abstract shared methods

* generate input

* remove postgres migration

* generate embedding strings

* remove random file

* Update query snapshots

* Update query snapshots

* feat: create periodic replay embedding

* first sketch of table

* batch and flush embeddings

* add default to timestamp generation

* fetch recordings query

* save first embeddings to CH

* dump session metadata into tokens

* fix lint

* brain dump to help th future traveller

* prom timing instead

* fix input concatenation

* add an e :/

* obey mypy

* some time limits to reduce what we query

* a little fiddling to get it to run locally

* paging and counting

* Update query snapshots

* Update query snapshots

* move the AI stuff to EE for now

* Update query snapshots

* kick off the task with interval from settings

* push embedding generation onto its own queue

* on a different queue

* EE to the max

* doh

* fix

* fangling

* Remove clashes so we can merge this into the other PR

* Remove clashes so we can merge this into the other PR

* start wiring up Celery task

* hmmm

* it's a chord

* wire up celery simple version

* rename

* why is worker failing

* Update .run/Celery.run.xml

* update embedding input to remove duplicates

* ttl on the table

* Revert "update embedding input to remove duplicates"

This reverts commit 9a09d9c9f0.

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Paul D'Ambra <paul@posthog.com>
2024-02-14 12:50:42 +00:00
..
Celery.run.xml feat: generate recording text embeddings (#20046) 2024-02-14 12:50:42 +00:00
Dev.run.xml chore(pycharm): Include compound run configuration (#18739) 2023-11-20 11:06:30 +01:00
Frontend.run.xml PyCharm run configurations (#6026) 2021-09-20 13:03:37 +01:00
Jest Tests.run.xml Turbo mode (#6632) 2021-10-26 20:08:45 +00:00
Plugin Server.run.xml feat: Replay events consumer (#16642) 2023-07-20 14:41:25 +00:00
PostHog.run.xml feat: add ee licensed replay transformer (#18874) 2023-11-29 10:41:18 +00:00
Storybook.run.xml PyCharm run configurations (#6026) 2021-09-20 13:03:37 +01:00