0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-12-01 12:21:02 +01:00
posthog/bin
David Newell 4f6d9c8673
feat: generate recording text embeddings (#20046)
* make migration

* general flow

* abstract shared methods

* generate input

* remove postgres migration

* generate embedding strings

* remove random file

* Update query snapshots

* Update query snapshots

* feat: create periodic replay embedding

* first sketch of table

* batch and flush embeddings

* add default to timestamp generation

* fetch recordings query

* save first embeddings to CH

* dump session metadata into tokens

* fix lint

* brain dump to help th future traveller

* prom timing instead

* fix input concatenation

* add an e :/

* obey mypy

* some time limits to reduce what we query

* a little fiddling to get it to run locally

* paging and counting

* Update query snapshots

* Update query snapshots

* move the AI stuff to EE for now

* Update query snapshots

* kick off the task with interval from settings

* push embedding generation onto its own queue

* on a different queue

* EE to the max

* doh

* fix

* fangling

* Remove clashes so we can merge this into the other PR

* Remove clashes so we can merge this into the other PR

* start wiring up Celery task

* hmmm

* it's a chord

* wire up celery simple version

* rename

* why is worker failing

* Update .run/Celery.run.xml

* update embedding input to remove duplicates

* ttl on the table

* Revert "update embedding input to remove duplicates"

This reverts commit 9a09d9c9f0.

---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Paul D'Ambra <paul@posthog.com>
2024-02-14 12:50:42 +00:00
..
build-schema.mjs refactor(product-analytics): lineGraphLogic.ts to tooltip-data.ts (#19815) 2024-01-17 20:28:10 +00:00
celery-queues.env feat: generate recording text embeddings (#20046) 2024-02-14 12:50:42 +00:00
check_kafka_clickhouse_up
check_temporal_up
copy-posthog-js feat(surveys): Add UI for enabling/disabling surveys popup (#17602) 2023-09-26 13:35:54 +01:00
deploy-hobby chore: hobby deployment on PR (#18733) 2023-11-29 18:16:15 -05:00
docker
docker-backend
docker-dev
docker-dev-web
docker-frontend
docker-migrate
docker-server feat: Set keepalive to 60 on gunicorn (#17897) 2023-10-11 08:54:48 +01:00
docker-server-unit feat: Use single entrypoint for both images but detect which to run (#18883) 2023-11-27 10:06:22 +00:00
docker-worker
docker-worker-beat
docker-worker-celery fix: Fix starting local celery worker queues (#19837) 2024-01-18 17:25:43 +00:00
e2e-test-runner
hobby-ci.py
install-macosx_arm64 chore: Update install script (#17851) 2023-10-11 13:41:01 +02:00
migrate
migrate_kafka_data.py
migrate-check feat: Add env var to skip migration checks (#17915) 2023-10-11 15:51:43 +01:00
plugin-server
start
start-backend
start-frontend chore(frontend): Real Tailwind + Autoprefixer (#19051) 2024-01-08 13:26:12 +01:00
start-frontend-https
start-https
start-worker fix: Fix starting local celery worker queues (#19837) 2024-01-18 17:25:43 +00:00
temporal-django-worker chore(batch-exports): add some Prometheus metrics for batch exports (#18467) 2023-11-09 09:22:25 -07:00
tests chore: Upgrade pydantic, mypy, and others (#19660) 2024-01-10 08:32:55 +00:00
unit_metrics.py fix: basic retry logic for booting up the application and waiting for unit (#19259) 2023-12-11 14:46:14 -05:00
upgrade-hobby