ted kaemming
0944412f48
feat: Support marking materialized columns as disabled and dropping them ( #26068 )
2024-11-13 10:57:27 -08:00
Michael Matloka
8a356a596a
chore(environments): Backfill project ID on group types ( #25980 )
2024-11-06 09:31:32 +01:00
Paul D'Ambra
8b4387c561
fix: hogql tests should run through the query cleaning code to avoid flaps ( #25900 )
...
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-10-31 11:27:08 +00:00
Georgiy Tarasov
cf97a84328
fix(insights): legacy funnels didn't work with personless events ( #25147 )
...
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-09-24 13:12:55 +00:00
Michael Matloka
26f0438221
chore(insights): Yeet groups-on-events from tests + optimizer ( #23320 )
...
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-07-11 20:36:37 +02:00
Michael Matloka
077b2759fd
chore(insights): Yeet the unbaked groups-on-events ( #22764 )
...
* chore(insights): Yeet the unbaked groups-on-events
* Update TestAutoProjectMiddleware
* Update verifiedDomainsLogic.test.ts.snap
* Update funnel_correlation.py
* Update test_property.py
* Update query snapshots
* Update UI snapshots for `chromium` (2)
* Update query snapshots
* Update UI snapshots for `chromium` (2)
* Update query snapshots
* Update query snapshots
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-24 16:38:42 +02:00
Michael Matloka
255229bd5b
fix(experiments): Prevent HogQL-only PoE modes breaking legacy insights ( #22886 )
...
* fix(experiments): Prevent HogQL-only PoE modes breaking legacy insights
* Actually leave `PERSON_ID_OVERRIDE_PROPERTIES_ON_EVENTS` alone
2024-06-11 23:08:08 +02:00
Thomas Obermüller
8ab8741e63
chore(refactor): pythonic schema ( #22573 )
2024-06-10 15:19:20 +02:00
timgl
1ec3b5fd41
feat: Always use person_distinct_id_override ( #22347 )
2024-06-05 12:51:54 -07:00
Ben White
cc9cb45d58
feat: Action steps refactor (attempt 2) ( #22137 )
2024-05-07 15:25:19 +02:00
Ben White
0fc2c9eccd
revert: "feat: Action steps refactor (part1) ( #22091 )" ( #22136 )
2024-05-07 12:32:41 +02:00
Ben White
776298d2a8
feat: Action steps refactor (part1) ( #22091 )
2024-05-07 12:08:13 +02:00
Julian Bez
9576fab1e4
chore: Add Pyupgrade rules ( #21714 )
...
* Add Pyupgrade rules
* Set correct Python version
2024-04-25 08:22:28 +01:00
Julian Bez
a0fc086175
chore(deps): Upgrade ruff ( #21648 )
2024-04-19 14:19:10 +02:00
Michael Matloka
b7add1d252
refactor(querying): Consolidate PersonOnEventsMode and PersonsOnEventsMode ( #21628 )
...
* Consolidate `PersonOnEventsMode` and `PersonsOnEventsMode`
* Fix multi-line imports too
* Fix member casing
* Fix typing
* Fix some more and update baseline
* Fix `PersonsOnEventsMode` member capitalization
2024-04-19 10:06:55 +02:00
timgl
6cf85db922
fix: Three clear options for persons on events ( #21455 )
...
* Revert "feat(hogql): Add feature flag for opting queries into v3 persons-on-events (#21150 )"
This reverts commit 205376b86e
2024-04-11 18:58:35 +01:00
Julian Bez
487ca39064
chore: Enable more ruff rules ( #21043 )
2024-04-08 16:21:51 +01:00
Michael Matloka
b93904e1cd
perf(funnels): Deep filtering of person distinct ID join ( #20050 )
...
* perf(funnels): Filter person distinct ID join
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-01-31 11:09:03 +01:00
Marius Andra
26ddcccafb
fix(funnels): actors modal longer query limit ( #19697 )
2024-01-11 12:08:54 +01:00
Julian Bez
7cabe21ae3
chore: Upgrade pydantic, mypy, and others ( #19660 )
...
* Upgrade pydantic and all related
* Upgrade mypy
* Add mypy-baseline
To update baseline when you fix something (only then!) use:
[mypy cmd] | mypy-baseline sync
2024-01-10 08:32:55 +00:00
Marius Andra
2944c06e53
fix(trends): fix "other" misalignment ( #19484 )
2023-12-22 09:36:18 +01:00
Marius Andra
3037124cdf
feat(insights): hide "other" breakdown ( #19359 )
2023-12-19 10:42:42 +01:00
Ellie Huxtable
0257b2bcb9
chore: Use ruff formatter ( #18207 )
...
* Use ruff formatter
Ruff is now also a formatter! And it runs in a fraction of a second
across our whole codebase vs "I waited more than 30s and cancelled it
because I got bored".
* Config and command -> ruff
* Run 'ruff format .'
* Update query snapshots
* Run 'ruff format .'
* Fix format after commit hook
* Update query snapshots
* Fix type error - ignore comment moved
* Exclude hogql grammar from formatting and reverted grammar
* Run format
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Tom Owers <tom@paace.co>
2023-10-31 13:41:57 +00:00
Michael Matloka
f7fd53680f
feat(query-engine): Add sessions timeline query ( #18131 )
...
* Remove unused `test_journeys.py`
* Add basic sessions timeline query node
* Snapshot sessions timeline test CH queries
* Support filtering by person UUID
* Support informal sessions
* Also fetch event elements
* Fix column names being swallowed in HogQL on timezone conversion
* Include recordings in the sessions timeline
* Move the schema additions to TypeScript
* Tune timeline query
* Simplify `journeys_for` API
* Re-engineer the query to support all cases
* Revert alias preservation change
* Fix existing tests without `event_uuid` specified
* Fix some tests using `journeys_for` failing
* Make `before` and `after` optional
* Fix more tests
* Don't suggest raw HogQL functions in close matches
* Add `to_persons_query`
2023-10-26 13:16:23 +00:00
Tom Owers
5513be7731
chore: upgraded Ruff linter ( #18188 )
...
* Upgraded Ruff linter
* Formatted whole codebase with new ruff rules
* Revert import removal
* Fixed mypi issues or added ignores
* Fixed schema formatting
* Fixed hogvm failing tests
* Remove duplicate key in list
2023-10-26 12:38:15 +02:00
Paul D'Ambra
31c1cdf301
chore: yeet CH recordings ingestion ( #17572 )
...
Removing ClickHouse based recordings
One big yeet for a man, a great yeet for humanity
2023-10-11 14:23:41 +01:00
timgl
476d102411
perf(Persons): Use optimize_aggregation_in_order for person queries ( #17817 )
...
* perf(Persons): Use optimize_aggregation_in_order for person queries
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-05 18:47:06 +01:00
Michael Matloka
77f3847efd
refactor(insights): Unify relative date parsing ( #16965 )
...
* Remove unused utils
* Unify relative date parsing
* Fix some missing timezone info
* Fix more issues
* Fix moar
* Remove redundant `strptime()`
* Add `test_hour_interval` snapshot
* Update formula `test_hour_interval`
* Fix timezone conversion
* Restore support for dates without zero padding
* Clarify `QueryDateRange`
* Snapshot `test_trends_compare_day_interval_relative_range`
* Fix `_end_time`/`_start_time` leftovers
* Remove stale TODO
* Fix remaining issues
* Limit truncation behavior
* Update query snapshots
* Remove truncation from events query
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-08-23 10:35:23 +02:00
Paul D'Ambra
a849819b81
feat: constrain recording date range when querying for actors recordings ( #16883 )
...
* feat: constrain recording date range when querying for actors recordings
* feat: constrain actor recordings query by date filters
* Update query snapshots
* Update query snapshots
* Update query snapshots
* does this avoid all the test changes?
* only limit by date_from and date_to
* but not wrong
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* fix
* Fix
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* fix
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-08-10 10:14:41 +01:00
Paul D'Ambra
5804600b54
feat: remove more recording events queries ( #16878 )
2023-08-03 10:01:44 +02:00
Thomas Obermüller
51ae61d4e0
fix(funnels): fix step funnel & correlation persons cache invalidation ( #16802 )
...
* add cache_invalidation_key to converted_people_url and dropped_people_url
* add cache_invalidation_key to success_people_url and failure_people_url
2023-07-28 10:22:40 +02:00
Marius Andra
8069762e45
feat(billing): track HogQLQuery and EventsQuery usage ( #15512 )
2023-06-01 09:19:41 +02:00
Michael Matloka
6daabb7b36
perf(persons): Prefilter person property conditions for reduced memory usage ( #15507 )
...
* perf: Prefilter rows in person search for reduced memory usage
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Better document `aggregate_by_person_version`
* Snapshot queries in more tests
* Use `DIRECT_ON_PERSONS` instead of new arg
* Explain `PersonPropertiesMode` options
* Streamline the various clauses
* Fix formatting
* Add comments and restore join optimization
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Fix comment typo
* Clarify persons-on-events v2
* Reduce parens
* Disambiguate prepends
* Update query snapshots
* Fix unmatched parens
* Update query snapshots
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-05-15 17:54:51 +02:00
Yakko Majuri
a61087aa1b
fix(poe-v2): fix funnels with cohort breakdowns ( #15457 )
...
* fix(poe-v2): fix funnels with cohort breakdowns
* fix properly
* snapshots
* Update query snapshots
* Update query snapshots
* add also_test_with_person_on_events_v2 decorator to relevant tests
* Update query snapshots
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-05-10 10:45:38 -03:00
Yakko Majuri
aa1fc7d4d5
fix(groups): do a left join for group props ( #15423 )
...
* fix(groups): do a left join for group props
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* lol
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-05-08 14:27:26 -03:00
Marius Andra
105d7e8b10
feat(insights): support 'any event' filter ( #15209 )
2023-05-08 17:25:14 +02:00
Neil Kakkar
06c5db6dcb
feat: calculate count of static cohort ( #15370 )
...
Co-authored-by: psykomal <bkomalsai@gmail.com>
2023-05-04 12:15:23 +00:00
Yakko Majuri
016192c8bd
fix(person-query): don't query persons twice if we don't need to ( #15265 )
...
* fix(person-query): don't query persons twice if we don't need to
* Update query snapshots
* black
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-26 16:18:54 -03:00
Yakko Majuri
ff8d08bfd6
fix(poe-v2): proper handling for poe v2 vs v1 where missing ( #15212 )
...
* fix(poe-v2): proper handling for poe v2 vs v1 where missing
* fix
* another fix
* black
* fix
2023-04-25 08:54:23 -03:00
dependabot[bot]
c24c2dfb07
chore(deps): bump sqlparse from 0.4.2 to 0.4.4 ( #15192 )
...
* chore(deps): bump sqlparse from 0.4.2 to 0.4.4
Bumps [sqlparse](https://github.com/andialbrecht/sqlparse ) from 0.4.2 to 0.4.4.
- [Release notes](https://github.com/andialbrecht/sqlparse/releases )
- [Changelog](https://github.com/andialbrecht/sqlparse/blob/master/CHANGELOG )
- [Commits](https://github.com/andialbrecht/sqlparse/compare/0.4.2...0.4.4 )
---
updated-dependencies:
- dependency-name: sqlparse
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update CI to work on forks
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Michael Matloka <dev@twixes.com>
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-24 13:32:51 +02:00
Yakko Majuri
5d9e2a08e0
feat(poe-v2): support poe v2 on trends ( #14852 )
...
* wip trends, lifecycle, breakdowns poev2
* fix test
* more testing
* remove unnecessary check for a fix
* Update query snapshots
* Update query snapshots
* Update query snapshots
* fix test
* Update query snapshots
* fix things?
* bring back old code because poe is handled by aliases
* another fix
* fix breakdowns as well
* final test fixes
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* Update query snapshots
* stop the infinite snapshot updates
* Update query snapshots
* Update query snapshots
* Update query snapshots
* fix retention and paths person join
* Update query snapshots
* fix snapshots
* Revert "fix retention and paths person join"
This reverts commit 361d11c684
2023-04-13 19:18:09 -05:00
Yakko Majuri
06d90c35f0
refactor(poe): using_person_on_events -> person_on_events_mode ( #14792 )
...
* initial team attr, PersonPropertiesMode refactor
* using_person_on_events -> person_on_events_mode
* fix person_properties_mode signatures, format
* add comment to team
* missing refs
* fix enum
* Update ee/clickhouse/queries/funnels/funnel_correlation.py
* Update ee/clickhouse/queries/funnels/funnel_correlation.py
* fix
* fix
* more fixes
* fix circular import
* add settings
* Update query snapshots
* Update query snapshots
* to enum or not to enum
* Update query snapshots
* Update query snapshots
* Update posthog/queries/trends/trends_event_query_base.py
* Update posthog/test/test_team.py
* Update posthog/queries/foss_cohort_query.py
* Update posthog/queries/foss_cohort_query.py
* Update posthog/queries/foss_cohort_query.py
* Update query snapshots
* Update query snapshots
* more and more fixes
* black
* code quality
* Update query snapshots
* Update query snapshots
* Update posthog/queries/session_recordings/session_recording_list.py
Co-authored-by: Tiina Turban <tiina303@gmail.com>
* Update posthog/queries/paths/paths_event_query.py
Co-authored-by: Tiina Turban <tiina303@gmail.com>
* fixes
* argh
* Update query snapshots
* fix test
* fix hogql
* Update posthog/queries/stickiness/stickiness_event_query.py
* fix breakdown
* Update query snapshots
* Update query snapshots
* Update query snapshots
* fix another test
* update base num queries due to extra instance config lookup for poe v2
* black
* sort
* assert num queries test
* Revert "assert num queries test"
This reverts commit c48c7fccf7644e9b2658
2023-03-20 12:03:36 -03:00
Yakko Majuri
d41e990f65
feat(sampling): add sampling for all breakdowns ( #14462 )
...
* feat(sampling): make sampling toggle a slider instead
* Update UI snapshots for `chromium` (1)
* feat(sampling): add initial unrestricted sampling to trends total volume
* Update posthog/queries/util.py
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (1)
* fix typing
* Update query snapshots
* Update query snapshots
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* feat(sampling): add sampling for all breakdowns
* fix
* Update query snapshots
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* fixes
* Update query snapshots
* Update frontend/src/scenes/insights/EditorFilters/SamplingFilter.tsx
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (1)
* type fixes
* typing
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-03-07 08:50:20 -03:00
Yakko Majuri
95670dc70b
fix(sampling): ensure funnel correlation results get corrected for sampling ( #14382 )
...
* fix(sampling): ensure funnel correlation results get corrected for sampling
* adapt signature to round return
* update
2023-02-24 09:18:58 -03:00
Michael Matloka
a0ff5e74c8
fix(trends): Properly handle timezones in date_from and date_to ( #14102 )
...
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-02-09 11:46:36 +01:00
Yakko Majuri
dee60b5e1a
feat(funnels-correlation): simplify method for extracting property keys + values ( #14031 )
...
* feat(funnels-correlation): use JSONExtractKeys instead of JSONExtractKeysAndValuesRaw + arrayMap
* Update snapshots
* switch approaches
* add missing arrayJoin
* Update snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-01-31 16:03:56 -03:00
Marius Andra
7ea19953e9
fix(naming-things): replace with_data with shallow_clone ( #13918 )
...
* fix(naming-things): replace with_data with shallow_clone
* more
* update comment
2023-01-31 15:25:09 +01:00
Marius Andra
5b4a3bffb4
feat(data-exploration): HogQL filters again ( #13830 )
2023-01-31 14:57:10 +01:00
Yakko Majuri
531c367b4c
feat(funnels): speed up funnel queries by preventing properties being passed across shards ( #13935 )
...
* feat(funnels): speed up funnel queries by preventing properties being passed across shards
* Update snapshots
* Update snapshots
* testing
* Update snapshots
* Update snapshots
* new approach
* Update snapshots
* Update snapshots
* Update snapshots
* remove more unnecessary fields
* update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* remove more cols and see :)
* remove event_columns_to_query
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* update query building
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
* Update snapshots
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-01-30 08:22:00 -03:00
Yakko Majuri
8077ef3e5c
refactor(persons-on-events): use notEmpty instead of toUUIDOrZero ( #13607 )
...
* refactor(persons-on-events): use notEmpty instead of toUUIDOrZero
* Update snapshots
* Update snapshots
* Update snapshots
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-01-10 09:25:26 -03:00
