mirrors/posthog
0
0
Fork 0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-24 18:07:17 +01:00
Code Issues Releases Activity
44bfcffca4
posthog/ee/idl/element.avro

54 lines
821 B
Plaintext
Raw Normal View History

Publish events to Kafka for consumption (#1644) * Publish events to Kafka for consumption * Commit avro idl's for event schemas * convert client to use github.com/dpkp/kafka-python * events loaded into clickhouse from Kafka * remove cruft * Publish events to Kafka for consumption * convert client to use github.com/dpkp/kafka-python * remove cruft * include kafka migrations * bugfixes for migrations * use constants for consistency * wrap up local migrations * small fixes * tune ups
2020-09-16 05:04:38 +02:00
{
"namespace": "com.posthog.ee",
"name": "element",
"type": "record",
"fields" : [
{
"name" : "text",
"type" : "string"
},
{
"name" : "tag_name",
"type" : "string"
},
{
"name" : "href",
"type" : "string"
},
{
"name" : "attr_id",
"type" : "string"
},
{
"name" : "attr_class",
"type" : "string"
},
{
"name" : "nth_child",
"type" : "string"
},
{
"name" : "nth_of_type",
"type" : "string"
},
{
"name" : "attributes",
"type" : "map",
"values" : "string"
},
{
"name" : "order",
"type" : "long"
},
{
"name" : "team_id",
"type" : "long"
},
{
Clickhouse Elements Dedup (based on master) (#1698) * Use ReplacingMergeTree for elements, remove element_groups and use elements_hash as a virtual "pk" * remove unused ELEMENT_GROUP_TABLE_SQL * merge fixes * use redis cache to avoid writing duplicate elements to clickhouse * move fakeredis to requirements.txt * add team_id to cache key * remove elements_group kafka table references * add elements_hash to clickhouse element serializer * fix cache key * rename few keys * add test runner to ease pycharm dev * fix a some mypy errors * remove typo Co-authored-by: Eric <eeoneric@gmail.com>
2020-09-24 12:47:28 +02:00
"name" : "elements_hash",
"type" : "string"
Publish events to Kafka for consumption (#1644) * Publish events to Kafka for consumption * Commit avro idl's for event schemas * convert client to use github.com/dpkp/kafka-python * events loaded into clickhouse from Kafka * remove cruft * Publish events to Kafka for consumption * convert client to use github.com/dpkp/kafka-python * remove cruft * include kafka migrations * bugfixes for migrations * use constants for consistency * wrap up local migrations * small fixes * tune ups
2020-09-16 05:04:38 +02:00
}
]
}
Copy Permalink