ted kaemming
85ef237459
feat(plugin-server): Support preserving distinct ID locality on overflow rerouting ( #20945 )
...
Turned off by default for backwards compatibility for now.
2024-04-02 10:56:29 -05:00
Ben White
0c0a82d6d7
fix: Add project path to action webhook urls ( #21211 )
2024-04-02 14:38:18 +02:00
Xavier Vello
db30cd2e33
feat(blobby): add new recordings-blob-ingestion-overflow role ( #21161 )
2024-04-02 13:20:35 +02:00
Paul D'Ambra
703a4ece7c
chore: more debug logging ( #21231 )
2024-03-28 21:33:50 +00:00
Paul D'Ambra
3b6798963e
fix: versions are not numbers, when will I ever learn ( #21228 )
...
* fix: parsing versions but not stupid
* update tests
* unknown for safety
2024-03-28 20:18:39 +00:00
Paul D'Ambra
02c596c569
feat: ingestion warning on old version ( #21025 )
...
* feat: ingestion warning on old version
* and some tests
* deprecate old body parsing method for reading the token
* add a counter too so we can see this in grafana dashboard
* typo
* fix v3 consumer to ignore ingestion warning
* fix
* fix
* fix
* add comment
* disconnect producer
* inject main cluster produer as a dependency from the recording consumer into its children
* inject main cluster produer as a dependency from the recording consumer into its children
* void the promises that eslint or prettier keeps clearing the comment from
* does that fix the test
* not safe to call stop twice
* not safe to call stop twice
* remove start and stop
* fix
* the shortest route from a to b
* fix
2024-03-28 18:24:19 +00:00
Paul D'Ambra
ead1438f7b
feat: pass producer into blob ingestion services ( #21205 )
2024-03-28 13:05:53 +00:00
Paul D'Ambra
ddeedc7d60
feat: remove unused code path ( #21200 )
...
* feat: remove unused code path
* fix
2024-03-28 11:44:59 +00:00
Xavier Vello
4edcf1bff8
feat(blobby): overflow detection updates the redis set with keys that trigger ( #21154 )
2024-03-27 14:47:06 +01:00
Marius Andra
9e837b8f68
revert(data-warehouse): add linked properties to person filters ( #21155 )
2024-03-26 15:21:16 +01:00
Paul D'Ambra
822cebc5a8
feat: don't clone replay event data ( #21074 )
...
* feat: clone once not every
* leeory j
* make the tests pass
2024-03-26 11:30:45 +00:00
Brett Hoerner
30bafdd382
chore(plugin-server): kafka ack cleanup and metric ( #21111 )
...
* cleanup: remove unused team arg from registerLastStep
* cleanup: rename promises to ackPromises to make it more clear thats what they are
* cleanup(plugin-server): make waitForAck explicit/required
* add Kafka produce/ack metrics
* Clarify Kafka produce metric/labels
2024-03-25 13:01:15 +00:00
Xavier Vello
17c5876ef8
chore(blobby): raise overflow trigger again ( #21104 )
2024-03-22 15:05:54 +01:00
Xavier Vello
ed01ee3621
chore(blobby): raise overflow threshold ( #21079 )
2024-03-21 17:50:07 +01:00
Xavier Vello
6741039ec1
feat(blobby): run overflow detection and report result as a gauge ( #21046 )
2024-03-21 11:12:29 +01:00
Paul D'Ambra
906737b4ee
feat: blobby ingestion warnings ( #20963 )
...
* don't hand your trousers to the shop assistant
* write ingestion warning when timestamp is very invalidd
* reduce amount of skew before we warn and add display code for ingestion warnings
* one week of skew
* is it this triggering linter
* Update UI snapshots for `chromium` (1)
* this is fine
* this is fine
* typo
* fix typo
Co-authored-by: Manoel Aranda Neto <5731772+marandaneto@users.noreply.github.com >
* move limiting into capture ingestion warning
* fix tests
* shared debounce key for person state
* Revert "shared debounce key for person state"
This reverts commit c0d30028edbc53e61d2b16737e5621d2b5360942.
* allow overriding debouncing of capture ingestion warning
* positive not negative
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Manoel Aranda Neto <5731772+marandaneto@users.noreply.github.com >
2024-03-19 16:27:33 +00:00
Michael Matloka
f02d045bf9
chore(environments): Add migration to backfill projects ( #20887 )
...
* chore(environments): Add migration to backfill projects
* Fix `noop`
* Add `project_id` to plugin server test setup
* Fix `project_id`
* Also add `posthog_project` to plugin server tests
* Update `createTeam`
* Fix func tests
2024-03-14 13:45:28 +01:00
Paul D'Ambra
3b7288f7c7
fix: replay ingestion was ignoring pageview urls ( #20883 )
2024-03-13 11:42:57 +00:00
Michael Matloka
da0507d5f1
chore(deps): rm eslint-plugin-prettier, upgrade @typescript-eslint/parser ( #20814 )
...
* chore(dev): Remove `eslint-{config,plugin}-prettier`
* Upgrade `@typescript-eslint` and restore `eslint-config-prettier`
* Fix promise handling in a few spots
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2024-03-11 16:15:19 +01:00
Eric Duong
b7c5d13cfb
feat(data-warehouse): add linked properties to person filters ( #20720 )
...
* add linked props
* selectors for columns
* populate
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* add icon and metadata
* Update UI snapshots for `chromium` (2)
* types
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* types
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* propogating table_name through frontend filters
* chain using table name if it's populated
* Update UI snapshots for `chromium` (1)
* Update UI snapshots for `chromium` (1)
* rename to table
* rename to table
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* use field name
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* add labeling in case of duplicates
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update cy test
* Update UI snapshots for `webkit` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `webkit` (2)
* Update UI snapshots for `chromium` (2)
* Update query snapshots
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update query snapshots
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* add key
* Update UI snapshots for `chromium` (2)
* whitelisted
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* lint error
* Update UI snapshots for `chromium` (2)
* Update UI snapshots for `chromium` (2)
* set to exact on change
* flip order
* property def loading
* update types
* more types
* Update UI snapshots for `webkit` (2)
* Update UI snapshots for `webkit` (2)
---------
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Tom Owers <owerstom@gmail.com >
2024-03-08 19:42:53 -05:00
Paul D'Ambra
2d8d9feccb
chore: add team id to log message ( #20797 )
...
* chore: add team id to log message
* remove unused variable
2024-03-08 19:16:23 +00:00
Ben White
307b2c43df
chore: Turn off v3 ingestion locally ( #20792 )
2024-03-08 15:53:25 +00:00
Robbie
1a50c27ee8
feat: Add more ad/campaign ids ( #20760 )
...
feat: Add more ad ids
2024-03-07 15:40:33 +00:00
David Newell
6d0c0e6026
fix: log level ( #20739 )
2024-03-07 09:19:52 +00:00
Tiina Turban
7a61690607
fix: Don't swap person join order ( #20659 )
2024-03-04 12:49:27 -06:00
Ben White
57edf362c8
feat: Mr Blobby backported improvements from v3 ( #20653 )
2024-03-01 13:40:25 +01:00
Ben White
54c5668caf
fix: Change histogram bucket sizes ( #20642 )
2024-03-01 12:10:08 +00:00
Ben White
47cf62b7a3
feat: Conditional enabling of replay ingestion ( #20614 )
2024-02-29 17:05:04 +01:00
Tiina Turban
9c0802a541
chore: skip falky autocapture functional test ( #20638 )
...
chore: skip falky autocapture test
We're not really touching that code atm, this test flakes quite a bit, let's skip it.
2024-02-29 14:24:33 +01:00
Xavier Vello
6117206ea2
feat(ingestion): pass PLUGIN_SERVER_MODE as pg app name ( #20613 )
2024-02-29 10:34:28 +01:00
Ben White
7cc9076cc1
feat: Batch parallelise flushes with concurrency limit ( #20599 )
2024-02-28 10:57:56 +01:00
Ben White
418911ebf6
fix: Add back in write stream for v3 ingester ( #20601 )
2024-02-28 09:46:02 +00:00
Ben White
ebd92f0913
feat: Added heartbeat check for processing ( #20596 )
2024-02-28 10:00:24 +01:00
Ben White
12e01a0ede
feat: V3 ingester - perf improvements ( #20587 )
2024-02-27 21:10:39 +01:00
Brett Hoerner
29f423ce19
chore(plugin-server): don't send event pipeline stall warnings to sentry ( #20585 )
2024-02-27 12:18:23 -07:00
Ben White
fbe120f87f
fix: Added handling for v3 ingester metadata.json file being corrupted ( #20583 )
2024-02-27 18:45:19 +01:00
Ben White
f73743091d
feat: Batch replay ingestion writes by session id ( #20577 )
2024-02-27 16:18:44 +00:00
Ben White
d31fb198e7
feat: Track ingester v3 api call times ( #20574 )
2024-02-27 15:21:15 +01:00
Ben White
f276ca3547
feat: Enable parallel batch processing for v3 ingester ( #20573 )
2024-02-27 14:29:27 +01:00
Ben White
09d4b2400f
chore: Refactor webhook runner logic ( #20546 )
2024-02-27 14:15:44 +01:00
Ben White
47b2882412
chore: Debugging options for V3 ingester ( #20569 )
2024-02-27 11:44:08 +00:00
Tom Owers
ed7e5dbb73
feat(webhook): Be able to use event timestamp in action webhooks ( #20558 )
...
Be able to use event timestamp in action webhooks
2024-02-27 11:24:28 +00:00
Ben White
ff22a7e680
fix: Loading from new s3 ingestion buckets ( #20550 )
2024-02-26 16:20:57 +01:00
Ben White
bcbe300c22
feat: Replay ingestion with EFS ( #20487 )
2024-02-26 09:43:27 +01:00
ted kaemming
66933ca632
refactor(plugin-server): Remove a few layers of passthrough functions in event ingestion ( #20540 )
2024-02-23 16:19:10 -08:00
ted kaemming
2897711cb0
feat(plugin-server): Track and log partition offsets and message counts within a batch ( #20541 )
2024-02-23 15:54:01 -08:00
Brett Hoerner
df47a2c9a7
chore(plugin-server): refactor composeWebhook fn to unify metrics ( #20494 )
2024-02-23 07:43:20 -07:00
Tiina Turban
cc9f11f5a9
chore: Add team-id to log context ( #20521 )
2024-02-22 21:38:25 +01:00
Tiina Turban
e099b18469
feat: Make pipeline step stalled log configurable ( #20519 )
2024-02-22 18:53:30 +00:00
Ben White
1b15f27ba8
feat: Swapped to express for plugin server http server ( #20506 )
2024-02-22 17:03:23 +00:00
