302 commits

Author	SHA1	Message	Date
Bartosz Sypytkowski	eb54947ab7	chore: add config option for redis stream group workers count	2024-11-08 04:39:44 +01:00
Bartosz Sypytkowski	b9ca480143	chore: add retry limit to which collab snapshot can be made	2024-11-07 13:12:17 +01:00
Bartosz Sypytkowski	bc49d73b40	chore: split redis stream readers to active and one shot	2024-11-07 11:43:19 +01:00
Bartosz Sypytkowski	2d9a024554	chore: use redis stream router	2024-11-07 07:18:20 +01:00
Bartosz Sypytkowski	f3cd597832	chore: fix clippy errors	2024-11-06 10:57:32 +01:00
Bartosz Sypytkowski	3fc49a8b21	chore: turn off collab preindexing	2024-11-06 10:10:55 +01:00
Bartosz Sypytkowski	863e405263	chore: add more precise logging on get unindexed collabs	2024-11-06 08:04:07 +01:00
Bartosz Sypytkowski	99203cc7f3	chore: fix flaky tests	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	25f0461389	chore: added metrics for new stateless operations	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	e86c9de316	chore: when saving collab snapshot, do not load it unless there are pending updates in redis	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	961c482995	chore: prevent hot loops in collab updates stream	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	2511bd720d	chore: fix clippy errors	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	ce793fa03e	chore: make collab group prune grace period configurable	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	395424bfd2	chore: detect and re-request missing updates on the server side	2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski	a99f986270	chore: removed appflowy history	2024-11-05 07:48:12 +01:00
Bartosz Sypytkowski	81dc66fa7b	chore: fix clippy warnings	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	f684d3623d	chore: fixed collab ack	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	fc1a7d28e2	chore: better stress test scenario	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	de4016659e	chore: add break in cancellation of snapshot task	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	d624cdf49b	chore: turn off separate appflowy history process	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	a2d3d7feb5	chore: add perf tests	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	279a599b66	chore: fix early return from redis collab update stream reader	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	85e25f887c	chore: don't try to prune empty redis stream	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	d0b7c7d8e3	chore: update stream - live and current queries	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	61820d7226	chore: more traces in collab group	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	a1546909c3	chore: remove server sync protocol (not used anymore)	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	00f5a5bb7e	chore: code cleanup	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	3e612e2db6	chore: create method for receiving the most recent snapshot	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	9c674d5777	chore: changes to make appflowy cloud compile under the latest appflowy collab	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	bee7caedac	chore: attach indexer to collab persister	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	97335a94ec	chore: basics of snapshots (unoptimized)	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	253bb97825	chore: a dirty draft of snapshot saving	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	9164c494b1	chore: redis stream for awareness	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	d26d0ff1a7	chore: collab streams	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	0d6b595ee8	chore: create collab update sink and stream	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	fe3611cc88	chore: remove broadcast and introduce lease	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	d3d3378b86	chore: draft of stateless collab group	2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski	6aed9609b9	chore: removed realtime shared state tests	2024-11-04 09:21:10 +01:00
Bartosz Sypytkowski	356cf5d132	chore: fix clippy errors	2024-11-04 08:29:32 +01:00
Bartosz Sypytkowski	f105c2dbc2	chore: fix clippy errors	2024-11-04 08:20:56 +01:00
Bartosz Sypytkowski	f9397eaaf2	chore: remove realtime shared state	2024-11-04 07:58:16 +01:00
Nathan.fooo	a5a5a6b59f	fix: import notion file base cases (#957)	2024-11-02 16:50:51 +08:00
Nathan.fooo	9629d4cefa	chore: add limit for importing zip file (#938) ... * chore: add limitation for import zip file * chore: support upload big file * chore: implement client api * chore: implement client api * chore: implement client api * chore: update logs * chore: check file size * chore: last process at * chore: set content type * chore: fix test * chore: try test * chore: temporary disable test	2024-10-28 08:51:34 +08:00
Nathan.fooo	246cbd3ec4	chore: update nginx config for import (#935)	2024-10-25 16:47:29 +08:00
Nathan.fooo	e738508d79	fix: Support notion database row document (#929) ... * chore: fix import notion database	2024-10-24 19:04:06 +08:00
khorshuheng	16fb9584f9	fix: masked postgres password in logs	2024-10-24 00:34:31 +08:00
Khor Shu Heng	9eb1c36c92	chore: access control interface to return error instead of boolean (#914)	2024-10-21 20:20:14 +08:00
Nathan.fooo	57c44818e2	feat: Import metrics (#911) ... * chore: implement metrics for import * chore: add metrics	2024-10-20 11:05:22 +08:00
Nathan.fooo	b1f37dbbf6	chore: fix petential unzip issues (#910)	2024-10-20 10:48:09 +08:00
Nathan.fooo	773f17e524	fix: import zip without root dir (#898) ... * fix: import notion zip file that do not have root dir * fix: compile	2024-10-18 00:51:53 +08:00