Commit graph

36 commits

Author SHA1 Message Date
Bartosz Sypytkowski
a5d6cc0a59 chore: passed through first circle of hell 2025-04-01 07:42:13 +02:00
nathan
1a5c1714db Merge branch 'main' into stateless 2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099)
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
2024-12-24 14:30:17 +08:00
Bartosz Sypytkowski
1b35326f0a Merge branch 'main' into stateless 2024-12-16 04:47:26 +01:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Bartosz Sypytkowski
7dc90904cb chore: fix clippy warnings 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
9164c494b1 chore: redis stream for awareness 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
d26d0ff1a7 chore: collab streams 2024-11-05 07:47:17 +01:00
Nathan.fooo
1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Nathan.fooo
38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint (#862)
* chore: using copy to improve write speed of batch collab api endpoint

* chore: insert to redis

* chore: fix compile
2024-10-07 08:58:19 +08:00
Bartosz Sypytkowski
6972f9c4ab
feat: Measure sync (#772)
* chore: redesign collab sync protocol to enable injection of metric tracking

* chore: track metrics for apply update on the server side

* chore: close locks

* chore: post rebase fixes
2024-08-30 21:48:19 +08:00
Nathan.fooo
5278203394
chore: decode update when spawn blocking when update size exceeds the… (#769)
* chore: decode update when spawn blocking when update size exceeds the threshold size

* chore: use 1mb as threshold
2024-08-30 11:30:15 +08:00
Bartosz Sypytkowski
2af1999375
chore: added locks with timeouts (#765)
* chore: added locks with timeouts

* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
Nathan.fooo
cccdf76116
chore: Update client protocol sync interval (#761)
* chore: separate server/client miss update

* chore: short pull timeout

* chore: short tick interval

* chore: fix clippy
2024-08-28 14:46:55 +08:00
Nathan.fooo
c8ee6b43ee
chore: try to fix inifinite sync (#756) 2024-08-27 16:41:19 +08:00
Bartosz Sypytkowski
ae3833ea91
chore: Remove last sync at (#735)
* chore: remove last sync at field

* chore: post rebase fixes

* chore: update test for missing update detection
2024-08-22 07:47:01 +08:00
Bartosz Sypytkowski
d503905931 chore: make sync plugin work over any collab type without generics 2024-08-14 14:42:12 +02:00
Bartosz Sypytkowski
f2fa4d7c22 chore: post rebase fixes 2024-08-14 05:26:38 +02:00
Bartosz Sypytkowski
66838c47e3 chore: make collab plugins work over generic collab providers 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski
ef860c2d5a chore: fix cargo fmt and clippy errors 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski
c27866fb25 chore: upgrade code to use asynchronous locks 2024-08-13 19:59:46 +02:00
Bartosz Sypytkowski
47e6f1e8b1
Update Yrs and AppFlowy-Collab (#518)
* chore: updated collab dependencies to v0.2

* chore: update collab to v0.2 and yrs to v0.18

* chore: pinned collab to specific revision

* chore: fix clippy errors

* chore: update commit id

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
Bartosz Sypytkowski
29928cb4a7
chore: add more detailed logging around errors in Transaction::try_encode_state_as_update_v1 (#514) 2024-05-01 20:14:27 +08:00
Nathan.fooo
79bb510aaf
ci: run history test (#513)
* ci: run history test

* chore: fix ci
2024-05-01 16:28:07 +08:00
Nathan.fooo
e2fd049333
chore: awarenss with origin (#498) 2024-04-26 19:39:08 +08:00
Nathan.fooo
1019b8c5b6
chore: update collab rev (#490) 2024-04-22 17:15:12 +08:00
Nathan.fooo
1515ccdb80
chore: fix encode message (#482) 2024-04-21 14:23:31 +08:00
Nathan.fooo
123484c864
chore: sync missing update from vector (#481) 2024-04-20 20:50:16 +08:00
Nathan.fooo
4d36f7e9e6
chore: fix potential sync issue (#474)
* chore: retry for handle message

* chore: retry when tring to lock the collab
2024-04-16 20:07:47 +08:00
Nathan.fooo
01f1af98f5
chore: wrapper for collab (#448)
* chore: wrapper for collab

* chore: add tests

* chore: fix audit

* chore: init sync

* chore: disable wasm user test

* chore: disable encode state when start

* chore: fix test
2024-04-05 11:30:00 +08:00
Nathan.fooo
a18b3d7886
feat: using pending to determine init sync or not (#435)
* chore: optimize sync

* chore: optimize sync

* chore: add test

* chore: update collab commit id

* chore: update

* chore: fix ci
2024-04-01 21:59:41 +08:00
Nathan.fooo
6c96d05e2f
feat: introduce custom function in casbin model that supports compari… (#433)
* feat: introduce custom function in casbin model that supports comparing role or level

* chore: update

* chore: log

* chore: log

* chore: remove cache
2024-03-31 19:54:41 +08:00
Nathan.fooo
d30cf93a1f
feat: sync protocol (#421)
* chore: send full update when it's first time to sync

* chore: update last sync at
2024-03-27 21:39:47 +08:00
Nathan.fooo
d4e45efd6a
chore: bump collab commit (#417)
* chore: bump collab rev

* chore: bump collab commit

* chore: custome decode ack code
2024-03-25 16:14:49 +08:00
Nathan.fooo
c015ee7c7e
fix: peer sync (#408) 2024-03-22 21:32:41 +08:00
Nathan.fooo
c85383b21d
chore: project folder structture (#392)
* chore: docker build

* chore: update

* chore: update

* chore: test stream pubsub

* chore: fix wanrings

* chore: realtime crate

* chore: realtime crate

* chore: realtime crate

* chore: realtime crate

* chore: reanme crates

* chore: reanme crates

* chore: project structure

* chore: disable docker for collab hisotry
2024-03-22 11:24:28 +08:00