Bartosz Sypytkowski
9092225ea4
chore: add stress test for many subscribing many awareness subs
2025-03-19 09:25:22 +01:00
Bartosz Sypytkowski
ac1ebf6646
chore: awareness pubsub switch to lightweight version
2025-03-19 09:04:07 +01:00
Bartosz Sypytkowski
8da2bb4139
chore: remove awareness from redis hash
2025-03-12 08:57:12 +01:00
Bartosz Sypytkowski
285af6bdd6
fix: clippy errors
2025-03-11 10:43:03 +01:00
Bartosz Sypytkowski
2f9f5d9ad8
chore: remove outdated awareness redis stream
2025-03-11 10:36:41 +01:00
Bartosz Sypytkowski
30d6b4edb2
chore: change awareness broadcasting from stream to pubsub
2025-03-11 05:25:22 +01:00
khorshuheng
8c6a657f03
fix: trim awareness when collab group is dropped
2025-01-15 00:54:49 +08:00
Bartosz Sypytkowski
9bd6589aa8
chore: add missing parameter
2025-01-03 09:16:01 +01:00
Bartosz Sypytkowski
cc6b58f73d
chore: add metrics to redis collab stream
2025-01-03 08:44:36 +01:00
nathan
fddbc8073e
chore: fix test
2024-12-24 15:42:52 +08:00
nathan
1a5c1714db
Merge branch 'main' into stateless
2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn ( #1099 )
...
* chore: batch index
* chore: format log
* chore: index workspace
* chore: fix stack overflow
* chore: background index
* chore: clippy
* chore: filter tasks
* chore: clippy
* chore: add metrics
* chore: fix test
2024-12-24 14:30:17 +08:00
nathan
9c40c3128b
chore: clippy
2024-12-20 11:08:01 +08:00
nathan
971aa6d3e1
chore: map error
2024-12-20 10:13:16 +08:00
Bartosz Sypytkowski
d120860312
chore: remove state vector from redis udpates
2024-12-17 04:29:41 +01:00
Bartosz Sypytkowski
41e9302ff9
Merge branch 'main' into stateless
2024-12-12 16:00:45 +01:00
Nathan.fooo
af38efe6d9
feat: sync document through http request ( #1064 )
...
* chore: query embedding
* chore: create embeddings
* chore: apply update to editing collab
* refactor: web-update
* chore: calculate missing update the sv is not none
* chore: add test
* chore: fix audit
* chore: commit sqlx
* chore: fix client api
* test: add
* chore: clippy
* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Zack
254bc23a6e
feat: insert database row into selected database ( #1029 )
...
* feat: insert database row into selected database
* feat: inserting database row
* feat: add impl for cell
* feat: insert row selection and mulitselection
* feat: support datetime field type
* fix: other fields like rich text
* feat: add database field server impl
* feat: add client api and tests
* feat: use to json value impl from collab
* feat: use add database cell impl from collab
* feat: update to latest collab
* chore: upgrade collab and fix tests
* chore: review issues
* fix: code review feedback
* feat: filter only allow supported field types
* feat: support more field types
* feat: support created at and last modified
* feat: add timestamp cell for created at and modified at fields
* chore: linting and formatting
* fix: add created at and last modified
* fix: ci add service dependency of appflowy cloud on admin frontend
* chore: trigger ci
* feat: add logging for admin frontend client signin
* fix: server logs if error
* fix: create admin confirmation without email
* fix: ci add service dependency of appflowy cloud on admin frontend
* fix: server logs if error
* chore: update collab
2024-12-11 15:47:29 +08:00
Bartosz Sypytkowski
5e7b5f87fa
chore: merge branch main into stateless
2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski
eb54947ab7
chore: add config option for redis stream group workers count
2024-11-08 04:39:44 +01:00
Bartosz Sypytkowski
bc49d73b40
chore: split redis stream readers to active and one shot
2024-11-07 11:43:19 +01:00
Bartosz Sypytkowski
2d9a024554
chore: use redis stream router
2024-11-07 07:18:20 +01:00
Bartosz Sypytkowski
9c428f1d89
chore: add stream key info to stream length exceeded check
2024-11-06 07:49:25 +01:00
Bartosz Sypytkowski
f328e96763
chore: reduce log visibility level
2024-11-06 07:31:32 +01:00
Bartosz Sypytkowski
5388d419e6
chore: remove unused import
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
183e915f5e
chore: lease drop log message - use tracing crate
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
25f0461389
chore: added metrics for new stateless operations
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
e86c9de316
chore: when saving collab snapshot, do not load it unless there are pending updates in redis
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
b6ba52672a
chore: add exponential backoff to collab update stream
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
961c482995
chore: prevent hot loops in collab updates stream
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
923fe7ffde
chore: fix errors in lease code
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
e9a7d42b2e
chore: fix issues mentioned in nathan review
2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski
7dc90904cb
chore: fix clippy warnings
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
279a599b66
chore: fix early return from redis collab update stream reader
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
85e25f887c
chore: don't try to prune empty redis stream
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
d0b7c7d8e3
chore: update stream - live and current queries
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
00f5a5bb7e
chore: code cleanup
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
97335a94ec
chore: basics of snapshots (unoptimized)
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
253bb97825
chore: a dirty draft of snapshot saving
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
9164c494b1
chore: redis stream for awareness
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
d26d0ff1a7
chore: collab streams
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
0d6b595ee8
chore: create collab update sink and stream
2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski
fe3611cc88
chore: remove broadcast and introduce lease
2024-11-05 07:47:17 +01:00
Nathan.fooo
054fd2e7d8
chore: ignore create redis stream error when create a new group ( #826 )
2024-09-16 15:31:05 +08:00
Nathan.fooo
54b811125e
chore: wrap spawn blocking when decoding collab ( #767 )
2024-08-29 22:53:33 +08:00
Bartosz Sypytkowski
f2fa4d7c22
chore: post rebase fixes
2024-08-14 05:26:38 +02:00
Nathan.fooo
73127fb886
chore: shorten group lifetime ( #726 )
2024-08-13 16:20:06 +08:00
Khor Shu Heng
bb1c93b98a
chore: replace bincode serialization with protobuf for collab stream ( #715 )
2024-08-05 23:44:34 +08:00
Khor Shu Heng
ca6490c1ac
feat: deserialization for entities used in collab stream ( #682 )
2024-07-30 17:08:48 +08:00
Nathan.fooo
1a22813113
chore: stop indexing when stream is not exist ( #652 )
2024-06-26 14:24:23 +08:00
