Commit graph

288 commits

Author SHA1 Message Date
Bartosz Sypytkowski
cc6b58f73d chore: add metrics to redis collab stream 2025-01-03 08:44:36 +01:00
Nathan.fooo
3ee52ad8d0
chore: fix private open api key in config (#1112)
* chore: fix private open api key in config

* chore: fmt
2025-01-02 13:03:01 +08:00
Bartosz Sypytkowski
a0bed04685 chore: add prometheus histogram metrics for collab redis update read latency 2024-12-31 14:18:42 +01:00
Nathan.fooo
b886db1d5c
chore: fix clippy warnings (#1103) 2024-12-29 12:47:34 +08:00
Bartosz Sypytkowski
4550cae2b1 chore: cherry pick github pr 1054 2024-12-27 10:07:01 +01:00
Bartosz Sypytkowski
c94938ee46 chore: fix clippy errors 2024-12-27 07:52:10 +01:00
khorshuheng
824d60920d Merge branch 'main' into stateless 2024-12-26 11:55:52 +08:00
Nathan.fooo
c80491267b
chore: update metrics and num threads (#1102) 2024-12-26 11:55:54 +08:00
nathan
fddbc8073e chore: fix test 2024-12-24 15:42:52 +08:00
nathan
1a5c1714db Merge branch 'main' into stateless 2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099)
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
2024-12-24 14:30:17 +08:00
Bartosz Sypytkowski
837f4de8f3 chore: remove gc check 2024-12-23 14:57:52 +01:00
Bartosz Sypytkowski
35430c6be2 chore: remove doing snapshots in collab group periodic saves 2024-12-23 13:02:23 +01:00
Bartosz Sypytkowski
59e8281010 Merge branch 'main' into stateless 2024-12-23 05:21:15 +01:00
Nathan.fooo
381b02a4d0
chore: disable batch index (#1098) 2024-12-23 00:04:25 +08:00
Zack
5ea714b004
Merge pull request #1092 from AppFlowy-IO/feat/update-collab
chore: update collab
2024-12-20 20:54:10 +08:00
Zack Fu Zi Xiang
cafff8098b
chore: update dockerfile rust version 2024-12-20 17:10:42 +08:00
Nathan.fooo
46f9c7811f
chore: return unindex collab one by one (#1095)
* chore: return unindex collab one by one

* chore: clippy
2024-12-20 15:14:47 +08:00
khorshuheng
8674c9f3ad Merge branch 'main' into stateless 2024-12-20 13:24:44 +08:00
nathan
9c40c3128b chore: clippy 2024-12-20 11:08:01 +08:00
nathan
011a5b59c9 chore: rename data to doc_state 2024-12-20 10:22:08 +08:00
nathan
971aa6d3e1 chore: map error 2024-12-20 10:13:16 +08:00
Zack Fu Zi Xiang
6f98894c6f
chore: version update to resolve sec issue 2024-12-20 09:37:25 +08:00
Nathan.fooo
1614474c2d
chore: check collab type before index (#1093) 2024-12-19 22:03:10 +08:00
Bartosz Sypytkowski
9d6b272656 chore: merge main into stateless branch 2024-12-19 06:52:20 +01:00
Bartosz Sypytkowski
c1d94e3d17 chore: add preliminary check for enabled indexing to batch collab insert 2024-12-19 06:49:32 +01:00
Nathan.fooo
e758f18d75
chore: add metadata column to save embeding info (#1086) 2024-12-18 22:48:25 +08:00
Khor Shu Heng
6fa6fa00cb
chore: refactor page view APIs to write to in-memory collab group (#1083) 2024-12-18 22:47:25 +08:00
Nathan.fooo
5f388c7432
chore: add metrics for write embeeding to pg (#1084) 2024-12-18 17:03:38 +08:00
Bartosz Sypytkowski
d5252f4273 Merge branch 'main' into stateless 2024-12-17 18:24:17 +01:00
Bartosz Sypytkowski
6c2ce8fc3c chore: fix snapshot s3 read and write 2024-12-17 18:22:20 +01:00
Nathan.fooo
abf827f2a6
chore: query multiple collab embedding state (#1081)
* chore: query multiple collab embedding state

* chore: clippy
2024-12-17 23:23:43 +08:00
Zack
06dc3b3a00
feat: add option for tls mailer (#1078) 2024-12-17 13:53:32 +08:00
Bartosz Sypytkowski
e85e60c0f2 chore: revert from editing collab 2024-12-17 05:43:04 +01:00
Bartosz Sypytkowski
d120860312 chore: remove state vector from redis udpates 2024-12-17 04:29:41 +01:00
Bartosz Sypytkowski
73872a2b1d chore: post merge fixes 2024-12-16 08:48:09 +01:00
Bartosz Sypytkowski
1b35326f0a Merge branch 'main' into stateless 2024-12-16 04:47:26 +01:00
Nathan.fooo
ec9c38254b
chore: open ai call directly (#1074)
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
2024-12-15 23:29:46 +08:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Bartosz Sypytkowski
ed07104aeb chore: remove from editing collab param in get encode collab method 2024-12-14 09:42:15 +01:00
Bartosz Sypytkowski
dfe780d30c chore: fix linter errors 2024-12-14 09:22:42 +01:00
Nathan.fooo
a549364fc9
chore: support insert space between delta (#1069) 2024-12-14 10:38:39 +08:00
Bartosz Sypytkowski
41e9302ff9 Merge branch 'main' into stateless 2024-12-12 16:00:45 +01:00
Nathan.fooo
af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Bartosz Sypytkowski
cdf98d1a83
chore: add logging for reindexing docs after restart (#1056) 2024-12-11 17:17:29 +08:00
Zack
254bc23a6e
feat: insert database row into selected database (#1029)
* feat: insert database row into selected database

* feat: inserting database row

* feat: add impl for cell

* feat: insert row selection and mulitselection

* feat: support datetime field type

* fix: other fields like rich text

* feat: add database field server impl

* feat: add client api and tests

* feat: use to json value impl from collab

* feat: use add database cell impl from collab

* feat: update to latest collab

* chore: upgrade collab and fix tests

* chore: review issues

* fix: code review feedback

* feat: filter only allow supported field types

* feat: support more field types

* feat: support created at and last modified

* feat: add timestamp cell for created at and modified at fields

* chore: linting and formatting

* fix: add created at and last modified

* fix: ci add service dependency of appflowy cloud on admin frontend

* chore: trigger ci

* feat: add logging for admin frontend client signin

* fix: server logs if error

* fix: create admin confirmation without email

* fix: ci add service dependency of appflowy cloud on admin frontend

* fix: server logs if error

* chore: update collab
2024-12-11 15:47:29 +08:00
khorshuheng
719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Bartosz Sypytkowski
c4514ca5bf chore: add explanation 2024-12-10 10:12:33 +01:00
Bartosz Sypytkowski
9971c23749 fix: update redis cache when inserting collabs in batches 2024-12-10 10:07:54 +01:00
Bartosz Sypytkowski
813179fdb0
chore: Remove async awaits from RealtimeServerActor (#1059)
* chore: reduce number of async await methods in connection manager

* chore: remove async handlers from rt actor
2024-12-10 15:20:28 +08:00