Commit graph

158 commits

Author SHA1 Message Date
Nathan.fooo
327ba7157e
chore: save fragment index (#1106) 2024-12-31 10:03:36 +08:00
nathan
1a5c1714db Merge branch 'main' into stateless 2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099)
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
2024-12-24 14:30:17 +08:00
khorshuheng
8674c9f3ad Merge branch 'main' into stateless 2024-12-20 13:24:44 +08:00
khorshuheng
414d721ee0 feat: quick note CRUD APIs 2024-12-20 11:11:51 +08:00
nathan
9c40c3128b chore: clippy 2024-12-20 11:08:01 +08:00
nathan
011a5b59c9 chore: rename data to doc_state 2024-12-20 10:22:08 +08:00
khorshuheng
1b17c8586b Merge branch 'quick-notes-api' into stateless 2024-12-19 16:50:33 +08:00
khorshuheng
8128c2f8e5 feat: quick note CRUD APIs 2024-12-19 16:50:05 +08:00
Bartosz Sypytkowski
9d6b272656 chore: merge main into stateless branch 2024-12-19 06:52:20 +01:00
Nathan.fooo
e758f18d75
chore: add metadata column to save embeding info (#1086) 2024-12-18 22:48:25 +08:00
Bartosz Sypytkowski
d5252f4273 Merge branch 'main' into stateless 2024-12-17 18:24:17 +01:00
Nathan.fooo
abf827f2a6
chore: query multiple collab embedding state (#1081)
* chore: query multiple collab embedding state

* chore: clippy
2024-12-17 23:23:43 +08:00
Bartosz Sypytkowski
24deac35a1 Merge branch 'main' into stateless 2024-12-17 06:48:56 +01:00
Nathan.fooo
91c2a925bc
test: add test (#1077) 2024-12-16 16:19:41 +08:00
Bartosz Sypytkowski
1b35326f0a Merge branch 'main' into stateless 2024-12-16 04:47:26 +01:00
Nathan.fooo
ec9c38254b
chore: open ai call directly (#1074)
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
2024-12-15 23:29:46 +08:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Bartosz Sypytkowski
41e9302ff9 Merge branch 'main' into stateless 2024-12-12 16:00:45 +01:00
Nathan.fooo
af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
khorshuheng
719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Nathan.fooo
ee87bb9bd6
chore: setup tokio console (#1046)
* chore: setup tokio console

* chore: setup tokio console

* chore: clippy

* chore: clippy
2024-12-06 11:33:04 +08:00
Bartosz Sypytkowski
5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski
51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo
0ec12c5f2f
chore: add file size (#1015) 2024-11-22 16:31:50 +08:00
Bartosz Sypytkowski
401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Zack
85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack
288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00
Nathan.fooo
14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Zack Fu Zi Xiang
a07b453c0b
feat: support last publish name 2024-11-08 17:29:02 +08:00
Bartosz Sypytkowski
d26d0ff1a7 chore: collab streams 2024-11-05 07:47:17 +01:00
Zack Fu Zi Xiang
8d8c895703
feat: support for original and modified namespace 2024-11-04 16:58:33 +08:00
Nathan.fooo
a3a581ea4e
chore: fix import test (#941)
* chore: fix import test

* chore: enable test

* chore: fix build

* chore: update test
2024-10-31 15:18:30 +08:00
Zack Fu Zi Xiang
0fe7d8def7
chore: merge with main 2024-10-28 09:46:31 +08:00
Nathan.fooo
9629d4cefa
chore: add limit for importing zip file (#938)
* chore: add limitation for import zip file

* chore: support upload big file

* chore: implement client api

* chore: implement client api

* chore: implement client api

* chore: update logs

* chore: check file size

* chore: last process at

* chore: set content type

* chore: fix test

* chore: try test

* chore: temporary disable test
2024-10-28 08:51:34 +08:00
Zack Fu Zi Xiang
e29d5d058d
Merge branch 'main' into feat/custom-namespace-change-publish-name 2024-10-27 13:31:45 +08:00
khorshuheng
3c0258b42a feat: add publish info to template home page 2024-10-25 17:30:56 +08:00
Zack Fu Zi Xiang
b775aa9d4c
feat: patching of publish name 2024-10-24 22:06:52 +08:00
khorshuheng
23e1da2910 feat: add publish info to list templates 2024-10-23 17:26:32 +08:00
khorshuheng
ee9e335152 feat: add publish info to template 2024-10-22 17:29:20 +08:00
Zack
60c589bd9c
feat: CRUD interface for custom namespace (#882)
* feat: listing all published_info

* fix: add sqlx files

* feat: add additional fields for publish info

* feat: get and set default publish info

* chore: cargo sqlx prepare

* fix: cargo clippy

* fix: test case exe order

* chore: cargo sqlx

* feat: get info and meta from workspace namespace

* chore: cargo sqlx

* feat: add original doc info for published view

* chore: log all publish endpoints

* fix: default values for publish info extra fields

* feat: move namespace restriction to gateway
2024-10-19 10:09:54 +08:00
Khor Shu Heng
ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
feat: additional access control config
2024-10-16 17:00:54 +08:00
khorshuheng
34a7fd3633 feat: additional access control config 2024-10-16 15:10:01 +08:00
Khor Shu Heng
2a15c8e4b5
feat: support appflowy web editing for document (#877) 2024-10-15 15:05:45 +08:00
Nathan.fooo
1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Nathan.fooo
33e63fae5c
chore: try to fix pg lock timeout (#864)
* chore: try to fix pg lock timeout

* chore: add logs for insert collab

* chore: add timeout for duplicate

* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
Khor Shu Heng
56f8f395fa
fix: add default serialization to owner email field (#856) 2024-10-02 22:22:25 +08:00
Khor Shu Heng
3b320b0619
feat: support protobuf serialization and deserialization for CollabParams (#834) 2024-10-02 09:49:55 +08:00
khorshuheng
81c9042439 feat: send email to workspace owner when user request access 2024-10-01 11:54:55 +08:00