Commit graph

304 commits

Author SHA1 Message Date
Khor Shu Heng
48224c6fcc
Merge pull request #1131 from AppFlowy-IO/unpublish-page
feat: endpoint for unpublish page
2025-01-07 13:27:52 +08:00
Nathan.fooo
5195dae3a5
feat: Chat file metadata (#1133)
* chore: chat question metadata

* chore: update

* chore: update env

* chore: update env
2025-01-07 12:46:55 +08:00
khorshuheng
ace49ef18f feat: endpoint for unpublish page 2025-01-07 12:25:48 +08:00
Nathan.fooo
327ba7157e
chore: save fragment index (#1106) 2024-12-31 10:03:36 +08:00
khorshuheng
3c1da30663 Merge branch 'main' into stateless 2024-12-26 11:53:41 +08:00
khorshuheng
52f9ee071e fix: sort quick notes by update time 2024-12-26 11:05:57 +08:00
nathan
1a5c1714db Merge branch 'main' into stateless 2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099)
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
2024-12-24 14:30:17 +08:00
Bartosz Sypytkowski
59e8281010 Merge branch 'main' into stateless 2024-12-23 05:21:15 +01:00
Nathan.fooo
46f9c7811f
chore: return unindex collab one by one (#1095)
* chore: return unindex collab one by one

* chore: clippy
2024-12-20 15:14:47 +08:00
khorshuheng
8674c9f3ad Merge branch 'main' into stateless 2024-12-20 13:24:44 +08:00
khorshuheng
414d721ee0 feat: quick note CRUD APIs 2024-12-20 11:11:51 +08:00
khorshuheng
1b17c8586b Merge branch 'quick-notes-api' into stateless 2024-12-19 16:50:33 +08:00
khorshuheng
8128c2f8e5 feat: quick note CRUD APIs 2024-12-19 16:50:05 +08:00
Bartosz Sypytkowski
9d6b272656 chore: merge main into stateless branch 2024-12-19 06:52:20 +01:00
Richard Shiue
ecadf8e287
chore: find question message from reply message (#1085)
* chore: find question message from answer message id

* chore: sqlx

* test: fix tests

* test: fix test

* chore: apply code suggestions to 2 files
2024-12-19 00:12:53 +08:00
Nathan.fooo
e758f18d75
chore: add metadata column to save embeding info (#1086) 2024-12-18 22:48:25 +08:00
Bartosz Sypytkowski
d5252f4273 Merge branch 'main' into stateless 2024-12-17 18:24:17 +01:00
Nathan.fooo
abf827f2a6
chore: query multiple collab embedding state (#1081)
* chore: query multiple collab embedding state

* chore: clippy
2024-12-17 23:23:43 +08:00
Bartosz Sypytkowski
e85e60c0f2 chore: revert from editing collab 2024-12-17 05:43:04 +01:00
Zack Fu Zi Xiang
98ec542393
fix: remove assert when delete blob metadata 2024-12-17 11:33:25 +08:00
Bartosz Sypytkowski
1b35326f0a Merge branch 'main' into stateless 2024-12-16 04:47:26 +01:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Bartosz Sypytkowski
ed07104aeb chore: remove from editing collab param in get encode collab method 2024-12-14 09:42:15 +01:00
khorshuheng
c1c5bf7420 chore: stop writing to af_collab_member 2024-12-13 10:17:22 +08:00
Bartosz Sypytkowski
41e9302ff9 Merge branch 'main' into stateless 2024-12-12 16:00:45 +01:00
Nathan.fooo
af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Zack
254bc23a6e
feat: insert database row into selected database (#1029)
* feat: insert database row into selected database

* feat: inserting database row

* feat: add impl for cell

* feat: insert row selection and mulitselection

* feat: support datetime field type

* fix: other fields like rich text

* feat: add database field server impl

* feat: add client api and tests

* feat: use to json value impl from collab

* feat: use add database cell impl from collab

* feat: update to latest collab

* chore: upgrade collab and fix tests

* chore: review issues

* fix: code review feedback

* feat: filter only allow supported field types

* feat: support more field types

* feat: support created at and last modified

* feat: add timestamp cell for created at and modified at fields

* chore: linting and formatting

* fix: add created at and last modified

* fix: ci add service dependency of appflowy cloud on admin frontend

* chore: trigger ci

* feat: add logging for admin frontend client signin

* fix: server logs if error

* fix: create admin confirmation without email

* fix: ci add service dependency of appflowy cloud on admin frontend

* fix: server logs if error

* chore: update collab
2024-12-11 15:47:29 +08:00
khorshuheng
719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Zack
7cd7ea1f9e
feat: invite to workspace email wait (#1057)
* feat: invite to workspace email wait

* feat: add option to skip email

* fix: docker compose ci mailer settings
2024-12-11 09:43:27 +08:00
Bartosz Sypytkowski
66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Khor Shu Heng
f79042fcc5
Merge pull request #1043 from AppFlowy-IO/web-update-fix
fix: web update should update both disk and mem cache
2024-12-06 10:44:52 +08:00
Nathan.fooo
afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
khorshuheng
aa64b7cd6b fix: web update should update both disk and mem cache 2024-12-05 16:51:56 +08:00
Bartosz Sypytkowski
5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski
51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo
3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
Bartosz Sypytkowski
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab (#1022)
* chore: reduce number of SQL statements executed when inserting new collab

* chore: add workspace id check

* chore: fix previous query

* chore: upsert collabs and embddings as stored procedures

* chore: fix clippy errors

* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
khorshuheng
484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Zack Fu Zi Xiang
c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Bartosz Sypytkowski
1932607ca9 Merge branch 'main' into stateless 2024-11-18 05:43:16 +01:00
Nathan.fooo
655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Bartosz Sypytkowski
401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Nathan.fooo
06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Bartosz Sypytkowski
f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Zack Fu Zi Xiang
f3cfd87cb8
fix: patch publish name 2024-11-13 17:21:49 +08:00
Nathan.fooo
91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Zack
85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack
288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00