Commit graph

275 commits

Author SHA1 Message Date
Zack Fu Zi Xiang
6f98894c6f
chore: version update to resolve sec issue 2024-12-20 09:37:25 +08:00
Zack Fu Zi Xiang
8f9158cc3b
chore: update collab 2024-12-19 16:57:05 +08:00
Zack
c0f7b1d3a9
feat: upsert database row (#1067)
* feat: upsert database row

* feat: improve api to accept database row document payload

* feat: test case for upsert

* chore: refactor

* feat: database row doc content impl

* refactor: simplify insert row field names

* feat: folder updates for database row document

* refactor: simplify row detail return

* feat: add doc contents for database row detail

* feat: refactor database row creation

* feat: upsert database row doc modification

* feat: ignore empty string

* feat: add document similarity check

* chore: refactor to use broadcast with timeout

* feat: wrap broadcast timeout in a tokio spawn
2024-12-18 13:47:20 +08:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Nathan.fooo
a549364fc9
chore: support insert space between delta (#1069) 2024-12-14 10:38:39 +08:00
Nathan.fooo
af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Nathan.fooo
b4a0669361
chore: bump collab that fix import notion doucment in database row (#1065) 2024-12-11 22:48:44 +08:00
Zack
254bc23a6e
feat: insert database row into selected database (#1029)
* feat: insert database row into selected database

* feat: inserting database row

* feat: add impl for cell

* feat: insert row selection and mulitselection

* feat: support datetime field type

* fix: other fields like rich text

* feat: add database field server impl

* feat: add client api and tests

* feat: use to json value impl from collab

* feat: use add database cell impl from collab

* feat: update to latest collab

* chore: upgrade collab and fix tests

* chore: review issues

* fix: code review feedback

* feat: filter only allow supported field types

* feat: support more field types

* feat: support created at and last modified

* feat: add timestamp cell for created at and modified at fields

* chore: linting and formatting

* fix: add created at and last modified

* fix: ci add service dependency of appflowy cloud on admin frontend

* chore: trigger ci

* feat: add logging for admin frontend client signin

* fix: server logs if error

* fix: create admin confirmation without email

* fix: ci add service dependency of appflowy cloud on admin frontend

* fix: server logs if error

* chore: update collab
2024-12-11 15:47:29 +08:00
khorshuheng
719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Nathan.fooo
ee87bb9bd6
chore: setup tokio console (#1046)
* chore: setup tokio console

* chore: setup tokio console

* chore: clippy

* chore: clippy
2024-12-06 11:33:04 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo
3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
khorshuheng
484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Nathan.fooo
655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Nathan.fooo
e9c374bfe2
chore: remove wasm client api (#989)
* chore: revamp client api

* chore: fmt
2024-11-14 00:53:30 +08:00
Nathan.fooo
9778843746
chore: disable history service (#985)
* chore: disable history service

* chore: fix build
2024-11-13 10:46:15 +08:00
Nathan.fooo
a5a5a6b59f
fix: import notion file base cases (#957) 2024-11-02 16:50:51 +08:00
Nathan.fooo
7c42cee11a
chore: Upgrade the collab library to fix the issue with importing Notion zip files that contain embedded zip attachments. (#955)
* chore: bump collab that fixs import notion zip file contains zip attachment

* chore: fix compile
2024-11-01 22:26:27 +08:00
Nathan.fooo
860a921ea5
chore: remove inline view id (#945)
* chore: remove inline view id

* test: fix test compile

* chore: logs

* chore: update test
2024-10-30 12:47:15 +08:00
Zack Fu Zi Xiang
e29d5d058d
Merge branch 'main' into feat/custom-namespace-change-publish-name 2024-10-27 13:31:45 +08:00
Zack Fu Zi Xiang
a1e9d56bcf
chore: make pin project workspace dependency 2024-10-25 17:23:35 +08:00
Nathan.fooo
246cbd3ec4
chore: update nginx config for import (#935) 2024-10-25 16:47:29 +08:00
Nathan.fooo
efb3d93f77
fix: resolve part csv when importing notion zip file (#932) 2024-10-25 14:45:26 +08:00
Nathan.fooo
e738508d79
fix: Support notion database row document (#929)
* chore: fix import notion database
2024-10-24 19:04:06 +08:00
Nathan.fooo
b1f37dbbf6
chore: fix petential unzip issues (#910) 2024-10-20 10:48:09 +08:00
Nathan.fooo
15b77e63af
fix: import zip with multiple level folder (#900) 2024-10-18 09:46:17 +08:00
Nathan.fooo
6c9ab2ba7e
fix: import notion zip file that do not have root dir (#897) 2024-10-18 00:29:50 +08:00
Nathan.fooo
ee0831e223
chore: support import notion zip file without subpages (#894) 2024-10-17 13:35:42 +08:00
Nathan.fooo
d3e4a6870d
chore: template (#889)
* chore: template

* fix: auto del file lifetime

* chore: delete file if fail to write to disk

* fix: modified html

* chore: set content type

* chore: md5 content

* chore: clippy

* fix: image loaded failed

* fix: build

* chore: bump collab

---------

Co-authored-by: Kilu <lu@appflowy.io>
2024-10-16 17:39:24 +08:00
Nathan.fooo
3c02fa253f
chore: retry import (#887)
* chore: retry import

* chore: delete temp files

* chore: bump collab
2024-10-16 12:55:53 +08:00
Nathan.fooo
22a70f241d
chore: bump collab version (#886)
* chore: bump collab version
2024-10-15 21:05:21 +08:00
Nathan.fooo
2b02a8d12b
chore: bump collab (#884) 2024-10-15 15:56:14 +08:00
Nathan.fooo
1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Nathan.fooo
95e8b30f11
chore: bump collab that use yrs 0.21.2 (#872)
* chore: bump collab that use yrs 0.21.2

* chore: fmt
2024-10-14 00:58:32 +08:00
Nathan.fooo
bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo
14cfaa0bbd
chore: insert metadata after import notion zip file (#871)
* chore: insert metadata after import notion zip file

* chore: update logs
2024-10-10 22:32:02 +08:00
Khor Shu Heng
8c14612f98
feat: refactor access control to enable swapping implementation (#859) 2024-10-10 13:04:47 +08:00
Nathan.fooo
98347b81ea
fix: import notion zip file as workspace (#868)
* chore: insert content length in header

* chore: custom header

* chore: workspace name

* chore: file name

* chore: handle file name that is not utf8 encode

* chore: clippy

* fix: end of file when unzip file

* chore: docs
2024-10-09 21:27:24 +08:00
Nathan.fooo
820db6564e
chore: create space view for imported notion zip file (#863) 2024-10-07 12:41:45 +08:00
Nathan.fooo
9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
Khor Shu Heng
11732324b5
feat: support fetching encoded collab in batch from memory (#837) 2024-10-02 10:22:40 +08:00
Zack Fu Zi Xiang
8523c8efcf
chore: update dep 2024-09-16 15:48:50 +08:00
Zack Fu Zi Xiang
5673faf604
chore: update deps 2024-09-16 15:15:18 +08:00
Zack Fu Zi Xiang
ad68131223
chore: update dep 2024-09-16 12:06:52 +08:00
Zack Fu Zi Xiang
4345f8b2a5
chore: merge with main 2024-09-16 10:55:14 +08:00
Nathan.fooo
4c54481d70
chore: bump collab version (#822)
* chore: bump collab version

* chore: update deps count
2024-09-14 23:59:50 +08:00
Zack Fu Zi Xiang
df66cfc6f4
chore: update dep 2024-09-13 14:51:15 +08:00
Zack Fu Zi Xiang
def42240ae
fix: update dep 2024-09-12 22:58:31 +08:00
Zack Fu Zi Xiang
f241c4a84f
chore: update dep and fix database row open 2024-09-12 21:14:24 +08:00
Zack Fu Zi Xiang
6406f42ff8
chore: update collab dep 2024-09-12 20:37:40 +08:00