Commit graph

277 commits

Author SHA1 Message Date
Zack Fu Zi Xiang
98ec542393
fix: remove assert when delete blob metadata 2024-12-17 11:33:25 +08:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
khorshuheng
c1c5bf7420 chore: stop writing to af_collab_member 2024-12-13 10:17:22 +08:00
Nathan.fooo
af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Zack
254bc23a6e
feat: insert database row into selected database (#1029)
* feat: insert database row into selected database

* feat: inserting database row

* feat: add impl for cell

* feat: insert row selection and mulitselection

* feat: support datetime field type

* fix: other fields like rich text

* feat: add database field server impl

* feat: add client api and tests

* feat: use to json value impl from collab

* feat: use add database cell impl from collab

* feat: update to latest collab

* chore: upgrade collab and fix tests

* chore: review issues

* fix: code review feedback

* feat: filter only allow supported field types

* feat: support more field types

* feat: support created at and last modified

* feat: add timestamp cell for created at and modified at fields

* chore: linting and formatting

* fix: add created at and last modified

* fix: ci add service dependency of appflowy cloud on admin frontend

* chore: trigger ci

* feat: add logging for admin frontend client signin

* fix: server logs if error

* fix: create admin confirmation without email

* fix: ci add service dependency of appflowy cloud on admin frontend

* fix: server logs if error

* chore: update collab
2024-12-11 15:47:29 +08:00
khorshuheng
719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Zack
7cd7ea1f9e
feat: invite to workspace email wait (#1057)
* feat: invite to workspace email wait

* feat: add option to skip email

* fix: docker compose ci mailer settings
2024-12-11 09:43:27 +08:00
Bartosz Sypytkowski
66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Khor Shu Heng
f79042fcc5
Merge pull request #1043 from AppFlowy-IO/web-update-fix
fix: web update should update both disk and mem cache
2024-12-06 10:44:52 +08:00
Nathan.fooo
afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
khorshuheng
aa64b7cd6b fix: web update should update both disk and mem cache 2024-12-05 16:51:56 +08:00
Bartosz Sypytkowski
51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo
3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
Bartosz Sypytkowski
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab (#1022)
* chore: reduce number of SQL statements executed when inserting new collab

* chore: add workspace id check

* chore: fix previous query

* chore: upsert collabs and embddings as stored procedures

* chore: fix clippy errors

* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
khorshuheng
484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Zack Fu Zi Xiang
c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Nathan.fooo
655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Nathan.fooo
06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Bartosz Sypytkowski
f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Zack Fu Zi Xiang
f3cfd87cb8
fix: patch publish name 2024-11-13 17:21:49 +08:00
Nathan.fooo
91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Zack
85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack
288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00
Nathan.fooo
14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Zack Fu Zi Xiang
ed4c14d53a
fix: also specify workspace id when deleting collab 2024-11-11 17:31:44 +08:00
Zack Fu Zi Xiang
8d8c3282ff
Merge branch 'main' into feat/last-publish-name 2024-11-11 17:15:41 +08:00
Zack
2028f4bffd
feat: use batch insert collab for workspace creation (#977)
* feat: use batch insert collab for workspace creation

* fix: separate user creation from initial workspace creation

* feat: separate workspace creation and collab initialization
2024-11-11 16:02:03 +08:00
Zack Fu Zi Xiang
b62552f382
fix: fetch published collab sql 2024-11-11 00:24:30 +08:00
Zack Fu Zi Xiang
e5623023aa
chore: cargo clippy 2024-11-10 04:46:51 +08:00
Zack Fu Zi Xiang
a07b453c0b
feat: support last publish name 2024-11-08 17:29:02 +08:00
Bartosz Sypytkowski
e31e541d07
Merge pull request #961 from AppFlowy-IO/remove-realitime-shared-state
chore: remove realtime shared state
2024-11-05 07:32:18 +01:00
Zack Fu Zi Xiang
d69a2dce1b
fix: update publish namespace 2024-11-04 17:22:47 +08:00
Zack Fu Zi Xiang
8d8c895703
feat: support for original and modified namespace 2024-11-04 16:58:33 +08:00
Bartosz Sypytkowski
f9397eaaf2 chore: remove realtime shared state 2024-11-04 07:58:16 +01:00
Zack Fu Zi Xiang
d6d7e7312e
fix: namespace already taken 2024-11-03 15:08:38 +08:00
Zack
56c55fb6a9
feat: handle duplicated publish names for a workspace (#944)
* feat: handle duplicated publish names for a workspace

* chore: cargo sqlx
2024-10-29 09:39:41 +08:00
Zack Fu Zi Xiang
f701abd2a7
feat: delete default view for workspace 2024-10-28 13:32:41 +08:00
Zack Fu Zi Xiang
0fe7d8def7
chore: merge with main 2024-10-28 09:46:31 +08:00
Nathan.fooo
9629d4cefa
chore: add limit for importing zip file (#938)
* chore: add limitation for import zip file

* chore: support upload big file

* chore: implement client api

* chore: implement client api

* chore: implement client api

* chore: update logs

* chore: check file size

* chore: last process at

* chore: set content type

* chore: fix test

* chore: try test

* chore: temporary disable test
2024-10-28 08:51:34 +08:00
Zack Fu Zi Xiang
dc44d0ae4e
fix: remove assert that might cause panic 2024-10-27 13:36:17 +08:00
Zack Fu Zi Xiang
b775aa9d4c
feat: patching of publish name 2024-10-24 22:06:52 +08:00
khorshuheng
23e1da2910 feat: add publish info to list templates 2024-10-23 17:26:32 +08:00
Khor Shu Heng
9eb1c36c92
chore: access control interface to return error instead of boolean (#914) 2024-10-21 20:20:14 +08:00
Khor Shu Heng
ba8a670101
fix: workspace invitation failure due to email case sensitivity (#904)
* fix: integration test failure due to password mismatch

* fix: workspace invitation failure due to email case sensitivity
2024-10-19 10:10:35 +08:00
Zack
60c589bd9c
feat: CRUD interface for custom namespace (#882)
* feat: listing all published_info

* fix: add sqlx files

* feat: add additional fields for publish info

* feat: get and set default publish info

* chore: cargo sqlx prepare

* fix: cargo clippy

* fix: test case exe order

* chore: cargo sqlx

* feat: get info and meta from workspace namespace

* chore: cargo sqlx

* feat: add original doc info for published view

* chore: log all publish endpoints

* fix: default values for publish info extra fields

* feat: move namespace restriction to gateway
2024-10-19 10:09:54 +08:00
Nathan.fooo
9942e68089
chore: imported workspace should not become the latest visting workspace (#890)
* chore: imported workspace should not become the latest visting workspace

* chore: sqlx files

* chore: update test

* chore: fmt
2024-10-16 21:02:05 +08:00
Khor Shu Heng
ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
feat: additional access control config
2024-10-16 17:00:54 +08:00
khorshuheng
383629ab1c chore: simplify not enough permission error 2024-10-16 15:10:31 +08:00
khorshuheng
34a7fd3633 feat: additional access control config 2024-10-16 15:10:01 +08:00