Commit graph

791 commits

Author SHA1 Message Date
Bartosz Sypytkowski
66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Nathan.fooo
ee87bb9bd6
chore: setup tokio console (#1046)
* chore: setup tokio console

* chore: setup tokio console

* chore: clippy

* chore: clippy
2024-12-06 11:33:04 +08:00
Khor Shu Heng
f79042fcc5
Merge pull request #1043 from AppFlowy-IO/web-update-fix
fix: web update should update both disk and mem cache
2024-12-06 10:44:52 +08:00
Nathan.fooo
afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
khorshuheng
aa64b7cd6b fix: web update should update both disk and mem cache 2024-12-05 16:51:56 +08:00
Bartosz Sypytkowski
51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Zack
e31928e77a
Merge pull request #1019 from AppFlowy-IO/feat/get-database-fields
feat: api to get database fields
2024-11-27 19:04:20 -08:00
Nathan.fooo
3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
Zack Fu Zi Xiang
7457371208
Merge branch 'main' into feat/get-database-fields 2024-11-27 18:18:34 +08:00
Zack Fu Zi Xiang
ed83fba242
feat: add type options 2024-11-27 17:24:14 +08:00
Khor Shu Heng
a4b598db5b
fix: remove only parent page when move to trash (#1021) 2024-11-27 13:00:58 +08:00
Bartosz Sypytkowski
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab (#1022)
* chore: reduce number of SQL statements executed when inserting new collab

* chore: add workspace id check

* chore: fix previous query

* chore: upsert collabs and embddings as stored procedures

* chore: fix clippy errors

* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
Zack Fu Zi Xiang
b4def2278d
chore: merge with main 2024-11-26 21:18:37 +08:00
khorshuheng
484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Zack Fu Zi Xiang
2da78b351f
feat: api to get database fields 2024-11-26 14:20:10 +08:00
Zack Fu Zi Xiang
c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Zack Fu Zi Xiang
298698ac0e
feat: format selection 2024-11-24 05:58:31 +08:00
Zack Fu Zi Xiang
ddecd8457c
feat: use folder view minimal for database list 2024-11-23 19:24:08 +08:00
Zack Fu Zi Xiang
a6bd54f447
feat: simplify listing databases 2024-11-23 12:11:27 +08:00
Zack Fu Zi Xiang
6d4200d1e7
feat: add row details 2024-11-23 02:40:26 +08:00
Zack Fu Zi Xiang
f3a2444615
feat: list database row ids 2024-11-22 20:21:31 +08:00
Nathan.fooo
0ec12c5f2f
chore: add file size (#1015) 2024-11-22 16:31:50 +08:00
Zack Fu Zi Xiang
687b5d9f6d
Merge branch 'main' into feat/search-database-by-name 2024-11-21 09:17:09 +08:00
Khor Shu Heng
afeaeb7796
chore: simplify collab level access control (#1008) 2024-11-20 12:29:16 +08:00
Khor Shu Heng
e6dbc95641
feat: api to update space (#1009) 2024-11-20 11:32:29 +08:00
Zack Fu Zi Xiang
d7478fb37a
chore: merge with main 2024-11-20 07:51:33 +08:00
khorshuheng
40835f00d1 fix: revert changes to casbin matcher 2024-11-19 21:11:18 +08:00
khorshuheng
00a6189cf3 fix: stop loading collab policies to improve access control evaluation 2024-11-19 12:58:21 +08:00
Khor Shu Heng
0818cf7565
feat: api for create space (#1006) 2024-11-19 12:54:10 +08:00
Khor Shu Heng
2647d41f3a
feat: allow create page API to accept a view name (#1005) 2024-11-19 11:46:23 +08:00
Bartosz Sypytkowski
3799966f12
chore: store pending collab writes in memory (#1000)
* chore: write immediatelly actually writes immediatelly

* chore: fix clippy errors

* chore: add metrics to new storage queue impl

* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
Nathan.fooo
655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Khor Shu Heng
d0c212ff10
refactor: remove enforcer group (#948) 2024-11-15 14:08:12 +08:00
Zack
d8075a9368
Merge pull request #994 from AppFlowy-IO/fix/smtp-email-username
feat: separate smtp username from email
2024-11-14 22:00:43 +08:00
Zack Fu Zi Xiang
4b2eb1b1ba
feat: separate smtp username from email 2024-11-14 16:00:15 +08:00
Nathan.fooo
06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Bartosz Sypytkowski
f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Nathan.fooo
e9c374bfe2
chore: remove wasm client api (#989)
* chore: revamp client api

* chore: fmt
2024-11-14 00:53:30 +08:00
Zack Fu Zi Xiang
f3cfd87cb8
fix: patch publish name 2024-11-13 17:21:49 +08:00
Nathan.fooo
91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Zack Fu Zi Xiang
787e6beb0d
feat: add name filtering 2024-11-12 23:48:41 +08:00
Zack
85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack
288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00
Nathan.fooo
14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Zack Fu Zi Xiang
ed4c14d53a
fix: also specify workspace id when deleting collab 2024-11-11 17:31:44 +08:00
Zack Fu Zi Xiang
8d8c3282ff
Merge branch 'main' into feat/last-publish-name 2024-11-11 17:15:41 +08:00
Zack
2028f4bffd
feat: use batch insert collab for workspace creation (#977)
* feat: use batch insert collab for workspace creation

* fix: separate user creation from initial workspace creation

* feat: separate workspace creation and collab initialization
2024-11-11 16:02:03 +08:00
Zack Fu Zi Xiang
b62552f382
fix: fetch published collab sql 2024-11-11 00:24:30 +08:00
Zack Fu Zi Xiang
e5623023aa
chore: cargo clippy 2024-11-10 04:46:51 +08:00