Commit graph

148 commits

Author SHA1 Message Date
Bartosz Sypytkowski
66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Nathan.fooo
afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Bartosz Sypytkowski
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab (#1022)
* chore: reduce number of SQL statements executed when inserting new collab

* chore: add workspace id check

* chore: fix previous query

* chore: upsert collabs and embddings as stored procedures

* chore: fix clippy errors

* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
Zack Fu Zi Xiang
c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Nathan.fooo
655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Bartosz Sypytkowski
f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Zack Fu Zi Xiang
f3cfd87cb8
fix: patch publish name 2024-11-13 17:21:49 +08:00
Zack
85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack Fu Zi Xiang
ed4c14d53a
fix: also specify workspace id when deleting collab 2024-11-11 17:31:44 +08:00
Zack Fu Zi Xiang
b62552f382
fix: fetch published collab sql 2024-11-11 00:24:30 +08:00
Zack Fu Zi Xiang
a07b453c0b
feat: support last publish name 2024-11-08 17:29:02 +08:00
Zack Fu Zi Xiang
d69a2dce1b
fix: update publish namespace 2024-11-04 17:22:47 +08:00
Zack Fu Zi Xiang
d6d7e7312e
fix: namespace already taken 2024-11-03 15:08:38 +08:00
Zack
56c55fb6a9
feat: handle duplicated publish names for a workspace (#944)
* feat: handle duplicated publish names for a workspace

* chore: cargo sqlx
2024-10-29 09:39:41 +08:00
Zack Fu Zi Xiang
f701abd2a7
feat: delete default view for workspace 2024-10-28 13:32:41 +08:00
Zack Fu Zi Xiang
dc53e163a0
chore: cargo sqlx 2024-10-27 14:07:08 +08:00
Zack Fu Zi Xiang
90a644eaad
chore: cargo sqlx 2024-10-25 09:32:13 +08:00
khorshuheng
23e1da2910 feat: add publish info to list templates 2024-10-23 17:26:32 +08:00
Khor Shu Heng
ba8a670101
fix: workspace invitation failure due to email case sensitivity (#904)
* fix: integration test failure due to password mismatch

* fix: workspace invitation failure due to email case sensitivity
2024-10-19 10:10:35 +08:00
Zack
60c589bd9c
feat: CRUD interface for custom namespace (#882)
* feat: listing all published_info

* fix: add sqlx files

* feat: add additional fields for publish info

* feat: get and set default publish info

* chore: cargo sqlx prepare

* fix: cargo clippy

* fix: test case exe order

* chore: cargo sqlx

* feat: get info and meta from workspace namespace

* chore: cargo sqlx

* feat: add original doc info for published view

* chore: log all publish endpoints

* fix: default values for publish info extra fields

* feat: move namespace restriction to gateway
2024-10-19 10:09:54 +08:00
Nathan.fooo
9942e68089
chore: imported workspace should not become the latest visting workspace (#890)
* chore: imported workspace should not become the latest visting workspace

* chore: sqlx files

* chore: update test

* chore: fmt
2024-10-16 21:02:05 +08:00
Khor Shu Heng
ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
feat: additional access control config
2024-10-16 17:00:54 +08:00
khorshuheng
34a7fd3633 feat: additional access control config 2024-10-16 15:10:01 +08:00
Nathan.fooo
3c02fa253f
chore: retry import (#887)
* chore: retry import

* chore: delete temp files

* chore: bump collab
2024-10-16 12:55:53 +08:00
Nathan.fooo
bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo
9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
khorshuheng
81c9042439 feat: send email to workspace owner when user request access 2024-10-01 11:54:55 +08:00
Khor Shu Heng
757d0e5380
fix: incorrect requester avatar url and workspace member count (#847) 2024-09-29 11:03:08 +08:00
khorshuheng
6c6de08eaa fix: access not granted after approval 2024-09-26 18:19:33 +08:00
khorshuheng
813fa29253 feat: add endpoints to allow workspace owner to approve web page view request 2024-09-26 14:59:33 +08:00
Khor Shu Heng
0b193e1606
feat: add endpoint for getting page view collab (#831) 2024-09-18 12:56:34 +08:00
khorshuheng
180db846d9 fix: filter out templates which has not been published 2024-09-16 00:05:22 +08:00
Zack Fu Zi Xiang
3de0a728e8
fix: error handling on mailer 2024-09-14 13:31:49 +08:00
Zack Fu Zi Xiang
11cdc862f2
feat: additional fields for workspace invitation 2024-09-13 17:43:10 +08:00
Zack Fu Zi Xiang
f25066f51f
feat: add get invitation by id 2024-09-12 15:10:48 +08:00
Khor Shu Heng
abae8d2d1b
feat: Support s3 as published collab storage (#798)
* chore: remove unused published collab methods

* feat: support s3 as published collab storage
2024-09-11 20:52:33 +08:00
Zack Fu Zi Xiang
312411cca2
fix: slow query deleting collab embeddings 2024-09-05 00:06:04 +08:00
Nathan.fooo
4e384b982e
chore: pass chat metadata (#789)
* chore: pass chat metadata

* chore: clippy
2024-09-04 17:19:39 +08:00
Zack Fu Zi Xiang
584ed0863f
chore: fmt sqlx 2024-09-04 12:03:25 +08:00
Zack Fu Zi Xiang
6d0a7cc95b
fix: delete user should only remove owned workspaces 2024-09-04 12:00:34 +08:00
khorshuheng
56b9f9daf4 feat: published view outline endpoint 2024-09-03 15:27:59 +08:00
Zack Fu Zi Xiang
236d972fbf
chore: cargo sqlx 2024-09-03 12:24:27 +08:00
Zack
826546c5cb
feat: duplicate published doc (#700)
* chore: test collab sync

* feat: folder view for user workspace

* feat: add private indicator

* chore: use collab cache instead

* chore: initial impl

* chore: cargo sqlx

* fix: write back to collab cache

* fix: assign page id

* fix: text map

* chore: connect api and refactor

* chore: switch to using mem storage

* fix: collab type

* feat: use group manager to manage sync

* feat: try add send command instead

* chore: add client api code

* feat: try use sink and stream from group collab

* chore: disable sync first

* fix: insert page before stopping group

* feat: add extra for view

* feat: add metadata to doc

* fix: icon

* fix: page circular dep

* fix: page circular dep

* fix: live update

* feat: database initial impl

* feat: workspace database

* chore: link database

* fix: database validation

* fix: workspace database oid

* fix: workspace database oid

* fix: specify view layout

* feat: add txn when inserting collab and rework database views

* fix: parent view id for new database

* fix: database view for folder

* fix: database ids

* fix: database row id

* fix: main database layout and write database before folder

* fix: metadata for non database main view

* chore: database in doc wip

* chore: filter visible views

* chore: use structure value instead of json

* chore: database in doc wip

* fix: remove child item push

* fix: main database view meta

* chore: rework inline database in doc

* fix: make duplicate more error forgiving

* chore: use get instead of get key value

* chore: merge with main

* feat: set max depth for folder view

* chore: update dependency counter

* chore: remove unneeded arg

* chore: simplify collab new from source

* chore: remove unneeded param

* chore: rename and doc

* feat: rework inline database and use duplicated ref

* chore: simplify params

* chore: fmt

* feat: deduplicate database wip

* fix: compatible with newer appflowy version

* fix: database views

* feat: database in doc

* chore: cargo clippy

* chore: update dockerfile rust toolchain

* fix: doc inline db parent id

* fix: database id

* fix: document data modification

* chore: minor refactor and todo

* chore: remove unneeded nesting

* fix: enforce ordering for views to add

* chore: add doc and test case for folder view

* fix: remove the need for cloning published collab

* fix: some review

* chore: move folder conversion logic

* fix: remove collab folder deps on shared entity

* chore: cargo fmt

* fix: compile

* chore: remove group manager dependency

* fix: dep count

* fix: add messages sent by server

* fix: dep count

* chore: add test for doc ref and inline doc database

* chore: cargo clippy

* chore: add more test scenarios

* chore: fix tests

* chore: get database id

* chore: update collab

* chore: add more assert and database row id checks

* fix: suggestions from review

* chore: sqlx

* fix: accumulate collab before insert

* chore: add tokio spawn blocking for encoding

* fix: reduce limit for publish collabs

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
Co-authored-by: nathan <nathan@appflowy.io>
2024-09-03 09:12:29 +08:00
Khor Shu Heng
9c8e718246
feat: Template CRUD Endpoint (#731)
* feat: template crud endpoint

* fix: clippy error

* fix: categories for related view

* fix: add created at and last updated at to template response

* feat: template api delete endpoint

* feat: include number of template count for template creator

* fix: use params instead of individual fields for template api

* fix: seach template creator by name query

* chore: simplify query

* feat: support template count limit for template homepage
2024-08-20 15:22:56 +08:00
khorshuheng
2f0a705e16 fix: update updated_at fields when updating template creator and category 2024-08-19 13:06:30 +08:00
khorshuheng
3481dab2bf fix: sorting order of template category and creator 2024-08-16 14:26:04 +08:00
khorshuheng
59e5a13ee4 fix: replace rank with priority 2024-08-14 14:17:21 +08:00
khorshuheng
f6e78a941f feat: api endpoint for template categories and creators 2024-08-12 13:43:14 +08:00
Khor Shu Heng
ea27e87103
feat: support avatar url for publish comment and reaction endpoint (#711)
* chore: update sqlx to 0.8

* feat: support avatar url for publish comment and reaction

* chore: simplify reactions and comments ops using query as
2024-08-08 23:58:28 +08:00