Nathan.fooo
2ab1e94b99
chore: create embed in background ( #1071 )
...
* refactor: create indexer scheduler
* refactor: replace current calls
* chore: use rayon thread pool
* chore: index unindexed collab using thread pool
* chore: index collab when write to disk
* chore: add test
* chore: add test
* chore: add test
* chore: fix client api deps
* chore: chat with document test
* chore: fix test
* chore: clippy
* chore: update test
2024-12-15 12:29:51 +08:00
khorshuheng
c1c5bf7420
chore: stop writing to af_collab_member
2024-12-13 10:17:22 +08:00
Nathan.fooo
af38efe6d9
feat: sync document through http request ( #1064 )
...
* chore: query embedding
* chore: create embeddings
* chore: apply update to editing collab
* refactor: web-update
* chore: calculate missing update the sv is not none
* chore: add test
* chore: fix audit
* chore: commit sqlx
* chore: fix client api
* test: add
* chore: clippy
* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Zack
254bc23a6e
feat: insert database row into selected database ( #1029 )
...
* feat: insert database row into selected database
* feat: inserting database row
* feat: add impl for cell
* feat: insert row selection and mulitselection
* feat: support datetime field type
* fix: other fields like rich text
* feat: add database field server impl
* feat: add client api and tests
* feat: use to json value impl from collab
* feat: use add database cell impl from collab
* feat: update to latest collab
* chore: upgrade collab and fix tests
* chore: review issues
* fix: code review feedback
* feat: filter only allow supported field types
* feat: support more field types
* feat: support created at and last modified
* feat: add timestamp cell for created at and modified at fields
* chore: linting and formatting
* fix: add created at and last modified
* fix: ci add service dependency of appflowy cloud on admin frontend
* chore: trigger ci
* feat: add logging for admin frontend client signin
* fix: server logs if error
* fix: create admin confirmation without email
* fix: ci add service dependency of appflowy cloud on admin frontend
* fix: server logs if error
* chore: update collab
2024-12-11 15:47:29 +08:00
Bartosz Sypytkowski
66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics ( #1045 )
...
* chore: move collab cache for appflowy collaborate service and add metrics
* chore: add histogram for measuring time spent in postgres transactions
* chore: delete blobs in chunks
* chore: bring back redis cache filling by import worker
* chore: cargo fmt
* chore: make import workspace update existing collabs
* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache ( #1028 )
...
* chore: collab cache for S3
* chore: adjust disk cache api to accomodate s3
* chore: move postgres dependent ops to disk cache
* chore: replace blob inserts from pg to s3
* chore: delete blob and collab exist now use s3
* chore: fix clippy erorrs
* chore: post rebase fixes
* chore: fix clippy warnings
* chore: fix imports
* chore: make snapshots work over S3
* chore: remove dead code
* chore: use compressed snapshots
* chore: add zstd compression
* chore: introduce collab size threshold to keep smaller collabs in postgres
* chore: remove collabs from S3 if they were put to postgres
* chore: update tests
2024-12-03 13:08:55 +08:00
Khor Shu Heng
afeaeb7796
chore: simplify collab level access control ( #1008 )
2024-11-20 12:29:16 +08:00
Bartosz Sypytkowski
3799966f12
chore: store pending collab writes in memory ( #1000 )
...
* chore: write immediatelly actually writes immediatelly
* chore: fix clippy errors
* chore: add metrics to new storage queue impl
* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
Nathan.fooo
655f13bc27
chore: search and chat ( #999 )
...
* chore: add test for search and chat
* chore: update test
* chore: update test
* chore: update ci
* chore: fix security audio
* chore: multiple core docker build
* chore: multiple core docker build
* chore: update ci
* chore: update model setting
* chore: test ci
* chore: use tiktoken to calcualte token length
* chore: remove env
* chore: use spawn_blocking with condition
* chore: docs
* chore: clippy
* chore: clippy
* chore: docker logs
* chore: pass message id
* chore: clippy
2024-11-16 14:52:12 +08:00
khorshuheng
a0c68d8c86
chore: remove access control middleware
2024-10-25 13:19:16 +08:00
Khor Shu Heng
2a15c8e4b5
feat: support appflowy web editing for document ( #877 )
2024-10-15 15:05:45 +08:00
Nathan.fooo
38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint ( #862 )
...
* chore: using copy to improve write speed of batch collab api endpoint
* chore: insert to redis
* chore: fix compile
2024-10-07 08:58:19 +08:00
Nathan.fooo
9c0dffacef
feat: implement import notion zip file api endpoint ( #840 )
...
* chore: implement api endpoint
* chore: worker
* chore: async zip
* chore: test bulk insert
* chore: insert collab
* chore: custom task
* chore: consume un acked message
* chore: fix compile
* chore: add test
* test: update
* chore: save import record
* chore: save import record
* chore: fix ci
* chore: remove unused deps
* chore: update docker file
* chore: build worker images
* chore: use small int
* chore: use small int
* chore: rm protoc deps in runtime
* chore: move collab cache to database crate
* chore: update test
* chore: rm health api endpoint
* chore: clippy
* chore: update ci
* chore: add test
* chore: upgrade collab
* chore: clippy
* chore: update test
* chore: use custom host
* chore: config nginx
* chore: install cert
2024-10-03 22:22:29 +08:00
Zack Fu Zi Xiang
4345f8b2a5
chore: merge with main
2024-09-16 10:55:14 +08:00
Nathan.fooo
a4b885e13b
chore: set exp time for collab base on collab type ( #820 )
...
* chore: set exp time for collab base on collab type
* chore: fix test
2024-09-13 19:04:56 +08:00
Zack Fu Zi Xiang
922418b122
chore: merge with main
2024-09-12 10:09:42 +08:00
Zack Fu Zi Xiang
cff144a857
chore: add test for duplicating doc in database row
2024-09-11 16:38:24 +08:00
Nathan.fooo
7cd88b7502
fix: batch create collab api endpoint might cause tokio runtime issue ( #810 )
...
* fix: batch create collab api endpoint might cause tokio runtime issue
* chore: remove test
* chore: clippy
2024-09-11 11:32:42 +08:00
Zack Fu Zi Xiang
d1635cb99c
chore: add test
2024-09-06 15:30:28 +08:00
Nathan.fooo
5d356718fa
fix: using spawn_blocking in order to not block the runtime ( #793 )
...
* fix: using blocking in order to not block the runtime
* chore: increase deps count
2024-09-05 09:19:34 +08:00
Nathan.fooo
365c64c5c2
chore: use colla storage instead of select from db directly ( #782 )
2024-09-02 21:25:21 +08:00
Bartosz Sypytkowski
2af1999375
chore: added locks with timeouts ( #765 )
...
* chore: added locks with timeouts
* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
Lucas.Xu
e7bf221ff0
feat: update built-in README for new users ( #757 )
...
* feat: add getting_started, desktop_guide and mobile_guide json
* feat: update built-in readme data
* feat: support adding database as template
* feat: support creating nested documents
* chore: refactor code
* chore: refactor code
* chore: remove println
* chore: update collab version
* feat: update built-in readme and image ref
* chore: remove template icon
* feat: use database::create_with_view to create collab
* chore: add template tests
* chore: update collab version
* chore: remove debug code
* chore: add comment
* chore: fix lint & test
* fix: code review
* fix: rust lint
* chore: update comment
* test: add default workspace test
* test: add default user workspace test
* chore: use workspace database body
* chore: fix typo and clippy
* fix: insert_folder_data_success test
* fix: insert_folder_data_success test
* feat: update content in gettting_started
* chore: update to-dos json
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-08-28 19:40:23 +08:00
Bartosz Sypytkowski
15b2e81579
chore: enable setting up periodic sync step 1 sends from sync plugin ( #738 )
...
* chore: enable setting up periodic sync step 1 sends from sync plugin
* chore: rollback to server sending sync step 1 to response to the client
* chore: increase sync step 1 interval in tests
2024-08-27 11:55:27 +08:00
Bartosz Sypytkowski
ae3833ea91
chore: Remove last sync at ( #735 )
...
* chore: remove last sync at field
* chore: post rebase fixes
* chore: update test for missing update detection
2024-08-22 07:47:01 +08:00
Bartosz Sypytkowski
d503905931
chore: make sync plugin work over any collab type without generics
2024-08-14 14:42:12 +02:00
Bartosz Sypytkowski
ef860c2d5a
chore: fix cargo fmt and clippy errors
2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski
c27866fb25
chore: upgrade code to use asynchronous locks
2024-08-13 19:59:46 +02:00
Bartosz Sypytkowski
44406ccdae
chore: update yrs and appflowy-collab ( #677 )
...
* chore: update yrs and appflowy-collab
* chore: remove wasm compilation target
* chore: fixed number conversion in tests
* chore: remove wasm integration tests
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-07-10 10:10:07 +08:00
Bartosz Sypytkowski
a706c312b3
chore: making embeddings code compile
2024-06-28 05:40:41 +02:00
Nathan.fooo
4eb1e6bceb
chore: generate history using redis steam ( #570 )
...
* chore: combine test
* chore: add snapshot test
* chore: add test
2024-05-23 07:57:20 +08:00
Khor Shu Heng
67d9fad7d7
chore: migrate collab storage to appflowy-collaborate ( #566 )
...
* chore: migrate collab storage to appflowy-collaborate
* fix: clippy error
* chore: remove handler
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
Nathan.fooo
d994b10115
chore: appflowy ai client ( #547 )
...
* chore: appflowy ai client
* chore: clippy
* chore: clippy
* chore: fix ci
* chore: disable index search
2024-05-12 09:23:32 +08:00
Khor Shu Heng
d9d874ab8a
feat: migrate collab cache to collaborate service ( #524 )
...
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-09 23:12:13 +08:00
Nathan.fooo
388d38428b
chore: revamp post realtime endpoint ( #536 )
...
* chore: revamp post realtime endpoint
* chore: fix clippy
* chore: fix fmt
2024-05-08 22:06:37 +08:00
Nathan.fooo
70262a1ac4
chore: try to not block actor mailbox ( #534 )
...
* chore: add test
* chore: spawn task to handle message
* chore: update error message
2024-05-08 16:54:05 +08:00
Nathan.fooo
359433f14c
fix: pool timeout when there are too many put blob requests ( #533 )
...
* fix: pool timeout when there are too many put blob requests
* chore: fix clippy
* fix: dont use transaction while putting data
---------
Co-authored-by: Zack Fu Zi Xiang <speed2exe@live.com.sg>
2024-05-08 12:20:06 +08:00
Nathan.fooo
ef8e6f360f
chore: try to fix ws token error ( #530 )
...
* chore: try to fix ws token error
* chore: fix compile
* chore: bump version number
* chore: update
* chore: update
* ci: fix test
2024-05-07 16:45:12 +08:00
Khor Shu Heng
5dbb9d9c86
fix: make sure test for offline user connect then sync failed when one or more future task failed ( #525 )
2024-05-07 10:54:40 +08:00
Nathan.fooo
5bebc6a2b2
chore: Integrate appflowy ai ( #504 )
...
* chore: remove client api
* chore: add summarize row test
* chore: merge main
* chore: fix ci
* chore: update docker compose file
2024-04-29 22:23:40 +08:00
Nathan.fooo
7b4b9d0c10
chore: folder data check ( #496 )
...
* chore: folder data check
* chore: stop observe remote change when specific type of collaboration object override with incorrect data
* chore: commit sqlx file
2024-04-26 13:20:06 +08:00
Nathan.fooo
a0593b5502
chore: refactor return response with object id ( #494 )
...
* chore: refactor return response with object id
* chore: fix ci
* chore: fix ci
2024-04-24 12:07:54 +08:00
Nathan.fooo
842e3d14e5
chore: remove collab state check ( #487 )
...
* chore: remove collab ping
* chore: fix tst
* chore: cacel previous actiont
2024-04-22 11:56:22 +08:00
Nathan.fooo
970fbaed57
feat: using transaction to write multiple records ( #477 )
...
* chore: impl batch write
* chore: update test
* chore: using save point to optimize write
* chore: update docs
* chore: fix test
* chore: increase write speed
* chore: use redis sorted set
* chore: fallback to write to disk directly when fail to queue
* chore: fix test
* chore: fix test
* chore: update log
* chore: add metrics
2024-04-19 15:22:57 +08:00
Nathan.fooo
4168d72390
chore: using redis conn for each action ( #476 )
...
* chore: batch insert
* chore: opti redis conn
* chore: fix test
2024-04-17 11:41:50 +08:00
Nathan.fooo
f3279e9b4e
feat: implement grpc for history server ( #470 )
...
* ci: docker compose for ci
* chore: add test
* chore: imple grpc
* chore: fix test
* chore: fix ci
2024-04-16 14:10:56 +08:00
Nathan.fooo
3901356e8a
chore: bump collab version ( #471 )
2024-04-15 12:35:14 +08:00
Nathan.fooo
28e0e74fd1
feat: Implement history(1) ( #466 )
...
* chore: update collab commit
* chore: collab history test
* chore: collab history test
* chore: impl redis stream
* chore: impl redis stream test
* chore: impl migration
* chore: implement history sql
* chore: add test
* chore: add test
* chore: fix test
* chore: update log and test
* chore: add xtask
* chore: clippy
* chore: impl api
* chore: add missing sqlx files
* chore: fix test
* chore: fix test
2024-04-15 09:18:19 +08:00
Nathan.fooo
4d019728ba
refactor: insert encode collab object in redis ( #469 )
...
* chore: insert collab redis cache with timestamp
* chore: add test
* chore: update expire time
* chore: update
* chore: fix test
2024-04-13 22:31:36 +08:00
Nathan.fooo
e9097107e5
chore: Disable multi thread ( #458 )
...
* chore: disable multiple thread
* chore: clippy
2024-04-09 10:07:40 +08:00
