Nathan.fooo
c80491267b
chore: update metrics and num threads ( #1102 )
2024-12-26 11:55:54 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn ( #1099 )
...
* chore: batch index
* chore: format log
* chore: index workspace
* chore: fix stack overflow
* chore: background index
* chore: clippy
* chore: filter tasks
* chore: clippy
* chore: add metrics
* chore: fix test
2024-12-24 14:30:17 +08:00
Nathan.fooo
381b02a4d0
chore: disable batch index ( #1098 )
2024-12-23 00:04:25 +08:00
Zack
5ea714b004
Merge pull request #1092 from AppFlowy-IO/feat/update-collab
...
chore: update collab
2024-12-20 20:54:10 +08:00
Zack Fu Zi Xiang
cafff8098b
chore: update dockerfile rust version
2024-12-20 17:10:42 +08:00
Nathan.fooo
46f9c7811f
chore: return unindex collab one by one ( #1095 )
...
* chore: return unindex collab one by one
* chore: clippy
2024-12-20 15:14:47 +08:00
Zack Fu Zi Xiang
6f98894c6f
chore: version update to resolve sec issue
2024-12-20 09:37:25 +08:00
Nathan.fooo
1614474c2d
chore: check collab type before index ( #1093 )
2024-12-19 22:03:10 +08:00
Nathan.fooo
e758f18d75
chore: add metadata column to save embeding info ( #1086 )
2024-12-18 22:48:25 +08:00
Khor Shu Heng
6fa6fa00cb
chore: refactor page view APIs to write to in-memory collab group ( #1083 )
2024-12-18 22:47:25 +08:00
Nathan.fooo
5f388c7432
chore: add metrics for write embeeding to pg ( #1084 )
2024-12-18 17:03:38 +08:00
Nathan.fooo
abf827f2a6
chore: query multiple collab embedding state ( #1081 )
...
* chore: query multiple collab embedding state
* chore: clippy
2024-12-17 23:23:43 +08:00
Zack
06dc3b3a00
feat: add option for tls mailer ( #1078 )
2024-12-17 13:53:32 +08:00
Nathan.fooo
ec9c38254b
chore: open ai call directly ( #1074 )
...
* chore: use open ai embedding
* chore: update test
* chore: retry
* chore: metrics
* chore: clippy
* chore: env
* chore: delete test
2024-12-15 23:29:46 +08:00
Nathan.fooo
2ab1e94b99
chore: create embed in background ( #1071 )
...
* refactor: create indexer scheduler
* refactor: replace current calls
* chore: use rayon thread pool
* chore: index unindexed collab using thread pool
* chore: index collab when write to disk
* chore: add test
* chore: add test
* chore: add test
* chore: fix client api deps
* chore: chat with document test
* chore: fix test
* chore: clippy
* chore: update test
2024-12-15 12:29:51 +08:00
Nathan.fooo
a549364fc9
chore: support insert space between delta ( #1069 )
2024-12-14 10:38:39 +08:00
Nathan.fooo
af38efe6d9
feat: sync document through http request ( #1064 )
...
* chore: query embedding
* chore: create embeddings
* chore: apply update to editing collab
* refactor: web-update
* chore: calculate missing update the sv is not none
* chore: add test
* chore: fix audit
* chore: commit sqlx
* chore: fix client api
* test: add
* chore: clippy
* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Bartosz Sypytkowski
cdf98d1a83
chore: add logging for reindexing docs after restart ( #1056 )
2024-12-11 17:17:29 +08:00
Zack
254bc23a6e
feat: insert database row into selected database ( #1029 )
...
* feat: insert database row into selected database
* feat: inserting database row
* feat: add impl for cell
* feat: insert row selection and mulitselection
* feat: support datetime field type
* fix: other fields like rich text
* feat: add database field server impl
* feat: add client api and tests
* feat: use to json value impl from collab
* feat: use add database cell impl from collab
* feat: update to latest collab
* chore: upgrade collab and fix tests
* chore: review issues
* fix: code review feedback
* feat: filter only allow supported field types
* feat: support more field types
* feat: support created at and last modified
* feat: add timestamp cell for created at and modified at fields
* chore: linting and formatting
* fix: add created at and last modified
* fix: ci add service dependency of appflowy cloud on admin frontend
* chore: trigger ci
* feat: add logging for admin frontend client signin
* fix: server logs if error
* fix: create admin confirmation without email
* fix: ci add service dependency of appflowy cloud on admin frontend
* fix: server logs if error
* chore: update collab
2024-12-11 15:47:29 +08:00
khorshuheng
719b95b94a
chore: update validator crate
2024-12-11 12:33:46 +08:00
Bartosz Sypytkowski
c4514ca5bf
chore: add explanation
2024-12-10 10:12:33 +01:00
Bartosz Sypytkowski
9971c23749
fix: update redis cache when inserting collabs in batches
2024-12-10 10:07:54 +01:00
Bartosz Sypytkowski
813179fdb0
chore: Remove async awaits from RealtimeServerActor ( #1059 )
...
* chore: reduce number of async await methods in connection manager
* chore: remove async handlers from rt actor
2024-12-10 15:20:28 +08:00
Khor Shu Heng
29cb70a362
fix: synchronization issue due to incorrect collab origin ( #1054 )
2024-12-09 14:19:00 +08:00
Nathan.fooo
a598aed5ec
chore: remove empty map when query is empty ( #1050 )
2024-12-07 10:20:53 +08:00
Bartosz Sypytkowski
66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics ( #1045 )
...
* chore: move collab cache for appflowy collaborate service and add metrics
* chore: add histogram for measuring time spent in postgres transactions
* chore: delete blobs in chunks
* chore: bring back redis cache filling by import worker
* chore: cargo fmt
* chore: make import workspace update existing collabs
* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Nathan.fooo
ee87bb9bd6
chore: setup tokio console ( #1046 )
...
* chore: setup tokio console
* chore: setup tokio console
* chore: clippy
* chore: clippy
2024-12-06 11:33:04 +08:00
Khor Shu Heng
f79042fcc5
Merge pull request #1043 from AppFlowy-IO/web-update-fix
...
fix: web update should update both disk and mem cache
2024-12-06 10:44:52 +08:00
Nathan.fooo
afcd1130c3
feat: chat settings ( #1044 )
...
* feat: chat settings
* chore: fix sqlx
2024-12-05 23:30:11 +08:00
khorshuheng
aa64b7cd6b
fix: web update should update both disk and mem cache
2024-12-05 16:51:56 +08:00
Bartosz Sypytkowski
51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable ( #1035 )
2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache ( #1028 )
...
* chore: collab cache for S3
* chore: adjust disk cache api to accomodate s3
* chore: move postgres dependent ops to disk cache
* chore: replace blob inserts from pg to s3
* chore: delete blob and collab exist now use s3
* chore: fix clippy erorrs
* chore: post rebase fixes
* chore: fix clippy warnings
* chore: fix imports
* chore: make snapshots work over S3
* chore: remove dead code
* chore: use compressed snapshots
* chore: add zstd compression
* chore: introduce collab size threshold to keep smaller collabs in postgres
* chore: remove collabs from S3 if they were put to postgres
* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo
3e3bf693fd
chore: upload api endpoint for web upload ( #1024 )
...
* chore: upload api endpoint for web upload
* chore: use rust 1.78
* fix: test
2024-11-28 09:09:09 +08:00
Bartosz Sypytkowski
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab ( #1022 )
...
* chore: reduce number of SQL statements executed when inserting new collab
* chore: add workspace id check
* chore: fix previous query
* chore: upsert collabs and embddings as stored procedures
* chore: fix clippy errors
* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
Nathan.fooo
0ec12c5f2f
chore: add file size ( #1015 )
2024-11-22 16:31:50 +08:00
Nathan.fooo
1e18180e9d
chore: set max import zip file size ( #1011 )
...
* chore: set max import zip file size
* chore: fix test
2024-11-20 14:07:36 +08:00
Nathan.fooo
fd98351473
chore: adjust redis env ( #1003 )
2024-11-17 14:26:59 +08:00
Bartosz Sypytkowski
3799966f12
chore: store pending collab writes in memory ( #1000 )
...
* chore: write immediatelly actually writes immediatelly
* chore: fix clippy errors
* chore: add metrics to new storage queue impl
* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
Nathan.fooo
d798c81ba4
chore: support split by text len ( #1002 )
...
* chore: support split by text len
* chore: update docs
* chore: update tests
2024-11-17 12:45:20 +08:00
Nathan.fooo
dcbc84dacc
chore: recreate group if it isn't exist ( #1001 )
2024-11-17 12:14:50 +08:00
Nathan.fooo
655f13bc27
chore: search and chat ( #999 )
...
* chore: add test for search and chat
* chore: update test
* chore: update test
* chore: update ci
* chore: fix security audio
* chore: multiple core docker build
* chore: multiple core docker build
* chore: update ci
* chore: update model setting
* chore: test ci
* chore: use tiktoken to calcualte token length
* chore: remove env
* chore: use spawn_blocking with condition
* chore: docs
* chore: clippy
* chore: clippy
* chore: docker logs
* chore: pass message id
* chore: clippy
2024-11-16 14:52:12 +08:00
Khor Shu Heng
d0c212ff10
refactor: remove enforcer group ( #948 )
2024-11-15 14:08:12 +08:00
nathan
b10a0e7829
chore: fix typo
2024-11-15 13:45:25 +08:00
Nathan.fooo
97f9ff3dd8
fix: byte index 8000 is not a char boundary ( #995 )
...
* chore: fix split text boundary error and add related tests
* chore: reduce clone
2024-11-15 13:38:08 +08:00
Zack
d8075a9368
Merge pull request #994 from AppFlowy-IO/fix/smtp-email-username
...
feat: separate smtp username from email
2024-11-14 22:00:43 +08:00
Zack Fu Zi Xiang
4b2eb1b1ba
feat: separate smtp username from email
2024-11-14 16:00:15 +08:00
Nathan.fooo
06a6ea2985
chore: retry upload file when get s3 service error ( #993 )
...
* chore: retry upload file when get s3 service error
* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Bartosz Sypytkowski
f6fef9918b
chore: split document content into multiple embeddings ( #990 )
...
* chore: split document content into multiple embeddings
* chore: fallback to uuid v4 generation due to unmaintained transient dependency
* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Nathan.fooo
50d519c4ea
fix: upload file zip file expire ( #987 )
2024-11-13 14:57:27 +08:00
Nathan.fooo
91b0c50722
chore: remove logs ( #986 )
2024-11-13 13:59:23 +08:00
