Nathan.fooo
ef40f8faa4
chore: adjust chunk size ( #1334 )
...
* chore: adjust chunk size
* chore: deduplcate search results
* chore: fix test
* chore: update logs
* chore: separate search and summary
* chore: fix test
2025-04-12 22:22:17 +08:00
Nathan.fooo
c76d2f0b4b
feat: summary search result ( #1326 )
...
* chore: summary search result
* chore: add test
* chore: clippy
* chore: distance and score
* chore: update test and clarify score and distance
* chore: fix test
* chore: model env
2025-04-11 20:30:11 +08:00
Nathan.fooo
3e65dd1014
add docs and tests for embedding related ( #1328 )
...
* chore: add docs and tests
* chore: add test
* chore: fix typo
* chore: clippy
2025-04-10 23:12:53 +08:00
Nathan.fooo
3181b17d60
chore: set deployment id for azure embedding ( #1322 )
...
* chore: fix audit
* chore: update audit config
* chore: fix azure embedding
* chore: adjust ai config
* fix: do not generate embedding when all chunk content is empty
2025-04-07 14:44:22 +08:00
Nathan.fooo
2c1c820e68
chore: support azure open ai ( #1321 )
2025-04-06 19:11:40 +08:00
Bartosz Sypytkowski
1fd900d994
Document paragraphs ( #1119 )
...
* chore: create embeddings by paragraphs
* chore: use document paragraphs method
* chore: document indexing by paragraphs with consistent hash
* chore: compare produced embeddings against existing ones
* chore: make pg stored proc compare between input and existing embedded fragments
* chore: missing sqlx generation
* fix: appflowy worker
* chore: make sure that embeddings are only changed when content had changed
* chore: remove partition key and recreate af_collab_embeddings_upsert migration
* chore: use pg15 on CI and update af_collab_embeddings table primary key
* chore: fix test
---------
Co-authored-by: Nathan <nathan@appflowy.io>
2025-04-06 17:47:02 +08:00
Bartosz Sypytkowski
eaee9d3317
chore: cargo clippy fix
2025-04-01 08:22:36 +02:00
Bartosz Sypytkowski
576f1654cf
chore: post cargo rebase fixes
2025-04-01 08:22:36 +02:00
Bartosz Sypytkowski
ec45ef23fe
chore: first phase of tests
2025-04-01 08:22:36 +02:00
Bartosz Sypytkowski
1db7cb36e0
chore: cargo clippy fix
2025-04-01 08:22:36 +02:00
Bartosz Sypytkowski
b8942c168e
chore: working on uuids
2025-04-01 07:42:13 +02:00
Bartosz Sypytkowski
a5d6cc0a59
chore: passed through first circle of hell
2025-04-01 07:42:13 +02:00
Bartosz Sypytkowski
4c9dd9eaf1
chore: working on query conversions
2025-04-01 07:42:13 +02:00
khorshuheng
9c435d9016
feat: add favorite reorder API
2025-03-24 12:55:22 +08:00
khorshuheng
d9d511be99
chore: remove unnecessary package as reported by cargo machete
2025-02-17 16:26:01 +08:00
Nathan.fooo
b47a635cfc
chore: support async embed ( #1139 )
2025-01-08 16:37:17 +08:00
Nathan.fooo
3ee52ad8d0
chore: fix private open api key in config ( #1112 )
...
* chore: fix private open api key in config
* chore: fmt
2025-01-02 13:03:01 +08:00
Nathan.fooo
327ba7157e
chore: save fragment index ( #1106 )
2024-12-31 10:03:36 +08:00
Bartosz Sypytkowski
c94938ee46
chore: fix clippy errors
2024-12-27 07:52:10 +01:00
khorshuheng
824d60920d
Merge branch 'main' into stateless
2024-12-26 11:55:52 +08:00
Nathan.fooo
c80491267b
chore: update metrics and num threads ( #1102 )
2024-12-26 11:55:54 +08:00
nathan
1a5c1714db
Merge branch 'main' into stateless
2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn ( #1099 )
...
* chore: batch index
* chore: format log
* chore: index workspace
* chore: fix stack overflow
* chore: background index
* chore: clippy
* chore: filter tasks
* chore: clippy
* chore: add metrics
* chore: fix test
2024-12-24 14:30:17 +08:00
