Commit graph

59 commits

Author SHA1 Message Date
Nathan.fooo
6c6f1c5cc3
Local chat (#1347)
* chore: support local chat

* chore: support local chat

* chore: docs

* chore: fmt

* chore: fmt

* chore: fix test
2025-04-18 14:37:21 +08:00
Nathan.fooo
9ea3c46c26
chore: return highlight search content (#1340) 2025-04-15 16:39:48 +08:00
Nathan.fooo
00b08f8d48
chore: return search sumamry with source id (#1336)
* chore: return search sumamry with source id

* chore: clippy
2025-04-14 14:47:07 +08:00
Nathan.fooo
ef40f8faa4
chore: adjust chunk size (#1334)
* chore: adjust chunk size

* chore: deduplcate search results

* chore: fix test

* chore: update logs

* chore: separate search and summary

* chore: fix test
2025-04-12 22:22:17 +08:00
Nathan.fooo
c76d2f0b4b
feat: summary search result (#1326)
* chore: summary search result

* chore: add test

* chore: clippy

* chore: distance and score

* chore: update test and clarify score and distance

* chore: fix test

* chore: model env
2025-04-11 20:30:11 +08:00
Nathan.fooo
3181b17d60
chore: set deployment id for azure embedding (#1322)
* chore: fix audit

* chore: update audit config

* chore: fix azure embedding

* chore: adjust ai config

* fix: do not generate embedding when all chunk content is empty
2025-04-07 14:44:22 +08:00
Bartosz Sypytkowski
1fd900d994
Document paragraphs (#1119)
* chore: create embeddings by paragraphs

* chore: use document paragraphs method

* chore: document indexing by paragraphs with consistent hash

* chore: compare produced embeddings against existing ones

* chore: make pg stored proc compare between input and existing embedded fragments

* chore: missing sqlx generation

* fix: appflowy worker

* chore: make sure that embeddings are only changed when content had changed

* chore: remove partition key and recreate af_collab_embeddings_upsert migration

* chore: use pg15 on CI and update af_collab_embeddings table primary key

* chore: fix test

---------

Co-authored-by: Nathan <nathan@appflowy.io>
2025-04-06 17:47:02 +08:00
Bartosz Sypytkowski
539cc5d536 chore: fix folder view id assertion 2025-04-01 08:22:36 +02:00
Bartosz Sypytkowski
6d2e8b7164 chore: cargo clippy fix 2025-04-01 08:22:34 +02:00
Bartosz Sypytkowski
d02b1123e1 chore: fixed test compilation errors 2025-04-01 08:19:42 +02:00
Bartosz Sypytkowski
f6060cb82d chore: moving string to uuid in tests 2025-04-01 08:18:12 +02:00
Nathan.fooo
dfd44f8fb7
Support stream model (#1290)
* chore: log stream error

* chore: support stream with model
2025-03-23 22:51:41 +08:00
Nathan.fooo
9587c0680f
chore: add custom prompt test (#1284) 2025-03-20 09:51:01 +08:00
Nathan.fooo
a2c10d60d6
chore: support streaming v2 (#1279) 2025-03-18 11:30:57 +08:00
Nathan.fooo
06ddd7f755
chore: generate ai image if need (#1254)
* chore: generate ai image

* chore: fix test
2025-02-26 22:54:03 +08:00
Nathan.fooo
18b1386bc2
chore: return model list (#1206) 2025-02-01 12:45:20 +08:00
Nathan.fooo
b650e9e5fb
chore: ai writer (#1153)
* chore: ai writer

* chore: update test

* chore: update test

* chore: set env

* chore: rename

* chore: format nginx conf
2025-01-12 23:07:31 +08:00
Nathan.fooo
527d91d069
chore: remove unused ai api endpoint (#1149) 2025-01-11 16:29:42 +08:00
Nathan.fooo
ee84464e82
chore: store blob file status (#1147)
* chore: store blob file status

* chore: fmt

* chore: fmt
2025-01-10 14:52:35 +08:00
Nathan.fooo
2f25a56f8c
test: update generate image in chat test (#1145) 2025-01-09 14:16:28 +08:00
Nathan.fooo
2bd6da228d
chore: chat stream timeout (#1137)
* chore: increase timeout

* chore: keepalive event
2025-01-08 01:11:25 +08:00
Nathan.fooo
9f16d040b5
chore: fix flaky test (#1135) 2025-01-07 15:12:37 +08:00
Nathan.fooo
49e83c6b6b
chore: format chat response (#1125)
* chore: chat response with format

* chore: update prompt

* chore: update test

* chore: update test

* chore: fix stress test

* chore: fix test

* chore: test

* chore: test

* chore: fix stress test

* chore: fix test
2025-01-06 01:19:00 +08:00
Nathan.fooo
a4490b96c6
chore: fix flaky test (#1094) 2024-12-19 22:16:09 +08:00
Richard Shiue
ecadf8e287
chore: find question message from reply message (#1085)
* chore: find question message from answer message id

* chore: sqlx

* test: fix tests

* test: fix test

* chore: apply code suggestions to 2 files
2024-12-19 00:12:53 +08:00
Nathan.fooo
abf827f2a6
chore: query multiple collab embedding state (#1081)
* chore: query multiple collab embedding state

* chore: clippy
2024-12-17 23:23:43 +08:00
Nathan.fooo
91c2a925bc
test: add test (#1077) 2024-12-16 16:19:41 +08:00
Nathan.fooo
ec9c38254b
chore: open ai call directly (#1074)
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
2024-12-15 23:29:46 +08:00
Nathan.fooo
2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Nathan.fooo
afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
Nathan.fooo
14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Nathan.fooo
a3a581ea4e
chore: fix import test (#941)
* chore: fix import test

* chore: enable test

* chore: fix build

* chore: update test
2024-10-31 15:18:30 +08:00
Nathan.fooo
860a921ea5
chore: remove inline view id (#945)
* chore: remove inline view id

* test: fix test compile

* chore: logs

* chore: update test
2024-10-30 12:47:15 +08:00
Nathan.fooo
f74757e41a
chore: remove deprecate chat api endpoint and update tests (#922)
* chore: remove deprecate chat api endpoint and update tests

* chore: fix test

* chore: clippy
2024-10-24 16:46:41 +08:00
Nathan.fooo
2f715c3136
feat: custom completion prompt (#906)
* feat: custom completion prompt

* chore: custom prompt
2024-10-20 14:27:41 +08:00
Nathan.fooo
a4b885e13b
chore: set exp time for collab base on collab type (#820)
* chore: set exp time for collab base on collab type

* chore: fix test
2024-09-13 19:04:56 +08:00
Nathan.fooo
71d292ebcd
chore: add app version when querying ai configuratino (#724)
* chore: update api endpoint that accepts app version

* chore: update env

* chore: disable locai ai config test
2024-08-13 11:14:32 +08:00
Nathan.fooo
7878a018a1
chore: Update index content api (#723)
* chore: support index pdf file

* chore: fix compile

* chore: fix test
2024-08-12 15:10:49 +08:00
Nathan.fooo
0b3949152b
feat: support chat with markdown (#718)
* chore: store metatdata

* chore: support markdown

* chore: update test
2024-08-08 13:19:19 +08:00
nathan
54dea523e6 chore: fix test 2024-08-05 23:23:06 +08:00
Nathan.fooo
a371912c61
chore: enable chat with provided context (#713)
* chore: enable chat with provided context

* chore: rename

* chore: update create chat message api endpoint

* chore: use list context

* chore: use list context

* chore: fix test

* chore: update api endpoint

* chore: rename client api function

* chore: rename client api function

* chore: expose entity

* chore: update sqlx files

* chore: update test
2024-08-05 14:06:44 +08:00
Nathan.fooo
eebdbcad79
chore: add api endpoint for local ai config (#678)
* chore: add api endpoint for local ai config

* chore: fix ci

* chore: api endpoint for download local ai config

* chore: update ci

* chore: ensure client version

* chore: update test
2024-07-15 08:30:11 +08:00
Nathan.fooo
cd8b33cc93
chore: use open ai model (#679) 2024-07-09 20:45:56 +08:00
Nathan.fooo
9884d93aa2
chore: rename function and add docs (#663) 2024-06-28 13:43:58 +08:00
Nathan.fooo
c0937bfbeb
feat: support switch model (#641)
* feat: support switch model
2024-06-22 15:01:33 +08:00
Nathan.fooo
430e3e15c9
fix: chat stream (#620)
* chore: fix chat stream
2024-06-13 22:46:49 +08:00
Nathan.fooo
d0467e7e2e
feat: Stream chat message (#610)
* chore: test stream

* chore: fix test

* chore: fix test

* chore: add log

* chore: fix parsing

* chore: fix parsing

* chore: fix parsing

* chore: create answer

* chore: create answer
2024-06-08 22:51:19 +08:00
Nathan.fooo
56b5c4c843
chore: disable old version history test (#604) 2024-06-04 20:41:31 +08:00
Nathan.fooo
093c3ef430
fix: disable ai message test (#600) 2024-06-04 16:52:14 +08:00
Nathan.fooo
50ff40f9d1
chore: add ai completoin scope (#599)
* chore: add ai completoin scope

* chore: fix ci to run test
2024-06-04 10:49:28 +08:00