Function calling (#996)

* Initial work on function calling

* wip

* Add websearch as a tool

* lint

* smol

* Move tools to their own files

* directly answer check

* Add text2img tool

* group tool calls together

* show retry even if no message

* fix trailing urls

* Add image popup

* format

* wip

* clean-up

* better loading indicator

* text colors

* extra example to summarize

* switch default model

* Add fetchUrl tool

* wip

* Add latest gradio

* fix types

* version bump sharp

* Basic tools menu

* working menu

* fix menu positioning

* deps fix

* add deps

* cleanup

* more cleanup

* cleanup

* package cleanups

* moar cleanup

* ui update

* Update ChatMessage.svelte

* upgrade gradio dep

* lint

* refactor and pass results to cohere

* feat: code interpreter tool

* fix: add e2b dependency

* feat: working TGI endpoint with tool results

* feat: allow image model to expand to 90dvw

* fix: dont block on title gen

* bump sharp

* misc cleanup

* fix url fetcher, adjust tool typing

* migrate to new MessageUpdate schema

* fix lint errors

* image editing, pdf upload + parsing

* feat: file preview for non-images

* feat: image prompting, file ui, file migration, many fixes

* feat: multiple files and tool file indices

* feat: add back remote keylogging prevention

* minor nit

* minor

* resolve nits

* feat: use node vm for calculator and improve prompt

* more nits

* feat: add index to tools settings

* chore: update invalid package lock

* feat: bump gradio client to 0.19.4

* feat: move pdf to markdown to huggingchat

* fix: uploaded file width

* feat: prompt the model when no files available

* Feat functions: UI update (#1157)

* details: close on click outside

* drag for tools

* tools ordering

* add link to community discussion

* misc

* calculator listed as last

* file style

* images with different ratios

* page scraper: longer timeout

@Saghen @mishig25 seems to work better with this

* vertical gap

* Revert "drag for tools"

This reverts commit 8eeed3b.

* chat padding on desktop

* file colors

* larger gap for all messages on xl screens

* feat: update pdf to markdown schema

* fix: uploaded file container width

* fix: tool name check

* fix: cohere endpoint

* fix: use most recent message for files

* feat: allow tools to access previous files

* feat: support all file types on document parser

* fix: use document parser in default tools

* feat: rename url fetcher internal name

* feat: resolve type error

* feat: enable tools on prod command r+

* feat: truncate document markdown

* feat: bump @huggingface/inference

* feat: resolve type errors

* nit

* Feat functions misc update 2 (#1158)

* update examples

a

* add tool indicator

* llama 3 description update

* image quick fix

* mobile

* icon purple

---------

Co-authored-by: Victor Mustar <[email protected]>
Co-authored-by: Liam Dyer <[email protected]>
Co-authored-by: Mishig <[email protected]>

Author: 4 people

.env

@@ -154,6 +154,7 @@ WEBHOOK_URL_REPORT_ASSISTANT=#provide webhook url to get notified when an assist
 ALLOWED_USER_EMAILS=`[]` # if it's defined, only these emails will be allowed to use the app
 
 USAGE_LIMITS=`{}`
+
 ALLOW_INSECURE_COOKIES=false # recommended to keep this to false but set to true if you need to run over http without tls
 METRICS_PORT=
 LOG_LEVEL=info

.eslintrc.cjs

@@ -24,7 +24,7 @@ module.exports = {
 		extraFileExtensions: [".svelte"],
 	},
 	rules: {
-		"no-shadow": ["error"],
+		"require-yield": "off",
 		"@typescript-eslint/no-explicit-any": "error",
 		"@typescript-eslint/no-non-null-assertion": "error",
 		"@typescript-eslint/no-unused-vars": [