Merge pull request #409 from seasalt-ai/image-audio-message-wiki-pages

Add Pages for Image & Audio Messages

Author: xuchen

content/en/seachat/seachat-manual/08-incoming-queries/01-user-sends-an-image-message.md

@@ -0,0 +1,40 @@
+---
+title: "User Sends an Image Message"
+description: "Learn how SeaChat understands and responds to user uploaded image messages."
+lead: ""
+date: 2025-01-22T08:48:45+00:00
+lastmod: 2025-01-22T08:48:45+00:00
+weight: 30
+draft: false
+images: []
+toc: true
+url: /en/seachat/manual/incoming-queries/user-sends-an-image-message
+---
+
+# Overview
+
+Up to this point, you've likely only seen SeaChat respond to text-based user chat messages. However, SeaChat has the capability to handle multimedia messages, such as audio and image, as well! This makes interactions more flexible and convenient for users, enabling them to share content in various formats for richer communication. 
+
+---
+
+## Image Understanding
+
+When a user uploads an image, SeaChat analyzes it to generate a detailed textual description. This description serves as the foundation for SeaChat's response, ensuring that the AI’s reply is tailored to the visual content. The process is designed to make it easier for users to share visual information without needing to describe or re-type it themselves.
+
+> :bulb: **Note** 
+> This feature is only available to premium subscribers. For non-premium accounts, SeaChat will only know that the user uploaded an image, but will not have any insight on the content.
+
+### Example
+
+In the following example, a user chats with the Seasalt.ai bot via WebChat and uploads a screenshot of a webinar invite in their message to the agent. By analyzing the contents of the image, SeaChat is able to understand and respond to the user's message effectively (without the user having to re-type all the contents of the image).
+
+<br/>
+<center>
+<a href="/images/seachat/en/incoming-queries/SeaChat_Responds_to_Image_Message_Webchat.png" target="_blank">
+<img width="80%" style="border-radius: 0.4rem; cursor: zoom-in;" src="/images/seachat/en/incoming-queries/SeaChat_Responds_to_Image_Message_Webchat.png" alt="SeaChat is able to understand and respond to a user-uploaded image message in WebChat.">
+</a>
+
+*Sending an Image Message to SeaChat*
+</center>
+
+<br/>

content/en/seachat/seachat-manual/08-incoming-queries/02-user-sends-an-audio-message.md

@@ -0,0 +1,37 @@
+---
+title: "User Sends an Audio Message"
+description: "Learn how SeaChat understands and responds to user uploaded audio messages."
+lead: ""
+date: 2025-01-22T08:48:45+00:00
+lastmod: 2025-01-22T08:48:45+00:00
+weight: 30
+draft: false
+images: []
+toc: true
+url: /en/seachat/manual/incoming-queries/user-sends-an-audio-message
+---
+
+# Overview
+
+Up to this point, you've likely only seen SeaChat respond to text-based user chat messages. However, SeaChat has the capability to handle multimedia messages, such as audio and image, as well! This makes interactions more flexible and convenient for users, enabling them to share content in various formats for richer communication. 
+
+---
+
+## Audio Understanding
+
+Some channels, such as Messenger, WhatsApp, and Line, allow users to send audio messages. SeaChat uses speech-to-text technology to convert the audio message into text, which is then processed as the user’s input. This feature ensures that even spoken messages can receive accurate and relevant responses from SeaChat. For users, this adds a layer of convenience, enabling hands-free communication in situations where typing might be difficult or less efficient.
+
+### Example
+
+In the following example, a user chats with the Seasalt.ai bot on WhatsApp and uses the "Voice Note" feature to send an audio message to the agent. By transcribing the audio first with speech-to-text, SeaChat is able to understand and respond to the audio message.
+
+<br/>
+<center>
+<a href="/images/seachat/en/incoming-queries/SeaChat_Responds_to_Voice_Message_WhatsApp.jpg" target="_blank">
+<img width="80%" style="border-radius: 0.4rem; cursor: zoom-in;" src="/images/seachat/en/incoming-queries/SeaChat_Responds_to_Voice_Message_WhatsApp.jpg" alt="Using speech-to-text SeaChat is able to understand and respond to a user-uploaded audio message in WhatsApp.">
+</a>
+
+*Sending an Audio Message to SeaChat*
+</center>
+
+<br/>

content/en/seachat/seachat-manual/08-incoming-queries/_index.md

@@ -0,0 +1,9 @@
+---
+title: "Incoming Queries"
+description: "Incoming Queries"
+date: 2025-01-22T08:48:57+00:00
+lastmod: 2025-01-22T08:48:57+00:00
+draft: false
+images: []
+weight: 200
+---