# 2025 Gooey.AI AI Agent Update

<figure><img src="https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FEOWUxAG8SlFjLIzbtXbp%2Fcopilotupdates2025.png?alt=media&#x26;token=e4c5f1cc-7777-4e3b-893c-e7afc2520afa" alt=""><figcaption></figcaption></figure>

Gooey.AI’s AI agent is used by thousands of global frontline workers - including HVAC technicians, teachers, farmers, and nurses. Here are our latest features designed for organizations to empower their frontline and measure how well AI extends their mission.

## TL;DR <a href="#id-56ru65ui12bg" id="id-56ru65ui12bg"></a>

* [Broader frontler model support](#km2uehh7lkj4) - Deepseek, GPT4o, o1, o3, Mistral 3 small, Gemini 2.
* Agentic Function Calling
  * [Secure Connections to external systems with functions and secrets](#id-6x82k1nxyjml)
  * [Web search](#id-7docm1tuljgs) to look up real-time data like market prices or the weather
  * Real-time code creation and execution for trusted calculations, file conversions, etc
* Knowledge Base Improvements
  * [Faster responses with Cache Settings](#nvnbunb9tytt)
  * [Securely connect](#km2uehh7lkj4) to live Microsoft Office365 and Google Drive spreadsheets, PPTX, PPT, and slides
  * [Broad speech recognition and translation support](#qrrdzvs8l4bg)
* [WhatsApp improvements](#ywwrkjh5gdx)
  * Button support, Voice note support, Real-time web search, Location support, and more
* [Web-Widget](#id-2cbxbzv7ayw1)
  * Preview Pane - shows page-level citations to PDFs side-by-side with the chat to help frontline workers verify answers from your custom knowledge base.
  * Built-in Photo & Audio inputs
  * Link as a stand-alone page or embed
* [Analysis](#els4jzsxj6j9) - push daily stats via cron jobs, create customized structured insights

## Long Version <a href="#id-2ov2pvbi3icz" id="id-2ov2pvbi3icz"></a>

### Support for all the latest models <a href="#id-2o6tlidzscbp" id="id-2o6tlidzscbp"></a>

We have added support for Deepseek, OpenAI o3, Gemini 2, GPT-4o, GPT-4o-mini, LLAMA 3.3, o1 preview, and o1 preview mini and smaller local fine-tuned models like Sarvam 2B, SEA-Lion, and AfroLLAMA.

### Functions and Secrets <a href="#id-6x82k1nxyjml" id="id-6x82k1nxyjml"></a>

* Gooey.AI Functions adds the power of JavaScript to any of your AI Workflows through
* Now you can store SECRETS in your[ API Keys tab](https://gooey.ai/account/api-keys/) in the Accounts Page. This will allow you to use external services with sandboxed Functions. \[add examples links]
* Two amazing updates from this update include LLM-based code writing and execution and Web Search.

#### Web search & Code writing and execution <a href="#id-7docm1tuljgs" id="id-7docm1tuljgs"></a>

* In this example, we use Google search via API which calls two searches:
  * The length of the Pont d’Arc
  * The speed of a cheetah
* Based on the question and the information from Google, the LLM creates the Javascript function and runs it in our sandbox.

<https://gooey.ai/copilot/base-copilot-w-search-rag-code-execution-v1xm6uhp/>

![](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FrJrgvQOj4MdB4kU9TiUH%2F0.png?alt=media)

### WhatsApp improvements <a href="#ywwrkjh5gdx" id="ywwrkjh5gdx"></a>

We’ve implemented a number of improvements to our Whatsapp deployment. Including:

* Follow up questions as Button - now everyone can support perplexity like experience on WhatsApp, with auto-suggested follow-up questions. A huge win for user engagement!
* Voice note support
* Real-time web search

![Screenshot of Voice Support with Web search](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FHqryGGJt0JukXVMr9HY8%2F1.png?alt=media) ![Screenshot of Auto Suggested Follow up buttons](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FKJmiMDsLPJBNbQUJinPZ%2F2.png?alt=media)

* Citation support
* Thumbs Up / Down Support - Incredibly useful to help your team identify where your agent is not meeting user expectations.

![Screenshot of Citation Support](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2F5xJHaaWMvWBSyrwFdUbb%2F3.png?alt=media) ![Screenshot of Citation Support with Feedback Button](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FspIEvgPUqKtmrqVebvMv%2F4.png?alt=media)

* Location - AI agents can request the user’s location and our integration will show the native WhatsApp UI to allow the user to share their location
* Inline Images
* Document uploads - upload a PDF or CSV and will scan or parse it and enable the user to read it

### Cache <a href="#nvnbunb9tytt" id="nvnbunb9tytt"></a>

* Now you can set your Cache Settings for your knowledge base. Cached knowledge means our responses are under 5 seconds even with thousands of knowledge base PDFs, Google Docs, or PPTs
* If your agent has documents that need to be regularly updated keep “Always Check for Updates” on. However, this will come at the cost of increased latency
* By default, we don’t keep this setting on. Find it under Settings > Cache

![](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FnSSItToAjB7g53XNDRwi%2F5.png?alt=media)

You can see our test run for with and without Caching.

<https://gooey.ai/bulk/caching-test-gooey-bot-bulk-run-hgpr7muqblun/>

![Lower is better in the chart above](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2F4nq5aG8wA34RKm2Y8B6h%2F6.png?alt=media)

### Wider support for knowledge-base documents <a href="#km2uehh7lkj4" id="km2uehh7lkj4"></a>

* In addition to supporting basic documents like PDF, .txt, and CSV, we offer support for links from Google Drive (including entire folders!).
* We’ve also added PPTX support for those in the MS Office Suite ecosystem!
* OneDrive support comes very soon!

### ASR support (for broadest language support) <a href="#qrrdzvs8l4bg" id="qrrdzvs8l4bg"></a>

We now offer ASR support for 16 models. The MMS model alone can identify 4000 languages.

1. Whisper Large v2
2. Whisper Large v2 Hindi fine-tuned
3. Whisper Large v2 Telugu fine-tuned
4. Whisper Large v3
5. Whisper Large v3 Chichewa fine-tuned
6. GPT-4o Audio
7. Conformer Hindi (ai4bharat.org)
8. Conformer English (ai4bharat.org)
9. Vakyansh Bhojpuri (EkStep)
10. Google Cloud v1
11. Chirp / USM (Google Cloud v2)
12. Deepgram
13. Azure Speech
14. Seamless M4T v2 (Meta AI)
15. Massively Multilingual Speech (Meta AI)
16. GhanaNLP ASR v2

### Web widget <a href="#id-2cbxbzv7ayw1" id="id-2cbxbzv7ayw1"></a>

Don’t miss our shiny new “Sources” preview in the Gooey.AI AI agent Web Widget. Our web widget shows all this as web pages or embedded documents inside the Chat Widget. The Preview pane allows easy inspection of sources and increases the credibility of AI agent sources.

### ![](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2F6q10hqOWYDmQNcKdqmEV%2F7.gif?alt=media) <a href="#ojlgo8wtfy1m" id="ojlgo8wtfy1m"></a>

* You can use the built-in Photo & Audio inputs, which allow users to share photo-based queries and voice notes.
* Link as a stand-alone page or embed

### Analysis <a href="#els4jzsxj6j9" id="els4jzsxj6j9"></a>

* Integrate with your own analysis tools: Push agent data to external sources in real-time (via POST functions) or on a daily schedule.

![](https://3205006002-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FleYcqBx5FRZcVr3wI4f4%2Fuploads%2FlSclJsjqiqPsRVVcCf5x%2F8.png?alt=media)

* Create conversations into structured insights with customized analysis prompts that can analyze every conversation in real-time.

### Templating <a href="#dpnkdyws07u7" id="dpnkdyws07u7"></a>

With Jinja-based templating, the AI agent can customize the prompt based on specified use cases. You can also learn more about [templating from our guide](https://docs.gooey.ai/guides/copilot/craft-your-ai-copilots-personality#advanced-prompting-strategies).
