Skip to content

Commit d0861f0

Browse files
Ambika Joshigitbook-bot
authored andcommitted
GITBOOK-246: No subject
1 parent 2dfacfd commit d0861f0

File tree

4 files changed

+42
-36
lines changed

4 files changed

+42
-36
lines changed
201 KB
Loading

SUMMARY.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,8 @@
1111
* [Curate your Knowledge Base Documents](guides/copilot/curate-your-knowledge-base-documents.md)
1212
* [Advanced Settings](guides/copilot/advanced-settings.md)
1313
* [Prepare Synthetic Data](guides/copilot/prepare-synthetic-data.md)
14-
* [Conversation Analysis](guides/copilot/conversation-analysis/README.md)
14+
* [Analysis and Observability](guides/copilot/conversation-analysis/README.md)
15+
* [Feedback](guides/copilot/conversation-analysis/feedback.md)
1516
* [Glossary](guides/copilot/conversation-analysis/glossary.md)
1617
* [Building a Multi-Modal Copilot](guides/copilot/building-a-multi-modal-copilot.md)
1718
* [Frequently Asked Questions about AI Copilot](guides/copilot/frequently-asked-questions-about-ai-copilot.md)
Lines changed: 10 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -1,48 +1,23 @@
1-
# Conversation Analysis
1+
# Analysis and Observability
22

3-
### Why it's useful? 
3+
Analytics dashboards help you manage your AI agents by giving you a clear view of how they’re performing. You can check how often users are engaging with the Agent, where errors happen, and how resources are being used—all in one place. This makes it easier for you to spot problems, track progress, and make improvements so your agents work more smoothly and deliver better results.
44

5-
As your copilot gains momentum, you will need to manage and monitor conversations. You can use Gooey.AI's LLM script for conversation analysis. 
5+
## Analytics Dashboard
66

7-
We can determine when the bot is answering and categorize answers based on subject, gender, user location, and other criteria that are important to your organization. 
7+
### How do you access the Analytics Dashboard? 
88

9-
### How does it work in Ulangizi AI?
9+
{% @arcade/embed flowId="Mx8g1ybWlz1PkqSS4Qk5" url="https://app.arcade.software/share/Mx8g1ybWlz1PkqSS4Qk5" %}
1010

11-
1. Here you can see the Overall details of the platform, users, and connected number on the left
12-
2. On the right you can see basic analytics of "Daily Messages Sent"
11+
You can go through all the tabs with line-by-line details about the various user conversations, we are also updating the categories section soon. 
1312

14-
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-08 at 3.17.03 PM.png" alt=""><figcaption></figcaption></figure>
15-
16-
3. You can see the "Daily Usage Trends", "Daily Performance Metrics" and "Daily Feedback Distribution"
17-
18-
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-08 at 3.17.16 PM.png" alt=""><figcaption><p> </p></figcaption></figure>
19-
20-
5. Finally, you can go through all the tabs with line-by-line details about the various user conversations, we are also updating the categories section soon.&#x20;
21-
22-
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-08 at 3.17.26 PM.png" alt=""><figcaption></figcaption></figure>
13+
<figure><img src="../../../.gitbook/assets/Screenshot 2025-09-01 at 4.26.00 PM.png" alt=""><figcaption></figcaption></figure>
2314

2415
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-08 at 3.33.15 PM.png" alt=""><figcaption></figcaption></figure>
2516

2617
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-08 at 3.37.50 PM.png" alt=""><figcaption></figcaption></figure>
2718

28-
### How to make it?
29-
30-
Key Concept:
31-
32-
1. This runs after we generate an answer.
33-
34-
[https://gooey.ai/compare-large-language-models/?example\_id=lbjnoem7](https://gooey.ai/compare-large-language-models/?example_id=lbjnoem7)\
35-
36-
37-
What you need to do:
38-
39-
1. Save your AI Copilot
40-
2. Tweak analysis LLM script using the example [here](https://gooey.ai/compare-large-language-models/?example_id=lbjnoem7)
41-
3. Start from the answered scripts
42-
4. Optionally add categorization (later)
43-
5. Save this LLM script
44-
6. Go to the Copilot's integration tab to the integration where we need to add the analysis script. Open the settings and add the Saved URL for the Analysis script in the "Analysis Run URL".&#x20;
19+
## Analysis Script&#x20;
4520

46-
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-13 at 12.55.00 PM.png" alt=""><figcaption></figcaption></figure>
21+
### How to use LLM to create Analysis script for qualitative data?
4722

48-
<figure><img src="../../../.gitbook/assets/Screenshot 2024-03-13 at 12.55.12 PM.png" alt=""><figcaption></figcaption></figure>
23+
{% @arcade/embed flowId="tJFWiKjVOpzFbdV770St" url="https://app.arcade.software/share/tJFWiKjVOpzFbdV770St" %}
Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
---
2+
description: >-
3+
Learn how to activate, view, analyze, and interpret user feedback on AI
4+
Copilot interactions using the analytics dashboard.
5+
icon: thumbs-up
6+
---
7+
8+
# Feedback
9+
10+
Feedback buttons are a quick and simple way of getting user inputs directly in the AI Agent. User can rate and provide feedback on every AI Agent&#x20;
11+
12+
## Activate feedback buttons in your AI Agent
13+
14+
By default, the feedback buttons are switched off in your AI Agent Integration. You can scroll down to the "Show Demo Button" section and switch on the Feedback buttons settings.&#x20;
15+
16+
{% @arcade/embed flowId="08CHykcBCUPluWeqcqn1" url="https://app.arcade.software/share/08CHykcBCUPluWeqcqn1" %}
17+
18+
### Detailed Feedback
19+
20+
When users give a thumbs down, ask them to explain what was wrong and how it could be improved. Make sure to use our suggested prompt in your copilot to make this work well.
21+
22+
{% @arcade/embed flowId="RdrkEOI1HDUOlBdnbAqE" url="https://app.arcade.software/share/RdrkEOI1HDUOlBdnbAqE" %}
23+
24+
## Analyze and Interpret user feedback
25+
26+
Head over to our analytics dashboard to track performance data, manage connections, and focus on successful user interactions.
27+
28+
Switch your view to evaluate conversations needing improvement. Examine negative feedback entries for targeted review and analysis. Understand areas where the AI's response may need improvement and make the necessary adjustments.
29+
30+
{% @arcade/embed flowId="C2BBnHBM9k69w2DAC7nr" url="https://app.arcade.software/share/C2BBnHBM9k69w2DAC7nr" %}

0 commit comments

Comments
 (0)