> This page is for version Scripted.
> For other versions, use one of these documentation indexes:
> - Generative (default): https://developers.ada.cx/generative/llms.txt
> - Scripted: https://developers.ada.cx/scripted/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://developers.ada.cx/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://developers.ada.cx/_mcp/server.

# View detailed reports on your bot's performance

## Overview\[#UUID-3849f727-cc9c-a7ce-b260-13c626030fa9_id_360038871813_id_h_01F4D75RGWEPRKMQBEAVW2X64G]

There is a variety of detailed reports you can use to measure your bot's
performance. This article outlines the individual reports, what they
measure, and how the various filters work. Unless otherwise noted, you
can view these reports by going to **Measure** > **Reports** in your
Ada dashboard.

Generally, these reports don't include data from test users. That means
that when you're testing your bot, you don't have to worry about skewing
your report results. The exception to this, as noted below, is SMS
campaigns, because there's no way to mark SMS message recipients as test
users.

## Learn about each report\[#UUID-3849f727-cc9c-a7ce-b260-13c626030fa9_id_360038871813_id_h_01F4D75X6MPX23B7KY1DGZ9T34]

Click a report name below to expand it and learn about the metrics it
includes. Note that the reports that are available in your bot will vary
based on your Ada subscription. If you have any questions, don't
hesitate to contact your Ada team.

For more information on the filters you can use to refine your report
data, see the [Filter the data that appears in a report](#UUID-3849f727-cc9c-a7ce-b260-13c626030fa9_id_360038871813_id_h_01F4D76Q4J9X2ZGWFAC7YAEAVB)
section of this page.

#### A/B Testing Overview

View the results from comparing Answer content variants, so you can
choose the option that performs best. For more information on A/B
testing, see [Run an A/B test](/scripted/docs/measure-success/plan-and-collect-feedback/run-an-a-b-test).

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Shown**
      </td>

      <td>
        The total number of times the test was presented to
        chatters.
      </td>
    </tr>

    <tr>
      <td>
        **Testing**
      </td>

      <td>
        The event selected to measure the test against. This was
        configured upon test setup.
      </td>
    </tr>

    <tr>
      <td>
        **Result**
      </td>

      <td>
        The status of the test. Possible results:

        * **Draft**: The test has never been live; variants
          can still be added and/or removed.
        * **Active**: The test is currently running.
        * **Complete**: The test has been completed.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/cc807f9c1a9f92955aa909f67f72f7ae31d62c907d3ca54733c7e8d127a56d8b.webp)

#### A/B Testing Breakdown

View a detailed breakdown of how your Answer variants performed. This
breakdown appears when you click onto a specific A/B test to see how it
performed. For more information on A/B testing, see [Run an A/B test](/scripted/docs/measure-success/plan-and-collect-feedback/run-an-a-b-test).

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Significance test results**
      </td>

      <td>
        A rating of whether the test results are conclusive or
        inconclusive, based on a two-sided significance test with 95%
        confidence.

        This is a statistical analysis based on the normal distribution of
        the data using the z-score to represent a given variant mean vs the
        overall population's mean. Then, we use the z-score to determine the
        probability a given variant is within 2 standard deviations from the
        mean. (2 standard deviations represents a 95% confidence level.)
        Possible results:

        * **Conclusive**: There is enough data to determine
          that a specific variant (including control) leads to a better conversion
          rate or to accomplish the event objective.
        * **Inconclusive**: There is not enough data to have a
          proper population mean, and therefore can’t be determined if a variant
          resulted in a better conversion rate or not.
      </td>
    </tr>

    <tr>
      <td>
        **Control**
      </td>

      <td>
        The performance of the control version of the Answer content,
        including monetary value and percent of conversations where this variant
        triggered the Event.

        The control's success rate is calculated with the formula `(control successes) / (control occurrences) * 100`. If the
        number of control occurrences is 0, then the control's success rate is
        also 0.
      </td>
    </tr>

    <tr>
      <td>
        **Variant(s)**
      </td>

      <td>
        The performance of the Answer content variants, including
        monetary value and percent of conversations where this variant triggered
        the Event.

        Each variant's success rate is calculated with the formula `(variant successes) / (variant occurrences) * 100`. If the
        number of variant occurrences is 0, then the variant's success rate is
        also 0.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/ebbc9c951efef184a6394eed1ee687af8d0b3b7ffc2f0ca90ec4f827222e3703.webp)

#### Agent Satisfaction Score

View customer satisfaction (CSAT) surveys where the scores are
attributed to human support, available if the “Automatically survey
after chat” option is turned on.

> **Note**
>
> When you filter this report by date, it uses the date that the user
> submitted their satisfaction survey, rather than the date the
> conversation started. As a result, the number of conversations that
> appear in this report may vary from other reports.

There are four ways you can set up customer satisfaction reviews, each with different scales for recording feedback:

| Rating type                  | Negative review     | Positive review |
| ---------------------------- | ------------------- | --------------- |
| **Numeric (5-point scale)**  | 1, 2, or 3          | 4 or 5          |
| **Numeric (10-point scale)** | 1, 2, 3, 4, 5, or 6 | 7, 8, 9, or 10  |
| **Emoji (5-point scale)**    | 😠, 🙁, or 😐       | 🙂 or 😍        |
| **Thumbs up/down (binary)**  | 👎                  | 👍              |

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Live chat score**
      </td>

      <td>
        The percent of agent reviews that were positive. Your bot
        calculates this with the formula `SUM (positive agent reviews) / SUM (all agent reviews) * 100`.
      </td>
    </tr>

    <tr>
      <td>
        **Agent name**
      </td>

      <td>
        The name of the agent who spoke with the chatter immediately
        before the chatter provided the review. If multiple agents interacted
        with the chatter in the same conversation, even if only one agent's name
        appears in this list, all of the agents in that conversation are
        assigned the chatter's CSAT score.

        Agent names appear in this list if they have at least one review in
        the time periods selected for either data display or for
        comparison.
      </td>
    </tr>

    <tr>
      <td>
        **Avg score**
      </td>

      <td>
        The percent of agent reviews that were positive.
      </td>
    </tr>

    <tr>
      <td>
        **# of positive**
      </td>

      <td>
        The number of agent reviews that were positive.
      </td>
    </tr>

    <tr>
      <td>
        **# of negative**
      </td>

      <td>
        The number of agent reviews that were negative.
      </td>
    </tr>

    <tr>
      <td>
        **Total # of surveys**
      </td>

      <td>
        The total number of agent reviews.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/749525c4f2d6d158b8a2a1875def1dbb6b9df7a295ba7c6a9172456f2fca8b09.webp)

#### Answer Performance

View feedback your chatters have given your Answers via thumbs up or
down responses, or via the Positive Review or Negative Review locked
Answers. For more information, see [Improve Answer training using chatter feedback](../../build-and-maintain-your-bot/train-and-manage-answers/improve-answer-training-using-chatter-feedback.mdx).

| Metric                   | Definition                                                                                                                                                                                              |
| ------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Feedback rate**        | The percent of reviewable Answers that chatters reviewed. Your bot calculates this with the formula `((total thumbs up) + (total thumbs down)) / (bot reviewable answers shown) * 100`.                 |
| **Total thumbs up**      | The number of reviewable Answers that chatters gave positive reviews.                                                                                                                                   |
| **Total thumbs down**    | The number of reviewable Answers that chatters gave negative reviews.                                                                                                                                   |
| **Reviewable Answers**   | A list of reviewable Answers that received chatter reviews in the selected timeframe.                                                                                                                   |
| **Frequency**            | The number of times this Answer appeared to chatters.                                                                                                                                                   |
| **Thumbs up**            | The number of positive reviews chatters gave this Answer.                                                                                                                                               |
| **Positive review rate** | The percent of time chatters gave this Answer a positive review, out of all the times it appeared. Your bot calculates this with the formula `(number of positive reviews) / (Answer frequency) * 100`. |
| **Thumbs down**          | The number of negative reviews chatters gave this Answer.                                                                                                                                               |
| **Negative review rate** | The percent of time chatters gave this Answer a negative review, out of all the times it appeared. Your bot calculates this with the formula `(number of negative reviews) / (Answer frequency)* 100`.  |

![](/_fern-files/_img/8bca17c1b77855218db3cfef4dcce2a6a5e1183ef536b38d03b0a824e5b5a278.webp)

#### Answers Resulting in Handoffs

View a list of Answers that most often preceded a chatter's request for
human support.

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Answer name**
      </td>

      <td>
        The last Answer to appear before the chatter requested a handoff
        to human support.
      </td>
    </tr>

    <tr>
      <td>
        **Frequency**
      </td>

      <td>
        The number of times the Answer appeared to chatters.
      </td>
    </tr>

    <tr>
      <td>
        **Total handoffs**
      </td>

      <td>
        The number of times the Answer appeared to a chatter immediately
        before they requested a handoff to human support.

        Your bot counts all handoff attempts as handoffs. Therefore, if your
        bot attempts to hand a chatter off to human support twice, and only the
        second attempt is successful, this report still counts it as two
        handoffs. However, the platform that handles your human support handoffs
        may count these differently.
      </td>
    </tr>

    <tr>
      <td>
        **Handoff rate**
      </td>

      <td>
        The percent of time chatters requested a handoff to human support
        after seeing this Answer, out of all the times it appeared. Your bot
        calculates this with the formula `(total handoffs) / frequency * 100`.
      </td>
    </tr>

    <tr>
      <td>
        **Percent of total handoffs**
      </td>

      <td>
        The percent of escalated conversations where the handoff occurred
        directly after this Answer, out of all Answers that were followed by
        handoffs. Your bot calculates this with the formula `SUM (handoffs for Answer) / SUM (handoffs for all Answers) * 100`.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/febfcc33ab59c43c233563bfa1b67ec77016fd962af5ad2d5b64f6a8185278bc.webp)

#### Article Performance

View how your knowledge base article links performed after your bot
suggested them. For more information, see [Let chatters search your Zendesk or Salesforce knowledge base content](/scripted/docs/use-ada-with-your-website/serve-your-website-information-in-chat/let-chatters-search-your-zendesk-or-salesforce-knowledge-base-content).

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Article name**
      </td>

      <td>
        The name of the knowledge base article.
      </td>
    </tr>

    <tr>
      <td>
        **Suggestion**
      </td>

      <td>
        The number of times your bot suggested the article to
        chatters.
      </td>
    </tr>

    <tr>
      <td>
        **Clicks**
      </td>

      <td>
        The number of times chatters clicked on a unique message that
        contained a knowledge base link.

        If a chatter clicked multiple times on the same message, it only
        counts as one click. However, if your bot suggests the same link
        multiple times, and a chatter clicks those links in different messages,
        those count as separate clicks.
      </td>
    </tr>

    <tr>
      <td>
        **Click rate**
      </td>

      <td>
        The percent of time chatters clicked on suggested article
        links.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/f063898ec537eedb5e1e623b1d8385b5b47f1fe3245fa61794c0316c91d08681.webp)

#### Automated Resolution Rate

The [automated resolution rate](/scripted/docs/measure-success/analyze-chat-data/understand-and-improve-your-bot-s-automated-resolution-rate)
is an analysis of how many conversations your bot was able to resolve
automatically.

To calculate the automated resolution rate, your bot takes a random
sample of your bot's conversations, then analyzes each conversation in
the sample to understand both the chatter's intent and the bot's
response. Based on that analysis, it then assigns a classification of
either Resolved or Not Resolved to each conversation in the sample.

For a conversation to be considered automatically resolved, the
conversation must be:

* **Relevant** - Ada effectively understood the chatter's inquiry, and
  provided directly related information or assistance.

* **Accurate** - Ada provided correct, up-to-date information.

* **Safe** - Ada interacts with the chatter in a respectful manner and
  avoided engaging in topics that caused danger or harm.

* **Contained** - Ada addressed the chatter's inquiry without having to
  hand them off to a human agent.

  While Containment Rate can be a useful metric to get a quick glance of
  the proportion of bot conversations that didn't escalate to a human
  agent, automated resolution rate takes it a step further. By measuring
  the success of those conversations and the content they contain, you
  can get a much better idea of how helpful your bot content really is.

In the Conversations portion of the Automated Resolution Rate page, you
can view a summary of what each chatter was looking for, how your bot
classified the conversation, and its reasoning. If you need more
information, you can click a row to view the entire conversation
transcript.

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Automated Resolution Rate**
      </td>

      <td>
        The percentage of conversations in your sample that your bot
        determined were automatically resolved. Your bot calculates this with
        the formula `Resolved conversations / (Resolved conversations + Not Resolved conversations)`.
      </td>
    </tr>

    <tr>
      <td>
        **Error margin**
      </td>

      <td>
        Because we are measuring automated resolutions by sampling, the
        error margin tells us how much we can can expect sampled results to
        differ from the actual if we were to measure automated resolutions on
        every single conversation.

        For example, let's say your bot lists your automated resolution rate
        as 40%, with a error margin of ±3%. This means that if you were to
        conduct the same sampling over and over again, the results would
        fluctuate between 37% (`40 - 3`) and 43%
        (`40 + 3`) in 95% of cases.
      </td>
    </tr>

    <tr>
      <td>
        **Containment Rate**
      </td>

      <td>
        The percent of conversations that did not result in a handoff to
        human support.
      </td>
    </tr>
  </tbody>
</table>

#### Average Handle Time

View the average amount of time chatters spent talking with your bot,
for conversations that didn’t end in handoffs to human support.

This report uses
[winsorization](https://en.wikipedia.org/wiki/Winsorizing) on all of its
metrics. To handle outliers, your bot calculates the 90th percentile of
all handle times. If a handle time is higher than the 90th percentile
limit, your bot replaces it with the 90th percentile limit instead.

| Metric                                | Definition                                                                                                                                 |
| ------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------ |
| **Avg handle time when contained**    | The average amount of time chatters spent talking with your bot, for conversations that didn’t end in handoffs to human support.           |
| **Avg handle time before escalation** | The average amount of time chatters spent talking to your bot before handoff, for conversations where chatters escalated to human support. |
| **Avg handle time with agents**       | The average amount of time chatters spent talking to live support agents.                                                                  |

![](/_fern-files/_img/75df64d8d55f67ba6527b6c56f47cddb0307d4bfe6b1e83bf49e097fc8627db0.webp)

#### Campaign Performance (SMS)

View the proactive campaign messages you have configured to start via
SMS, and how often those messages were attempted, delivered
successfully, and replied to. For more information, see [Start text conversations using proactive campaigns for SMS](/scripted/docs/build-and-maintain-your-bot/create-conversations/start-text-conversations-using-proactive-campaigns-for-sms).

Unlike web content, there is no way to mark SMS conversations as test
content. Be aware that this data may include data from your internal
tests as a result.

| Metric            | Definition                                                                                                    |
| ----------------- | ------------------------------------------------------------------------------------------------------------- |
| **Campaign name** | The name of the campaign.                                                                                     |
| **Attempted**     | The number of campaign messages Ada attempted to send chatters via SMS.                                       |
| **Delivered**     | The number of campaign messages Ada attempted to send chatters via SMS that didn't result in delivery errors. |
| **Engaged**       | The number of campaign messages chatters replied to via SMS.                                                  |

![](/_fern-files/_img/25a8d832ab2ef13eb0341bdc8bf2c17afac0235be1dd8194a58df5009f974d86.webp)

#### Campaign Breakdown (SMS)

View how a specific SMS campaign has performed. For more information,
see [Start text conversations using proactive campaigns for SMS](/scripted/docs/build-and-maintain-your-bot/create-conversations/start-text-conversations-using-proactive-campaigns-for-sms).

Unlike web content, there is no way to mark SMS conversations as test
content. Be aware that this data may include data from your internal
tests as a result.

| Metric        | Definition                                                                                                                                                     |
| ------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Attempted** | The number of campaign messages Ada attempted to send chatters via SMS.                                                                                        |
| **Delivered** | The number of campaign messages Ada successfully delivered to chatters via SMS, and the percent of successful message deliveries out of all delivery attempts. |
| **Engaged**   | The number of SMS campaign messages Ada successfully chatters replied to, and the percent of successful message deliveries out of all delivery attempts.       |

![](/_fern-files/_img/c25cc68d0e011f6f39f483124eb218aac37191648d67f04174cd1fa004439cfd.webp)

#### Campaign Performance (Web)

View the proactive campaign messages you have configured to appear on
web, and how often those messages have been shown, opened, and replied
to. For more information, see [Start conversations using basic proactive campaigns](/scripted/docs/build-and-maintain-your-bot/create-conversations/start-conversations-using-basic-proactive-campaigns)
and [Start customizable interactions using advanced proactive campaigns](/scripted/docs/build-and-maintain-your-bot/create-conversations/start-customizable-interactions-using-advanced-proactive-campaigns).

| Metric            | Definition                                                                                                                                                       |
| ----------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Campaign name** | The name of the campaign.                                                                                                                                        |
| **Shown**         | The number of times your bot showed chatters the campaign message.                                                                                               |
| **Opened**        | The percent of campaign messages shown that chatters opened. Your bot calculates this with the formula `(messages opened) / (messages shown) * 100`.             |
| **Engaged**       | The percent of campaign messages shown that chatters responded to. Your bot calculates this with the formula `(messages responded to) / (messages shown) * 100`. |

![](/_fern-files/_img/8cc7529704f86ceb1af8286c2327ff8263a4c05c0ab7a8c3feadc27dacaa8d4d.webp)

#### Campaign Breakdown (Web)

View how a specific web campaign has performed. For more information,
see [Start conversations using basic proactive campaigns](/scripted/docs/build-and-maintain-your-bot/create-conversations/start-conversations-using-basic-proactive-campaigns)
and [Start customizable interactions using advanced proactive campaigns](/scripted/docs/build-and-maintain-your-bot/create-conversations/start-customizable-interactions-using-advanced-proactive-campaigns).

| Metric      | Definition                                                                    |
| ----------- | ----------------------------------------------------------------------------- |
| **Shown**   | The number of times your bot showed chatters the campaign message.            |
| **Opened**  | The number and percent of campaign messages shown that chatters opened.       |
| **Engaged** | The number and percent of campaign messages shown that chatters responded to. |

![](/_fern-files/_img/b317621de475e1e3c7700d656470d39f5c859a6ede31c5b124f985df030f8789.webp)

#### Clarification Rate

View the percent of conversations where your bot required at least one
clarification. For more information, see [Understand the Needs Clarification and Not Understood Answers](/scripted/docs/build-and-maintain-your-bot/train-and-manage-answers/understand-the-needs-clarification-and-not-understood-answers).

| Metric                 | Definition                                                                                     |
| ---------------------- | ---------------------------------------------------------------------------------------------- |
| **Clarification rate** | The percent of conversations in which the *Needs Clarification* Answer appeared at least once. |

![](/_fern-files/_img/7b8b6fa539ca12187e1df00abec6cddc209ab61945175860efc8acd00d0fc040.webp)

#### Containment Rate

View how often chatters were able to self-serve instead of escalating to
human support.

| Metric               | Definition                                                                      |
| -------------------- | ------------------------------------------------------------------------------- |
| **Containment rate** | The percent of conversations that did not result in a handoff to human support. |

![](/_fern-files/_img/9488ccfe53d11d0367b86e2cc7453a55f30d5b798bfe07e9cba777b62d6a9d79.webp)

#### Conversational Messages Volume

View the number of bot, chatter, and agent messages per conversation.

Example conversation:

```
Bot
- Hello! (1)
- Hello! How can I be of assistance today? (2)

                    Chatter
                    [1] Hello -
                    [2] What is the status of my order? -

Bot
- I can check on that for you. (3)
- What is your order number? (4)

                    Chatter
                    [3] abc123 -

Bot
- Let me fetch that information for you... (5)
- Your order is currently being packaged for shipping. (6)
- Your estimated delivery date is Dec 25. (7)

                    Chatter
                    [4] that is too long. let me speak to an agent -

Bot
- Understood. Connecting you to the next available Agent (8)

Agent
- Hello my name is Ada. How can I further help you? {1}

                    Chatter
                    [5] I need my order sooner. please cancel it -

Agent
- Sorry about the delay. I will cancel your order {2}
- Your order has been cancelled {3}

                    Chatter
                    [6] Thank you -
```

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Number of conversations**
      </td>

      <td>
        The number of conversations where a chatter sent at least one
        message to your bot.
      </td>
    </tr>

    <tr>
      <td>
        **Bot messages**
      </td>

      <td>
        The number of conversations (y-axis) that contained a given
        number of messages your bot sent (x-axis).

        In the example above, where bot messages are counted in parentheses `()`, this conversation would fall under **8 bot
        messages**. Each response bubble counts as a single message,
        excluding messages that indicate a live agent has joined or left the
        chat. Emojis, links, pictures, and knowledge base articles all count as
        bot messages for this report.
      </td>
    </tr>

    <tr>
      <td>
        **Agent messages**
      </td>

      <td>
        The number of conversations (y-axis) that contained a given
        number of messages agents sent (x-axis).

        In the example above, where agent messages are counted in curly
        brackets <code />, this conversation would fall under **3
        agent messages**. Emojis, links, and pictures all count as agent
        messages for this report.
      </td>
    </tr>

    <tr>
      <td>
        **Chatter messages**
      </td>

      <td>
        The number of conversations (y-axis) that contained a given
        number of messages chatters sent (x-axis).

        In the example above, where chatter messages are counted in square
        brackets `[]`, this conversation would fall under 6 chatter
        messages. Emojis, links, and pictures count as chatter messages for this
        report.
      </td>
    </tr>

    <tr>
      <td>
        **Number of messages (x-axis)**
      </td>

      <td>
        The number of each type of message per conversation.

        Roughly 95% of conversations have fewer than 45 messages of any one
        type, which is why the upper end of the scale groups all conversations
        with 45 or more of any one type of message.
      </td>
    </tr>

    <tr>
      <td>
        **Number of conversations (y-axis)**
      </td>

      <td>
        The number of conversations that fall in each quantity of
        messages.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/50054e740ea14976c3a2502ebc2348a7d60cc2929d9ed00d5bc9a777490bbc37.webp)

#### Conversations Breakdown

View the number of conversations initiated, engaged, and escalated in
your bot.

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Opens**
      </td>

      <td>
        The number of conversations where a chatter opened your bot and
        was presented with a greeting. Every conversation contains one greeting.
        The entire series of messages that may be sent counts as one greeting,
        but only one needs to be sent for it to count as an open.
      </td>
    </tr>

    <tr>
      <td>
        **Engaged**
      </td>

      <td>
        The number of conversations where a chatter sent at least one
        message to your bot.

        A conversation counts as engaged once a chatter sends a message,
        regardless of whether your bot understands the message.
      </td>
    </tr>

    <tr>
      <td>
        **Escalated**
      </td>

      <td>
        The number of conversations where a chatter requested an
        escalation to human support.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/17688822110d1250be52a6602b6cd77424c68627d0e778a0852dc5f839527409.webp)

#### Conversation Topics Overview

View a list of topics your chatters talk about. For more information,
see [Track conversation topics](/scripted/docs/measure-success/analyze-chat-data/track-conversation-topics).

This report isn't listed with the other reports; instead, you can see it
if you go to **Conversations** > **Topics** in your Ada dashboard.

| Metric         | Definition                                                                                                         |
| -------------- | ------------------------------------------------------------------------------------------------------------------ |
| **Topics**     | A list of conversation topics that bot builders in your organization have configured.                              |
| **Volume**     | The number of conversations that contain the conversation topic keywords.                                          |
| **Handoffs**   | The number of conversations that contain the conversation topic keywords and that were escalated to human support. |
| **Updated by** | The last bot builder who updated the conversation topic.                                                           |

![](/_fern-files/_img/4c570c21e3ced9574ee0dfcbfb68316587f01c744e64a52f0c77569f1835983f.webp)

#### Conversation Topics Breakdown

View how a particular conversation topic performed. For more
information, see [Track conversation topics](/scripted/docs/measure-success/analyze-chat-data/track-conversation-topics).

This report isn't listed with the other reports; instead, you can see it
if you go to **Conversations** > **Topics** in your Ada dashboard and
click on a topic to see more detail.

| Metric                          | Definition                                                                                                                   |
| ------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- |
| **Volume**                      | The number of conversations that contain the conversation topic keywords.                                                    |
| **Handoffs**                    | The number of conversations that contain the conversation topic keywords and that were escalated to human support.           |
| **Customer satisfaction score** | Of all conversations that contained this topic’s keywords, the percent that received positive customer satisfaction reviews. |

![](/_fern-files/_img/4de10f4411732074c1ac4ee3a81d486e07a091407f420413aa6384908c9ed5d4.webp)

#### Customer Satisfaction Score

View the percent of your bot's conversations that chatters reviewed
positively. For more information, see [Collect and analyze chatter satisfaction data with Satisfaction Surveys](/scripted/docs/measure-success/plan-and-collect-feedback/collect-and-analyze-chatter-satisfaction-data-with-satisfaction-surveys).

Chatters can rate conversations in surveys at the end of the chat, the
Anytime Survey, or a survey triggered by an Answer with a Satisfaction
Survey block. If the survey appeared more than once in a single
conversation, the bot will show the previous selection to the chatter,
allowing them to update their feedback. Only the most recent rating is
recorded per conversation; the latest rating overrides any previous
ratings.

There are three ways you can set up customer satisfaction reviews:

There are four ways you can set up customer satisfaction reviews, each with different scales for recording feedback:

| Rating type                  | Negative review     | Positive review |
| ---------------------------- | ------------------- | --------------- |
| **Numeric (5-point scale)**  | 1, 2, or 3          | 4 or 5          |
| **Numeric (10-point scale)** | 1, 2, 3, 4, 5, or 6 | 7, 8, 9, or 10  |
| **Emoji (5-point scale)**    | 😠, 🙁, or 😐       | 🙂 or 😍        |
| **Thumbs up/down (binary)**  | 👎                  | 👍              |

| Metric              | Definition                                                                                                                 |
| ------------------- | -------------------------------------------------------------------------------------------------------------------------- |
| **Overall score**   | The percent of conversations chatters reviewed positively, out of all conversations they reviewed.                         |
| **Bot only score**  | The percent of conversations chatters reviewed positively, out of all conversations that did not escalate to a live agent. |
| **Live chat score** | The percent of conversations chatters reviewed positively, out of all conversations that escalated to a live agent.        |

![](/_fern-files/_img/8608ad09ed019b1645b43a3b76f1dfb63d3157a85f9c0774de081114aa291dae.webp)

#### Engagement Rate

View how often customers chose to chat with your bot.

| Metric              | Definition                                                                                        |
| ------------------- | ------------------------------------------------------------------------------------------------- |
| **Engagement rate** | The percent of conversations where chatters sent at least one message or quick reply to your bot. |

![](/_fern-files/_img/eeeae2d89c2ac55c64c2fa8517134315a71a214ab8806b2736d73800e3c7b60f.webp)

#### Events Overview

View your bot’s tracked events, how often they occurred, and the
monetary values associated with them. For more information, see [Create and track chatter actions](/scripted/docs/measure-success/plan-and-collect-feedback/create-and-track-chatter-actions).

| Metric                  | Definition                                                                                                                        |
| ----------------------- | --------------------------------------------------------------------------------------------------------------------------------- |
| **Total count** (top)   | The total number of events that occurred.                                                                                         |
| **Total value**         | The total monetary value of all of the events that occurred.                                                                      |
| **Event name**          | The name of the event being measured.                                                                                             |
| **Total count** (table) | The number of times the event occurred.                                                                                           |
| **Total value**         | The total monetary value of all of the occurrences of the event, based on the value assigned to the event when it was configured. |

![](/_fern-files/_img/f6389130cc5c0da8c9ceaf0cdf0bc490e97f8179cdbd4af145688c21c145340e.webp)

#### Events Breakdown

View how a specific event performed. For more information, see [Create and track chatter actions](/scripted/docs/measure-success/plan-and-collect-feedback/create-and-track-chatter-actions).

| Metric          | Definition                                                                                                                        |
| --------------- | --------------------------------------------------------------------------------------------------------------------------------- |
| **Total count** | The number of times the event occurred.                                                                                           |
| **Total value** | The total monetary value of all of the occurrences of the event, based on the value assigned to the event when it was configured. |

![](/_fern-files/_img/3b3f916bb93139bc26303d18a9699b5a02a93905a9748ffd469f7d226327cc50.webp)

#### Goals Overview

View how often your bot’s goals were met, so you can track and measure
valuable business interactions. For more information, see [Set goals to measure your bot's impact](/scripted/docs/measure-success/plan-and-collect-feedback/set-goals-to-measure-your-bot-s-impact).

| Location                 | Metric                                                                                                                                                                                | Definition                                                 |
| ------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------- |
| **Top**                  | **Goal completion**                                                                                                                                                                   | The number of times any goals in the table were completed. |
| **Goal conversion rate** | The percent of conversations in which any goals in the list were completed.                                                                                                           |                                                            |
| **Goal value**           | The total monetary value of all goals in the list.                                                                                                                                    |                                                            |
| **Table**                | **Goal name**                                                                                                                                                                         | The name of the goal being measured.                       |
| **Goal completion**      | The number of times the goal was completed.                                                                                                                                           |                                                            |
| **Goal conversion rate** | The percent of conversations in which the goal was completed.                                                                                                                         |                                                            |
| **Goal value**           | The total monetary value associated with the goal. Your bot calculates this with the formula `(number of conversations where the goal was completed) * (value assigned to the goal)`. |                                                            |

![](/_fern-files/_img/ec1c78b5fb7ef1cbf6f9a93324548ac1714e76500785e308e27bf8816a4587f9.webp)

#### Goals Breakdown

View how a specific goal performed. For more information, see [Set goals to measure your bot's impact](/scripted/docs/measure-success/plan-and-collect-feedback/set-goals-to-measure-your-bot-s-impact).

| Metric                   | Definition                                                                                                                                                                            |
| ------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Goal completion**      | The number of times the goal was completed.                                                                                                                                           |
| **Goal conversion rate** | The percent of conversations where the goal was completed.                                                                                                                            |
| **Goal value**           | The total monetary value associated with the goal. Your bot calculates this with the formula `(number of conversations where the goal was completed) * (value assigned to the goal)`. |

![](/_fern-files/_img/bc9895a3662f9ac19546b4b15e39a751b0e16e11ad94484774f167496593f2fa.webp)

#### Link Click Performance

View the click-through rates for links presented via Link Message or Web
Window blocks.

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Total shown**
      </td>

      <td>
        The total number of links your bot showed to chatters. Multiple
        instances of the same link count as one link.
      </td>
    </tr>

    <tr>
      <td>
        **Total clicks**
      </td>

      <td>
        The total number of times chatters clicked on a unique message
        that contained a link.

        If a chatter clicks multiple times on the same message, it only
        counts as one click. However, if the same link appears multiple times as
        part of the same conversation, and a chatter clicks more than one
        instance of that link, the clicks are counted separately.
      </td>
    </tr>

    <tr>
      <td>
        **Click rate**
      </td>

      <td>
        The percent of links chatters clicked on, out of all the links
        shown.
      </td>
    </tr>

    <tr>
      <td>
        **URL**
      </td>

      <td>
        The link URL.
      </td>
    </tr>

    <tr>
      <td>
        **Answers**
      </td>

      <td>
        The Answers that contain the Link Message or Web Window block
        with the URL your bot showed to chatters.
      </td>
    </tr>

    <tr>
      <td>
        **Shown**
      </td>

      <td>
        The number of times your bot showed this link to chatters. Links
        that contain variables (such as a user ID) are counted as the same
        “base” link.
      </td>
    </tr>

    <tr>
      <td>
        **Clicked**
      </td>

      <td>
        The number of times chatters clicked on this link. Links that
        contain variables are counted as the same “base” link.
      </td>
    </tr>

    <tr>
      <td>
        **Click rate**
      </td>

      <td>
        The percent of links chatters clicked on, out of all the links
        shown.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/f303edc836fcfd547c1e2a772af1c5b84d7fc490c53453263730d9fa9655dfa1.webp)

#### Popular Answers

View a list of Answers that appear most often in conversations.

| Metric                       | Definition                                                                                                                                |
| ---------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------- |
| **Answer name**              | A list of all Answers that appeared to chatters, sorted in descending order by frequency by default. This list excludes greeting Answers. |
| **Frequency**                | The total number of times the Answer appeared to chatters.                                                                                |
| **Percent of total Answers** | The percent of time your bot showed this Answer to chatters, out of all Answers it showed to chatters.                                    |

![](/_fern-files/_img/68deaeb24d8afcc0a0525b9f59c17e2fbdec554b4e63848d2e0fafc545c01665.webp)

#### Recognition Rate

View how often your bot was able to recognize and answer chatters’
questions. For more information, see [Understand the Needs Clarification and Not Understood Answers](/scripted/docs/build-and-maintain-your-bot/train-and-manage-answers/understand-the-needs-clarification-and-not-understood-answers).

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Recognition rate**
      </td>

      <td>
        The percent of Answers your bot sent that were not the *Not
        Understood* Answer, including text messages, suggestions, quick
        replies, knowledge base suggestions, and clarifications, and excluding
        greeting Answers.

        You don't have to aim for this rate to be 100%. In the case of
        chatter questions that were either incoherent or didn't have any
        training, the *Not Understood* Answer would be appropriate and
        expected.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/8a3f6dce8825d51b7075d7dba24e37c7a4d7ddd8e88f5681c5a36040a8ed734e.webp)

#### Satisfaction Survey Results

View the results of your customer satisfaction (CSAT) survey. For more
information, see [Collect and analyze chatter satisfaction data with Satisfaction Surveys](/scripted/docs/measure-success/plan-and-collect-feedback/collect-and-analyze-chatter-satisfaction-data-with-satisfaction-surveys).

> **Note**
>
> When you filter this report by date, it uses the date that the user
> submitted their satisfaction survey, rather than the date the
> conversation started. As a result, the number of conversations that
> appear in this report may vary from other reports.

<table>
  <thead>
    <tr>
      <th>
        Metric
      </th>

      <th>
        Definition
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        **Last submitted**
      </td>

      <td>
        The most recent time a chatter submitted a satisfaction
        survey.
      </td>
    </tr>

    <tr>
      <td>
        **Agent**
      </td>

      <td>
        The agent, if any, who participated in the conversation. If
        multiple agents participated in the conversation, this is the agent who
        participated closest to the end of the chat.
      </td>
    </tr>

    <tr>
      <td>
        **Survey type**
      </td>

      <td>
        The type of survey the chatter responded to. If the chatter
        responded to multiple survey types, this is the one that happened
        closest to the end of the chat. Possible survey types:

        * **End chat**: The survey presented to the chatter
          when they click “End chat” outside of a handoff.
        * **Anytime survey**: If enabled, the survey the
          chatter can access at any point after sending your bot four
          messages.
        * **Live agent**: The survey chatters receive when
          they close the chat after speaking with an agent, or when an agent
          leaves the conversation.
        * **CSAT block**: The survey presented to chatters
          when the Satisfaction Survey block is included in an Answer.
      </td>
    </tr>

    <tr>
      <td>
        **Rated**
      </td>

      <td>
        The satisfaction rating the chatter selected.
      </td>
    </tr>

    <tr>
      <td>
        **Reason for rating**
      </td>

      <td>
        The reason(s) that the chatter selected in the survey follow-up
        question, if any.

        Possible positive reasons:

        * Efficient chat
        * Helpful resolution
        * Knowledgeable support
        * Friendly tone
        * Easy to use
        * Bot was intelligent
        * Other

        Possible negative reasons:

        * Took too long
        * Unhelpful resolution
        * Lack of expertise
        * Unfriendly tone
        * Technical issues
        * Bot didn't understand
        * Other
      </td>
    </tr>

    <tr>
      <td>
        **Resolution**
      </td>

      <td>
        The chatter’s response, if any, to whether your bot was able to
        resolve their issue. This can either be yes or no.
      </td>
    </tr>

    <tr>
      <td>
        **Comments**
      </td>

      <td>
        Additional comments, if any, that the chatter wanted to include
        in the survey about their experience.
      </td>
    </tr>
  </tbody>
</table>

![](/_fern-files/_img/c74c875ab4d062982735f505fde0a45e5e32abb24d6ca4da189d5c4f5efa770b.webp)

#### Tags Overview

View answer and conversation volumes by Answer tag. For more
information, see [Manage content using tags and descriptions](/scripted/docs/build-and-maintain-your-bot/create-conversations/guide-chatters-through-conversations-using-answer-flows-and-quick-replies#UUID-82f30670-1a6a-ed51-28c5-3a5cebb23791_id_360018117594_id_content-management-using-tags-descriptions).

| Metric                     | Definition                                                                                                                                                                                       |
| -------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| **Total Answers**          | The number of Answers with tags that appeared in conversations.                                                                                                                                  |
| **Conversation volume**    | The number of conversations where your bot showed at least one Answer with a particular tag to chatters. If a conversation has two Answers with the same tag, your bot only counts the tag once. |
| **Tags**                   | The tag that was assigned to at least one Answer in the conversation.                                                                                                                            |
| **Answer frequency**       | The number of Answers your bot showed to chatters with the associated tag.                                                                                                                       |
| **% of all Answers**       | The percent of all Answers your bot showed to chatters that had the associated tag.                                                                                                              |
| **# of conversations**     | The number of conversations where an Answer with the associated tag appeared.                                                                                                                    |
| **% of all conversations** | The percent of all conversations where an Answer with the associated tag appeared.                                                                                                               |

![](/_fern-files/_img/ce1c7c7ec2496fb64eb4bbd8b8cfe0d1e10aa1af63422cfde2481897abe402cb.webp)

#### Total Answers

View the total number of Answers your bot has served over time
(excluding greetings).

| Metric            | Definition                                                                    |
| ----------------- | ----------------------------------------------------------------------------- |
| **Total Answers** | The total number of Answers your bot showed to chatters, excluding greetings. |

![](/_fern-files/_img/62e7d690aaab45d7d812dce14fa2a46798957bec8079e305bb949d62bf044d32.webp)

## Filter the data that appears in a report\[#UUID-3849f727-cc9c-a7ce-b260-13c626030fa9_id_360038871813_id_h_01F4D76Q4J9X2ZGWFAC7YAEAVB]

### Filter data by date

To filter a report by date:

1. Click the date filter drop-down.

2. Define your date range by one of the following:

   * Select a predefined range from the list on the left.

   * Type the filter start date in the Starting field. Type the filter
     end date in the Ending field.

   * Click the starting date on the calendar on the left, and the
     ending date on the calendar on the right.

3. Click **Apply**.

The date filter dropdown provides you with the ability to specify the
date range you want to filter the report's data by. You can select from
a list of preset date ranges or select **Custom…** to specify your own
by way of a calendar selector.

### Filter data by additional criteria

The list of available filters differs for each report, depending on the
data the report includes. Clicking the **Add Filter** drop-down menu
gives you access to the filters relevant to the report you're viewing.

* **Previous Timeframe**: Display the immediate past timeframe (same
  length) to compare against current selection. Graphs will also display
  a figure representing the delta (difference) between ranges (ie. how
  much did your bot’s volume rise or drop between timeframes)

* **Exclude Locked Answers**: Graphs and tables will only display
  volumes for answers created after bot creation (for more details on
  locked answers, see “Answers That Don’t Need Training” here). This
  will remove volume for answers like “Greeting” and “Not Understood.”

* **Language** (if Multilingual feature enabled): Include/exclude volume
  of different languages if your bot has content in other languages.

* **Platform**: Isolate different platforms that your bot is visible in
  or interacts with (ex. Nuance, Zendesk, SMS, etc)

* **Browser**: Isolate users from specific internet browsers (ex.
  Chrome, Firefox, etc)

* **Device**: Isolate users from specific devices and operating systems
  (ex. Windows, iPhone, Android, etc.)

* **Answers**: Isolate specific answer(s). This can be used to check the
  performance of an answer or multiple answers over time.

* **Interaction Type**: Isolate answers that result from questions that
  were clicked (quick reply buttons) or typed.

* **Include Test User**: Include conversations originating from the Ada
  dashboard test bot. Test bot conversations are excluded by default.

* **Filter by Variable**: View only the conversations which include one
  or more variables. For each variable, you can define specific content
  the variable must contain, or simply whether the variable *Is Set* or
  *Is Not Set* with any data.

![](/_fern-files/_img/97eee295474001a7614cdbfb7039e0ebe70f3d4f83c0f9fc0416b20983b76221.webp)

### Additional information

* Report data is updated approximately every hour (but may take up to three hours).

* Reports are in the time zone set in [your profile](/scripted/docs/build-and-maintain-your-bot/manage-your-bot-and-your-team/manage-your-user-profile).

## Printing\[#UUID-3849f727-cc9c-a7ce-b260-13c626030fa9_UUID-23711501-de83-73c3-4ab1-248200695f46]

We recommend viewing your bot's data in the dashboard for the best
experience. However, if you need to save the report as a PDF or print it
physically, use the following recommendations to limit rendering issues:

1. Click **Print**.

2. In the Print window that appears, beside **Destination**, select
   either **Save as PDF** or a printer.

3. Click **More settings** to display additional print settings.

4. Set **Margins** to **Minimum**.

5. Set **Scale** to **Custom**, then change the value to **70**.

   * Alternatively, you can set the **Paper size** to **A3** (11-3/4 x
     16-1/2 in) or **Legal** (8.5 x 14 in).

6. Under **Options**, select the **Background graphics** checkbox.

7. Right before saving or printing, scroll through your print preview,
   and beside **Pages**, change the number of pages you want to include
   in your PDF or printout. The settings you changed above may affect
   how these pages render.

8. If your destination is Save as PDF, click **Save**. If your
   destination is a printer, click **Print**.

---

Have any questions? Contact your Ada team, or email us at [](<mailto:help@ada.support%20%E2%80%9CHelp Docs inquiry%E2%80%9D>).