Analytics

SmartPal provides customers, with all talent activity data on the analytics page to foster data-driven decisions. The Analytics page has two tabs: “Report” and “Monthly”

Report tab

Setting the timeframe

On the reports tab you can create reports on a set time range. Set the required start and end dates on the top of the page and hit the “set” button to generate the report.

Please note:

  • Data for the start and end dates are inclusive.

  • The start date can not be set earlier than 6 months before the current date.

  • The examined time period can not be longer than 3 months.

Funnel report

In the left hand side panel you find the most important numerical results of the set timeframe.

Users

Active users: Unique end-users interacting with the bot in the set time period. (Note: on certain platforms this number represents unique end-user devices.)

New users: Unique end-users interacting with the chatbot for the first time in the set time period. (Note: on certain platforms this number represents unique end-user devices.)

Questions

Questions asked: End-user utterances that were interpreted as a question (not included: small talk; activity in job discovery, application and content flow; chatbot control commands).

Rate of incoming questions outside working hours: Percentage of questions coming in outside your company’s set working hours (set during the chatbot implementation phase) - outside working hours include regional public holidays (company region is set during the chatbot implementation phase).

Users asking questions: Number of users asking at least one question in the conversation with the chatbot in the set time period.

Questions per user asking: The average number of questions asked per questioning user. Equals to Questions asked / Users asking questions

FAQ Automation

Direct Answers: Amount of direct answers give to candidates by a recruiter

Questions answered automatically: Amount of questions that were automatically answered by the chatbot.

Auto-Response rate: Percentage of questions automatically answered by the chatbot.

Job Discovery Funnel

Note: This section is present only if the job discovery feature is turned on in your chatbot.

Users starting job search: Number of candidates entering the job discovery funnel in the set time period 

Users getting to job carousel: Number of candidates finishing the job discovery funnel (reaching the job carousel) in the set time period. Note: occasionally users go trough the job discovery phase over a longer period of time (even as long as several days). In this case, users might not be counted in the metric above as they started the job discovery before the set starting time of the examined period. Additionally, users getting directly to the job carousel using the offer deeplinking feature will be counted here, but not in the metric above.

Conversion to job carousel: Percentage of users finishing the job discovery flow compared those how started it. Note: in some cases, due to use of the deeplinking feature as explained above, this metric might occasionally go above 100%.

Users starting job application: Number of candidates starting the job application process. Note: candidates getting directly to the job application via application deeplinking are counted into this metric.

Conversion to starting job application: Percentage of users starting the job application process compared to the candidates reaching the job carousel. Note: due to occasional time difference between reaching the job carousel and starting the application process, and also because application deeplinking this metric eventually can go above 100%.

Users completing job application: Number of candidates who submitted at least one application.

Conversion to completing job application: Percentage of users who submitted at least one application compared to the amount of users who started the application flow.

Total number of applications: Total number of applications received in the set time period via the chatbot. As candidates might submit multiple applications, this number can be higher than the “Users completing job application” metric.

Job Search to Application Conversion: Percentage of candidates submitting at least one application compared to the amount of candidates starting the job search.

Amount of various button clicks in the job carousel that lead to an external link (typically job description or application page on your career website).

Feedback Summary

Classification of user feedback given, in case the user feedback feature is turned on for your chatbot. The individual feedback given can be found at the bottom of the page in the “Feedback” section.

Top Categories

The chart on the left side shows the top of the category distribution of the questions that were automatically answered by the chatbot in the set time period.

Using the three dots icon in the upper right corner the chart can be downloaded in SVG of PNG format.

Note: Deleted categories won’t appear in the chart. Also, categories that got their names changed will be shown with their current names.

Active Users

Chart of daily active users in the selected time period. Using the three dots icon in the upper right corner the chart can be downloaded in SVG of PNG format.

Feedback

The individual feedback on the conversation given by candidates. Note: in order to prompt for candidate feedback the feature must be activated on your chatbot.

Monthly tab

This section contains charts of Questions asked / auto responded and Active / new users per month. Both charts can be downloaded in SVG or PNG format using the three dots icon in the upper right corner of the particular chart.

 

At the bottom of the tab you find the key KPIs per month. See explanations of the metrics above at “Funnel report”