Furhat Robotics Robot Owner's Manual

Hide thumbs

Table Of Contents

Table of Contents

Quick Links

Download this manual

Furhat Robotics

Robot Owners Guide

Product Documentation

Version 1.4

Table of Contents

Need help?

Do you have a question about the Robot and is the answer not in the manual?

Questions and answers

Summary of Contents for Furhat Robotics Robot

Page 1 Furhat Robotics Robot Owners Guide Product Documentation Version 1.4 C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 2: Table Of Contents
Operating Your Robot Using Web-Console Home Tab Video Panel Gaze Control Roll Control Speech Output Panel Speech Recognition Panel Home Settings Panel Gesture Panel Skills Tab Installing Skills Running & Managing Skills C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 3 Microphone Placement Considerations External Monitor Placement Considerations Physical Security Considerations Caring For Your Robot Environmental Operations & Handling Cleaning & Periodic Maintenance Transportation Furhat Skills Support Troubleshooting Revision History Glossary C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 4: Introduction
Introduction The Robot Owners Guide is intended to serve as a guide to your Furhat Robot. It covers: ● Getting Started : Introduces the Robot and helps you get your robot set up ● Using Your Robot : Takes you through all of the robots features, controls, and interfaces ●...
Page 5 Furhat products. Please visit our website at f urhatrobotics.com for the latest information, data, and software. For questions relating to this document please contact sales@furhatrobotics.com C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 6: Getting Started
Getting Started This chapter describes how to unpack, set up, and get your robot up & running. Your Robot Your robot comes packaged in its own protective hardshell case which includes the Furhat Robot Unit and all basic accessories. The product package includes the following items:...
Page 7: Unboxing
● Open the lid of the case, revealing the white robot cover plate with Furhat logo cut-out ● Lift off the white robot cover plate, safely store it to the side, placing it back in the case later ● Carefully lift the robot unit out, taking care to protect the neck articulation as you lift ●...
Page 8: Start Up
● Disconnect the robot from its AC power source , unless you plan to use it soon thereafter. C urrently shipping robots continue to power the projector system as long as the robot is connected to an AC power source. ...
Page 9: Robot Type
Robot Type A Furhat robot can be of two types: P roduction or R esearch , these types are configured in software by Furhat Robotics. The different types enable specific software functions; for example, research robots have access to the full library of voices from A capela and also have the Camera Feed feature enabled.
Page 10: On-Face Menu Functions
● WiFi-LAN : This menu item enables you to use your robot to create a WiFi hotspot, to which you can connect a device of your choosing, and then access the robots Web-Console.
Page 11: First Time Network Connection
Fixed Ethernet Connection ● If the robot is connected to a fixed ethernet network via an ethernet cable, it will attempt to configure its network settings via the fixed ethernet connection using DHCP ●...
Page 12: Verifying Internet Connection
● Some screens support video, power and touch via single USB-C cable. For such screens, simply connect the screen to the robots USB-C port using the single USB cable. ● For screens that use HDMI, connect the screen’s HDMI port to your robot USB-C port (using an appropriate USB-C/HDMI adapter) ...
Page 13 ● For screens that use HDMI and support touch capabilities, a USB cable is used to transmit touch events from the screen to the robot, connect this cable to a USB-A port on your robot. ● Connect the screen to an appropriate power source and switch on the screen using the appropriate control/power button on the screen.
Page 14: Using Your Robot
You can also V iew , S tart , S top , I nstall and U ninstall skills from your robot using the Skills features within the robots Web-Console.
Page 15: Home Tab
At the top of the home panel you can see information on which skill is running on your robot, as well as the u ser account icon and the c onsole log icon.
Page 16 Skills being displayed. Selecting origin s ystem results in only log messages from FurhatOS being displayed The Home Panel also contains a number of additional features as follows C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 17: Video Panel
Gaze Control The Video Panel also enables you to remotely direct the gaze of the robot via motor movements of the robots neck motion platform. You can direct the gaze of your robot using a mouse inside the video panel.
Page 18: Speech Output Panel
The Speech Recognition Panel enables you to test the function of the robot microphones as well as speech recognition feature. When you select the L isten button, the robot will indicate that it is listening. Simply speak some words or a sentence of your choosing (in English), and the robots' understanding of your speech will appear in text on the Speech Recognition Panel.
Page 19: Gesture Panel
USB connected audio devices. Gesture Panel The Gesture Panel enables you to remotely direct all of the built-in gestures on your robot. For example you can direct your robot to:...
Page 20: Skills Tab
GUI component which provides additional skill features via a browser based GUI, this GUI (if present) is accessed by pressing the grey G UI button. Installing Skills The Skills Tab enables you to import new skills on your robot. This feature is accessed using the I mport Skill B utton. ...
Page 21: Running & Managing Skills
If you wish to start a particular skill, or stop the currently running skill, then select the S tart or Stop buttons for the relevant skill as desired. If you wish to uninstall a skill from your robot, then select the D elete button and confirm the removal of the skill in the confirmation dialog that follows.
Page 22: Dashboard Tab
Dashboard Tab The Dashboard Tab is primarily used to monitor and inspect the actions of the running skill on your robot. It delivers these insights primarily via the Attention Panel and the Skill Log Panel. Video Panel Please refer to the related Video Panel information in the earlier Home Tab chapter.
Page 23: Attention Panel
Web-Console. Attention Panel Your robot can detect and track the presence of users within the robots interaction space using it's onboard camera and the sensory perception features of FurhatOS. The Attention Panel provides an abstract graphical representation of the robots attention model and supports viewing the model from a top down (plan) and side (elevation) view point.
Page 24: Skill Log Panel
If the S how Intent option at the bottom of the panel is selected then the log panel will annotate user utterances with the i ntent that the system matches the utterance with. C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 25: Wizard Tab
Dashboard tab where the skill developer has no control over the layout) Settings Tab The Settings Tab enables you to view and change all the operator level settings on your robot. You can access the Settings Tab by clicking on the S ettings button, you will then be presented with a range of settings arranged in functional groups ...
Page 26: Face & Neck Settings Panel
The t ilt setting enables you to p an the face in the horizontal direction. The r oll setting enables you to p itch the face in the vertical direction. C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 27 Panel. The panel displays and allows the editing of the lower level face configuration attributes expressed as a set of discrete parameters. N ote that changes to this model require specialised knowledge and care. C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 28 Select the U p-Arrow and D own-Arrow buttons one R obot Hardware revisions of 2.3.1 and later / Robots from Furhat-319 and onwards C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 29: Microphone Settings
(skill) needs. Microphone Settings Your robot has an on board stereo microphone setup, however it also ships with a USB connected microphone array. and supports the use of additional USB microphones if you desire.
Page 30 The use of recognizer services requires appropriate G oogle / M icrosoft service specific accounts and the related account keys/credentials. Depending on your contract, your robot may ship with predefined credentials for one or both services. If you do not have predefined credentials, or you...
Page 31: Voice Settings Panel
The Default Voice Panel allows you to select the voice that will be used by default for speech output on your robot from the list of available voices installed on your robot. The list of installed voices can be sorted by N ame , G ender , L anguage and S ynthesizer (voice provider). Click ...
Page 32 You can test your settings using the Play function on the Home Tab Depending on your contract, your robot may ship with a license for Acapela voices. The voice settings panel enables you to check whether you have a license installed on your system.
Page 33: Asset Management Panel
If you wish to edit a model already installed on your robot then you can do so using the e xpand button and then navigating to the asset sub-part and using the edit button on the sub-part.
Page 34: Network Settings Panel
The currently connected network is denoted with a green dot. Information is provided on the (network) i nterface on your robot to which this network is attached, as well as the I P address that has been allocated by the network to your robot.
Page 35 If you are connected to a network using wired ethernet, you will see a network denoted as a Wired Connection as shown here. C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 36: Security Settings Panel
The Password Settings Panel gives you control over your robots password. This is the password that grants access to the robot Web-Console, with the default password a dmin . It is recommended to change the default password to a secure and appropriate password of your own choosing.
Page 37: Update Panel
The Update Panel shows you which version of FurhatOS your robot is running. It also indicates if you are already on the latest version of the system If you wish to upgrade your robot, please select the U pdate button and observe the instructions on screen.
Page 38 When enabling the camera feed, please give due consideration to applicable ethical, security and privacy requirements. Information on how to receive and programmatically process the camera feed video stream can be found on d ocs.furhat.io C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 39: Robot Deployment Guidelines
Additional Spatial Design Considerations The optimal height of the robot is where it is at eye level or or just below eye level with users and the placement of the robot should be at the appropriate height taking into consideration what users it will be interacting with (e.g.
Page 40 ● A distance of 1 meter between the robot and users is considered optimal for interactions C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 41: Lighting Considerations
If placed closer than 10-15 cm to the robot, there is a risk the microphone will pick up fan noise from the robot. To be able to detect the direction of the user speaking, the microphone is best placed on a level surface, however, it can also be placed on a sloping surface of no more than 45 degrees incline.
Page 42: Physical Security Considerations
The physical deployment of the robot should pay attention to securing access to the rear I/O panel of the robot where multiple physical I/O ports are present. The robot’s rotary controller is also accessible at the rear of the robot and this controller can be used to effect changes to the robot's configuration and settings.
Page 43: Caring For Your Robot
● Avoid removing power from your robot while it is running. Shut down your robot using the on/off switch and only then remove power from the robot. ● We recommend that you keep your robot up to date with the latest releases of F urhatOS using the software update function within the Web-Console Your robot is designed to operate reliably in a continuous, sustained manner, however: ●...
Page 44: Cleaning & Periodic Maintenance
● The protective case in which your robot came is the ideal transportation device for your robot. It is designed and built to offer maximum protection to your robot while it is being transported.
Page 45: Furhat Skills
Furhat Skills Furhat Robotics has a number of skills, including a demonstrator skill, that can be used to explore and showcase our products. Please contact s ales@furhatrobotics.com for further information on Furhat Skills. C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 46: Support
Support We are happy to support you in getting the best use and value out of your Furhat Robotics products. Should you require support, or wish to report an issue with your Furhat Robotics product, please use our online service desk by visiting ...
Page 47: Troubleshooting
The robot automatically connects to a The robot will connect automatically to known networks. You can set WiFi network I don’t want to use. your robot to forget a network from the on-face menu or via the Web-Console C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 48 If the robot has not rebooted after 40 minutes, contact support. The face is dark when I start the robot. Verify that the robot has power and is turned on - there is no LED indicator, but you should be able to hear the fan. Verify that the projector is working by removing the mask and checking the lense, there should always be some light coming from the projector.
Page 49 I’ve connected the robot to external Make sure that the 3.5mm audio cable you plug into the robot is either speakers, but there is no sound. a TRS (tip-ring-sleeve) or TRRS type (tip-ring-ring-sleeve). Make sure it’s firmly inserted into the 3.5mm audio point.
Page 50 For speech recognition please also ensure that your internet connection is working properly. The robot does not track me by Note that the robot will only track the user if a skill is running and the following with it's head skill is designed to attend to the user.
Page 51: Revision History
20200924 FurhatOS Versions 1.22.0 & later Added robot type Research Furhat Robot Generation 2, Rev A & later /Production description Reflected Camera Feed Feature Reflected FPS SW Focus Control. C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...
Page 52: Glossary
Internet Protocol Light Emitting Diode Operating System RFID Radio Frequency Identification Robot Development Kit Software Development Kit Secure Shell SSID Service Set Identifier Text To Speech Universal Serial Bus C opyright Furhat Robotics AB © 2020 - Commercial In Confidence...