Small Robot Becomes Tourism Expert

How can humanoid robots be used in the tourism sector? Thirteen computer science and business informatics students tested this for the city of Bremerhaven as part of a course project. They recently presented their findings to their clients. “I always enjoy working with the university and the students and seeing the excellent results and their application in the city at the end. Thank you very much for the great work,” says Dr. Ralf Meyer, Head of the Department of Economy, Tourism, and Science in Bremerhaven.

The humanoid robot Pepper is about 1.20 meters tall, has big eyes, and enjoys interacting with people.  It is programmed to analyze human gestures and facial expressions and to answer questions. Computer science and business informatics students at Bremerhaven University of Applied Sciences have made it suitable for tourism support for the city of Bremerhaven as part of their “PepperMINT” study project. The small robot would be particularly well-suited for use at the cruise terminal. “Pepper could explain to guests how to get to the city center or help them check in on shore. One could also predefine routes through the city center and make these available to guests via QR code,” says Prof. Dr. Thomas Umland, who supervised the project group over the course of two semesters.

In order for Pepper to know how to behave, he needs instructions. This so-called system prompt describes his personality and specifies which topics he should discuss and how. “We’ve described Pepper as a tourism expert and specified that he can only answer questions about Bremerhaven, the university, and our Computer Science Day. We also defined the style of his speech output: friendly but firm,” explains student Qusay Mohammad Alhasan. If someone asks Pepper a question that doesn’t fit the guidelines, he responds: “Sorry, I can only provide information about Bremerhaven.” Pre-programmed gestures, such as waving, support the speech output. In this case, speech processing is handled by the Large Language Model (LLM) Gemini, though the use of a locally hosted LLM would also be possible. Additionally, the robot can display information on its screen. For example, QR codes for websites can be displayed when Pepper is asked about tourist attractions.

The robot is not merely an information terminal that remains stationary in one place. It can move and navigate to defined waypoints within a mapped area. This is also done via voice control. It is programmed to maintain a safe distance from people and obstacles. Newer models can also recognize people, a capability the 10-year-old version the students worked with does not yet possess. The old operating system also had to be updated to run the current software. “When we were able to talk to Pepper for the first time, it was a special moment for us,” says student Niklas Nakotte. 

The project results show that Pepper is generally very well suited for use in tourist information. However, it does not function reliably when too many people speak at the same time, which is why it is less suitable for trade shows and other large events. Additionally, further programming would be necessary. “PepperMINT” was a pilot project that laid the groundwork. “We have an idea for a micro-project in which Pepper will be tested in real life at the cruise terminal. Bremerhaven University of Applied Sciences is a great partner that we’re happy to work with,” says science liaison Corinna Brand. 

The Bachelor’s program in Computer Science at Bremerhaven University of Applied Sciences is characterized by a broad foundation in the field. In addition to gaining solid programming skills, students learn engineering-based approaches to developing complex software systems in teams. The Bachelor’s program in Business Informatics offers a solid education in information technology engineering combined with foundational and applied knowledge of business administration. This is because business informatics professionals act as interpreters between the distinct worlds of computer science and business administration, where communication often breaks down. The knowledge gained in both programs is reinforced during a practical semester. State-of-the-art computer labs provide the opportunity to test networks, software environments, application software, and specialized tools under real-world conditions. In open labs, students can collaborate with faculty to conduct experiments, such as developing the program’s server infrastructure.

(automatically translated by deepl.com)