Researchers at the Fraunhofer Institute for Digital Media Technology IDMT in Oldenburg developed a speech recognition solution for use in industrial production.
The use of speech recognition in manufacturing was previously considered prone to errors. As a result, it was rarely adopted. Now, the Fraunhofer IDMT in Oldenburg has developed a solution. This enables users to control the machines reliably via voice commands. Even on a noisy factory floor, the speech recognition system works reliably. Employees speak into a wireless headset or a fixed microphone. And in future, they could use smart hearing technology. A combination of directional microphones and an effective noise-cancelling system can suppress loud ambient noise.
Speech recognition
Marvin Norda, the project manager for voice-activated manufacturing at Fraunhofer IDMT, explains the project. "For the first time, our technology enables people to control machines in production in a reliable, intuitive way using voice commands. For manufacturing companies, this means more efficiency and lower costs." The technology also benefits workers because contactless machine operation is safe and also hygienic."
Walking less far
"When workers operate multiple machines, they do not have to walk as far. For example, they can use a mobile device to give voice commands to the equipment remotely. And they have both hands free, allowing them to move a workpiece into position in the work area while simultaneously giving the robot an instruction such as "lower the arm" or "grab the workpiece".
Efficient speech recognition
Operating a machine via voice commands is more efficient than via a control panel or touch panel. Clicking through nested menu structures is a cumbersome and error-prone process, while direct voice commands involve simple instructions.
Hundreds of commands
"Speech recognition technology can handle hundreds of individual commands. This depends on the application and is not limited to a particular voice. It is possible to quickly add new or modified commands and train the system," Norda adds.
Experience and expertise
Oldenburg-based researchers have years of experience and expertise in research and development of audio technologies and speech recognition software. This is something that also benefits the more than 50 companies that are members of AiP (Audio Technology for Intelligent Manufacturing), an industrial working group established by Fraunhofer IDMT in Oldenburg.
Industrial customers
“We develop customisable system solutions for industrial customers. The voice control system can be configured to their individual needs and put into operation quickly,” says Norda. The speech recognition software can be integrated into the cloud or the company’s server, depending on the company’s requirements. It is also possible to seamlessly integrate a mini-PC. Alternatively, the system can be integrated into a machine’s PLC.
Test phase
Lower Saxony's Ministry of Science and Culture and the Volkswagen Foundation are supporting the project. The solution is now ready for the market and is already being tested by some industrial customers. At the Hannover Messe from 17-21 April 2023, visitors can see the technology and explore its possibilities live at the Fraunhofer stand. There will be demonstrations with a voice-activated milling machine.
Photo 1: Machines like this milling machining centre can be controlled using speech recognition systems and audio technology from Fraunhofer IDMT in Oldenburg. (Photo: Fraunhofer IDMT / Anika Bödecker)
