EMOTION DETECTION AND CLASSIFICATION SYSTEM BASED ON SOUND FLOW DATA

Abstract

In today's rapidly changing and demanding work environment, the ability to quickly and accurately assess an employee's emotional state is crucial to protecting human lives and reducing material risks. Emotional well-being plays an important role in workplace safety, productivity, and overall mental health. Therefore, the development of effective tools for monitoring negative emotions and responding to them is an urgent task of our time. The purpose of this study is to develop an algorithm capable of classifying emotions using audio data recorded by a user's smartphone. Such a tool is especially useful if integrated into a broader health monitoring system that allows you to evaluate human health indicators in real time using non-invasive methods. This article presents a new solution that uses acoustic signals picked up by a smartphone microphone to detect and classify user emotions. Using convolutional neural networks (CNNS), a type of deep learning algorithm known for its effectiveness in processing audio and visual data, the proposed system can determine the user's emotional state. The CNN model is trained to recognize patterns in audio data corresponding to various emotional manifestations, focusing on detecting negative emotions such as anger or sadness. The results of the study demonstrate the effectiveness of the system: the error rate in determining negative emotions is 19.5% for false positive results (errors of the first kind) and 20.1% for false negative results (errors of the second kind). These indicators indicate its potential for practical application in real conditions. By integrating this solution into existing biomedical monitoring systems, organizations can expand their ability to monitor the emotional well-being of employees, potentially preventing negative consequences such as industrial accidents or mental health crises. The integration of emotion recognition using smartphones into health monitoring systems represents significant progress in the field of non-invasive biomedical monitoring, using the ubiquitous presence of smartphones and machine learning capabilities.