Smart mirror application for social event based outfit recommendation and skin health analysis

Abstract

The rapid evolution of Artificial Intelligence(AI) has paved the way for innovative applications in everyday objects. Among these, a smart mirror is a representation of a traditional mirror with integrated technologies to provide realtime personalized recommendations and health insights. Busy schedules make it challenging for individuals to manage their to-do lists, health, and even dress code choices. According to the past work done, both Khandaker et al. [1] and Simone et al. [2] developed smart mirrors with various features, such as face verification, weather updates, calendar events, news, traffic, and emotion recognition. Considering social event-based fashion recommendation, Federico et al [3] proposed an event classifier combined with a recommender by implementing a fashion object detector for social events. Nikita et al [4] proposed outfit recommendation by detecting user outfits, identifying the social event, and suggesting similar outfits for the detected event. However the system lacks the ability of considering outfits suitable for multiple social events. In the context of acne detection, Quan et al. [5] proposed an automatic system that employs Faster Region-based Convolutional Neural Network (R-CNN) for acne lesion detection and LightGBM for severity grading. Similarly, Hang et al. [6] introduced an ensemble neural network-based approach featuring a classification module for severity estimation and an acne localization module. However, prior research has focused on general acne detection, there is limited work addressing localizing acne within the ”Danger Triangle of the Face” which is a crucial clinical aspect. This research proposes a comprehensive Internet of Things(IoT) smart mirror framework to address past limitations. Mainly, it has features for face verification, acne detection with ”Triangle of Death” localization, and social event-based fashion recommendation. By leveraging these components, the proposed smart mirror represents a significant advancement towards smart computing, seamlessly integrated with digital intelligence.