Evaluation of Deep Convolutional Neural Network-Based Tattoo Detection

In this study, two deep learning models for automatic tattoo detection were analyzed; a modified Convolutional Neural Network (CNN) and pre-trained ResNet-50 model. In order to achieve this, ResNet-50 uses transfer learning with fine-tuning. The purpose of this study was to evaluate the accuracy, precision, recall, F1-score, and computational efficiency of the system being considered. To augment the dataset included 1000 photos that were equally divided between those showing tattoos and those that did not show tattoos. A k-fold cross-validation approach was employed in training and testing the models. Although custom CNNs are effective, utilizing pre-trained ones like ResNet-50 can offer even better outcomes. Specifically, ResNet-50 attained a higher accuracy (0.86 compared to 0.79), precision (0.85 versus 0.78), recall (0.91 against 0.86), and F1-score (0.91 vis-a-vis 0.86) as compared to custom CNNs. In selecting these models for examination, two main motivations were considered. The first motivation is to see whether transfer learning with a pre-trained ResNet-50 model does well when compared with a customized CNN designed specifically for tattoo detection. Secondly,the intent of this study is to know what advantages can be derived from each approach and their demerits too. Furthermore, it seeks to determine if transfer learning can provide an alternative in contrast to the common CNN techniques with regards to precision and computational efficiency. In this research, two models will be evaluated in order to answer the question of what is better for tattoo detection: transfer learning or designing custom architectures.