- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
A Thermal Infrared Face Database With Facial Landmarks and Emotion Labels
摘要： Thermal infrared imaging is an emerging modality that has gained increasing interest in recent years, mostly due to technical advances resulting in the availability of affordable microbolometer-based IR imaging sensors. However, while sensors are widely available, algorithms for thermal image processing still lack robustness and accuracy when compared to their RGB counterparts. Current methods developed for RGB data make use of machine learning algorithms that require large amounts of labeled images which are currently not available for the thermal domain. In this paper, we address the question whether providing a large number of labeled images would allow the application of current image processing methods on the example of solving challenging face analysis tasks. We introduce a high-resolution thermal facial image database with extensive manual annotations and explore how it can be used to adapt methods from the visual domain for infrared images. In addition, we extend existing approaches for infrared landmark detection with a head pose estimation for improved robustness and analyze the performance of a deep learning method on this task. An evaluation of algorithm performance shows that learning algorithms either outperform available solutions or allow completely new applications that could previously not be addressed. As a conclusion, we prove that investing the effort into acquiring appropriate training data and adapting competitive algorithms is not only a viable approach in analysing thermal infrared images but can also allow outperforming specific task-designed solutions. The database is freely available for academic use at https://github.com/marcinkopaczka/thermalfaceproject.
关键词： face tracking,thermal infrared,machine learning,facial expression recognition,Face detection
更新于2025-09-04 15:30:14
-
Machine Learning-Based Charge Transport Computation for Pentacene
摘要： Insight into the relation between morphology and transport properties of organic semiconductors can be gained using multiscale simulations. Since computing electronic properties, such as the intermolecular transfer integral, using quantum chemical (QC) methods requires a high computational cost, existing models assume several approximations. A machine learning (ML)–based multiscale approach is presented that allows to simulate charge transport in organic semiconductors considering the static disorder within disordered crystals. By mapping ?ngerprints of dimers to their respective transfer integral, a kernel ridge regression ML algorithm for the prediction of charge transfer integrals is trained and evaluated. Since QC calculations of the electronic structure must be performed only once, the use of ML reduces the computation time radically, while maintaining the prediction error small. Transfer integrals predicted by ML are utilized for the computation of charge carrier mobilities using o?-lattice kinetic Monte Carlo (kMC) simulations. Bene?ting from the rapid performance of ML, microscopic processes can be described accurately without the need for phenomenological approximations. The multiscale system is tested with the well-known molecular semiconductor pentacene. The presented methodology allows reproducing the experimentally observed anisotropy of the mobility and enables a fast estimation of the impact of disorder.
关键词： machine learning,multiscale approach,organic semiconductors,charge transport,pentacene
更新于2025-09-04 15:30:14