SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2002.03557 · 2020

Multitask Emotion Recognition with Incomplete Labels

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 7 functions out of this paper's own repositories and ran 7 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

FunctionStatusWhere it lives
sigmoid Ran HKUST-NISL/Multitask-Emotion-Recognition-with-Incomplete-Labels/Multitask-CNN-RNN/val.py
code served (permissive licence) · get_code("b8e95809ca2c17c9")
IRLbl Ran HKUST-NISL/Multitask-Emotion-Recognition-with-Incomplete-Labels/Multitask-CNN-RNN/torchsampler/imbalanced_ML.py
code served (permissive licence) · get_code("a6365a0e5e75becf")
MeanIR Ran HKUST-NISL/Multitask-Emotion-Recognition-with-Incomplete-Labels/Multitask-CNN-RNN/torchsampler/imbalanced_ML.py
code served (permissive licence) · get_code("67ee8f792913dc4d")
accuracy Ran HKUST-NISL/Multitask-Emotion-Recognition-with-Incomplete-Labels/Multitask-CNN-RNN/utils/model_utils.py
code served (permissive licence) · get_code("9892ec4891095438")
averaged_accuracy Ran HKUST-NISL/Multitask-Emotion-Recognition-with-Incomplete-Labels/Multitask-CNN-RNN/utils/model_utils.py
code served (permissive licence) · get_code("377d492e7d719b31")
averaged_f1_score Ran HKUST-NISL/Multitask-Emotion-Recognition-with-Incomplete-Labels/Multitask-CNN-RNN/utils/model_utils.py
code served (permissive licence) · get_code("f068ad448aee186f")
parse_txt Ran wtomin/Multitask-Emotion-Recognition-with-Incomplete-Labels/emotion_demo.py
code served (permissive licence) · get_code("3a0dedf12c75778e")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We train a unified model to perform three tasks: facial action unit detection, expression classification, and valence-arousal estimation. We address two main challenges of learning the three tasks. First, most existing datasets are highly imbalanced. Second, most existing datasets do not contain labels for all three tasks. To tackle the first challenge, we apply data balancing techniques to experimental datasets. To tackle the second challenge, we propose an algorithm for the multitask model to learn from missing (incomplete) labels. This algorithm has two steps. We first train a teacher model to perform all three tasks, where each instance is trained by the ground truth label of its corresponding task. Secondly, we refer to the outputs of the teacher model as the soft labels. We use the soft labels and the ground truth to train the student model. We find that most of the student models outperform their teacher model on all the three tasks. Finally, we use model ensembling to boost performance further on the three tasks.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2002.03557")
get_code_for_paper("2002.03557")
have("2002.03557")

Connect an agent — have() is free.