SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2501.17151 · NeurIPS · 2024

Scanning Trojaned Models Using Out-of-Distribution Samples

Mohammad Rohban, Hossein Mirzaei, Mojtaba Nafez, Jafar Habibi, Mohammad Sabokrou, Ali Ansari, Bahar Dibaei, Moein Madadi, Sepehr Rezaee, † Zeinab, Sadat Taghavi, Arad Maleki, and 2 more

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 8 functions out of this paper's own repositories and ran 5 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
rohban-lab/trodo canonical 4 of 7
copy not recorded — 1 of 1
FunctionStatusWhere it lives
Attack Ran rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("2e0cda14736613a9")
get_models_scores Ran rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("8fed773e3caa0c82")
get_msp Ran rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("fedab0497f8658a8")
get_results Ran rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("6cf451e2ce941877")
wrapper_method Ran this paper's copy was not recorded; identical code first harvested from nilspwalter/the-uncanny-valley
pointer only · get_code("9b45cb80d93fe980")
PGD Not yet run rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("944b6daf2fbff670")
mean_id_score_diff Not yet run rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("ab7b73c6a0686190")
mean_id_score_diff Not yet run rohban-lab/trodo/src/evaluate.py
pointer only (licence: NONE) · get_code("8e71e877296483f4")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Scanning for trojan (backdoor) in deep neural networks is crucial due to their significant real-world applications. There has been an increasing focus on developing effective general trojan scanning methods across various trojan attacks. Despite advancements, there remains a shortage of methods that perform effectively without preconceived assumptions about the backdoor attack method. Additionally, we have observed that current methods struggle to identify classifiers trojaned using adversarial training. Motivated by these challenges, our study introduces a novel scanning method named TRODO (TROjan scanning by Detection of adversarial shifts in Out-of-distribution samples). TRODO leverages the concept of "blind spots"-regions where trojaned classifiers erroneously identify out-of-distribution (OOD) samples as in-distribution (ID). We scan for these blind spots by adversarially shifting OOD samples towards in-distribution. The increased likelihood of perturbed OOD samples being classified as ID serves as a signature for trojan detection. TRODO is both trojan and label mapping agnostic, effective even against adversarially trained trojaned classifiers. It is applicable even in scenarios where training data is absent, demonstrating high accuracy and adaptability across various scenarios and datasets, highlighting its potential as a robust trojan scanning strategy. The code repository is available at: https://github.com/rohban-lab/TRODO.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2501.17151")
get_code_for_paper("2501.17151")
have("2501.17151")

Connect an agent — have() is free.