SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2411.12775 · 2024

Revisiting Fake News Detection: Towards Temporality-aware Evaluation by Leveraging Engagement Earliness

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 7 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
leejunmo/dawn canonical 1 of 7
FunctionStatusWhere it lives
str2bool Ran leejunmo/dawn/utils.py
pointer only (licence: NONE) · get_code("7c508037b40522af")
arg_as_list Not yet run leejunmo/dawn/utils.py
pointer only (licence: NONE) · get_code("bffdebdc7c98629b")
generate_tweet_timestamp_id Not yet run leejunmo/dawn/TimestampEstimator.py
pointer only (licence: NONE) · get_code("9c6b89adc2824227")
get_current_tweet_id Not yet run leejunmo/dawn/TimestampEstimator.py
pointer only (licence: NONE) · get_code("2d0ba8a2ba9a8edd")
get_tweet_timestamp Not yet run leejunmo/dawn/TimestampEstimator.py
pointer only (licence: NONE) · get_code("687c3a914b264a92")
make_eng_mat Not yet run leejunmo/dawn/construct_data.py
pointer only (licence: NONE) · get_code("17c20d367ab8a4ab")
strlower Not yet run leejunmo/dawn/utils.py
pointer only (licence: NONE) · get_code("e551dbf2d956ad41")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Social graph-based fake news detection aims to identify news articles containing false information by utilizing social contexts, e.g., user information, tweets and comments. However, conventional methods are evaluated under less realistic scenarios, where the model has access to future knowledge on article-related and context-related data during training. In this work, we newly formalize a more realistic evaluation scheme that mimics real-world scenarios, where the data is temporality-aware and the detection model can only be trained on data collected up to a certain point in time. We show that the discriminative capabilities of conventional methods decrease sharply under this new setting, and further propose DAWN, a method more applicable to such scenarios. Our empirical findings indicate that later engagements (e.g., consuming or reposting news) contribute more to noisy edges that link real news-fake news pairs in the social graph. Motivated by this, we utilize feature representations of engagement earliness to guide an edge weight estimator to suppress the weights of such noisy edges, thereby enhancing the detection performance of DAWN. Through extensive experiments, we demonstrate that DAWN outperforms existing fake news detection methods under real-world environments. The source code is available at https://github.com/LeeJunmo/DAWN.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2411.12775")
get_code_for_paper("2411.12775")
have("2411.12775")

Connect an agent — have() is free.