SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2602.10685 · 2026

Beyond Task Performance: A Metric-Based Analysis of Sequential Cooperation in Heterogeneous Multi-Agent Destructive Foraging

Alejandro Mendoza Barrionuevo, Samuel Luis, Daniel Gutiérrez, Sergio Toral Marín

arXiv · PDF · Open in the Atlas

Code that ran

8 of 9 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 1 honoured the contract we drafted, 1 violated it and 0 have no contract verdict; 6 failures of our instrument; 1 no recorded run), measured 2026-11-22; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2602.10685.json · badge: /api/ran/2602.10685.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
amendb/CollaborationMetrics canonical (classifier label)
classifier basis: census
8 ran · 1 no recorded run
FunctionStatusWhere it lives
a_star_find_path Ran
ran; our contract draft was wrong, not the code
amendb/CollaborationMetrics/Algorithms/a_star2.py
pointer only (licence: NONE) · get_code("a530b08843e49186")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

calculate_heuristic Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
amendb/CollaborationMetrics/Algorithms/a_star.py
pointer only (licence: NONE) · get_code("70e2f075da841dcd")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

create_node Ran
ran; our contract draft was wrong, not the code
amendb/CollaborationMetrics/Algorithms/a_star.py
pointer only (licence: NONE) · get_code("0d99a8631178298e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_slope Ran
ran, honoured the contract we drafted
amendb/CollaborationMetrics/Evaluation/AlgorithmAnalizerLegendarium.py
pointer only (licence: NONE) · get_code("fde54bbef5011dd3")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_valid_neighbors Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
amendb/CollaborationMetrics/Algorithms/a_star.py
pointer only (licence: NONE) · get_code("18bc793664dc0596")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

heuristic Ran
ran, violated the contract we drafted
amendb/CollaborationMetrics/Algorithms/a_star2.py
pointer only (licence: NONE) · get_code("f1161108aaeac133")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

is_reachable Ran
ran; our contract draft was wrong, not the code
amendb/CollaborationMetrics/Environment/CleanupEnvironment.py
pointer only (licence: NONE) · get_code("be266ba0d055a639")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

process_dataframe Ran
ran; our contract draft was wrong, not the code
amendb/CollaborationMetrics/Evaluation/AlgorithmAnalizerLegendarium.py
pointer only (licence: NONE) · get_code("65c9c893e779da9f")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

calculate_global_metrics Not yet run
unverified (harvested, no recorded run)
amendb/CollaborationMetrics/Evaluation/AlgorithmAnalizerLegendarium.py
pointer only (licence: NONE) · get_code("793509ed70d5f89f")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, amendb/CollaborationMetrics when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 9 samples lifted from this paper's linked repositories, 9 carry a function identity and 0 do not. Of the 9 distinct functions with an identity, 1 are also present in other papers whose code we hold (1 with at least one paper dated earlier, 0 the same month, 0 later) and 8 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
heuristic 2 other papers
2 dated earlier
2407.07086 (2024-07)
Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Models
2501.07343 (2025-01)
Fast-Revisit Coverage Path Planning for Autonomous Mobile Patrol Robots Using Long-Range Sensor Information

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

This work addresses the problem of analyzing cooperation in heterogeneous multi-agent systems which operate under partial observability and temporal role dependency, framed within a destructive multi-agent foraging setting. Unlike most previous studies, which focus primarily on algorithmic performance with respect to task completion, this article proposes a systematic set of general-purpose cooperation metrics aimed at characterizing not only efficiency, but also coordination and dependency between teams and agents, fairness, and sensitivity. These metrics are designed to be transferable to different multi-agent sequential domains similar to foraging. The proposed suite of metrics is structured into three main categories that jointly provide a multilevel characterization of cooperation: primary metrics, interteam metrics, and intra-team metrics. They have been validated in a realistic destructive foraging scenario inspired by dynamic aquatic surface cleaning using heterogeneous autonomous vehicles. It involves two specialized teams with sequential dependencies: one focused on the search of resources, and another on their destruction. Several representative approaches have been evaluated, covering both learning-based algorithms and classical heuristic paradigms.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2602.10685")
get_code_for_paper("2602.10685")
have("2602.10685")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2602.10685.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2602.10685.svg)](https://syntology.ai/paper/2602.10685)

Connect an agent — have() is free.