SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2003.05995 · 2020

CRWIZ: A Framework for Crowdsourcing Real-Time Wizard-of-Oz Dialogues

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 7 functions out of this paper's own repositories and ran 2 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
JChiyah/crwiz canonical 2 of 7
FunctionStatusWhere it lives
match_utterance_to_state_formulation Ran JChiyah/crwiz/app/crwiz/utils/helper.py
code served (permissive licence) · get_code("4ab72a7fbdc3e9a3")
state_contains_action Ran JChiyah/crwiz/app/crwiz/fake_actions.py
code served (permissive licence) · get_code("303694cee996f344")
filter_used_transitions Not yet run JChiyah/crwiz/app/crwiz/finite_state_machine.py
code served (permissive licence) · get_code("7421270ead42ade4")
get_room_logs Not yet run JChiyah/crwiz/app/crwiz/utils/log_utils.py
code served (permissive licence) · get_code("d7ce4615a8831b14")
get_user_logs Not yet run JChiyah/crwiz/app/crwiz/utils/log_utils.py
code served (permissive licence) · get_code("be30b361a9f699b0")
load_dialogue_states Not yet run JChiyah/crwiz/app/crwiz/dialogue_state.py
code served (permissive licence) · get_code("741a2ed3a398fe66")
perform_post_task_analysis Not yet run JChiyah/crwiz/app/crwiz/utils/post_task_analysis.py
code served (permissive licence) · get_code("a7db20b99d43d14b")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Large corpora of task-based and open-domain conversational dialogues are hugely valuable in the field of data-driven dialogue systems. Crowdsourcing platforms, such as Amazon Mechanical Turk, have been an effective method for collecting such large amounts of data. However, difficulties arise when task-based dialogues require expert domain knowledge or rapid access to domain-relevant information, such as databases for tourism. This will become even more prevalent as dialogue systems become increasingly ambitious, expanding into tasks with high levels of complexity that require collaboration and forward planning, such as in our domain of emergency response. In this paper, we propose CRWIZ: a framework for collecting real-time Wizard of Oz dialogues through crowdsourcing for collaborative, complex tasks. This framework uses semi-guided dialogue to avoid interactions that breach procedures and processes only known to experts, while enabling the capture of a wide variety of interactions. The framework is available at https://github.com/JChiyah/crwiz

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2003.05995")
get_code_for_paper("2003.05995")
have("2003.05995")

Connect an agent — have() is free.