SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2306.09712 · ICML · 2023

Semi-Offline Reinforcement Learning for Optimized Text Generation

Rui Yan, Yi Liu, Li Dong, Xiting Wang, Changyu Chen, Yiqiao Jin, Victor Dong, Jie Cao

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In reinforcement learning (RL), there are two major settings for interacting with the environment: online and offline. Online methods explore the environment at significant time cost, and offline methods efficiently obtain reward signals by sacrificing exploration capability. We propose semioffline RL, a novel paradigm that smoothly transits from offline to online settings, balances exploration capability and training cost, and provides a theoretical foundation for comparing different RL settings. Based on the semi-offline formulation, we present the RL setting that is optimal in terms of optimization cost, asymptotic error, and overfitting error bound. Extensive experiments show that our semi-offline approach is efficient and yields comparable or often better performance compared with state-of-the-art methods. Our code is available at https://github.com/ChangyuChen347/semioffline-RL.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2306.09712")
get_code_for_paper("2306.09712")
have("2306.09712")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2306.09712.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2306.09712.svg)](https://syntology.ai/paper/2306.09712)

Connect an agent — have() is free.