SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2602.01606 · 2026

Boosting Maximum Entropy Reinforcement Learning via One-Step Flow Matching

Zheng Li, Haoyu Wang, Yijing Wang, Zhiqiang Zuo, Zeqiao Li

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Diffusion policies are expressive yet incur high inference latency. Flow Matching (FM) enables one-step generation, but integrating it into Maximum Entropy Reinforcement Learning (MaxEnt RL) is challenging: the optimal policy is an intractable energy-based distribution, and the efficient log-likelihood estimation required to balance exploration and exploitation suffers from severe discretization bias. We propose Flowbased Log-likelihood-Aware Maximum Entropy RL (FLAME), a principled framework that addresses these challenges. First, we derive a Q-Reweighted FM objective that bypasses partition function estimation via importance reweighting. Second, we design a decoupled entropy estimator that rigorously corrects bias, which enables efficient exploration and brings the policy closer to the optimal MaxEnt policy. Third, we integrate the MeanFlow formulation to achieve expressive and efficient one-step control. Empirical results on MuJoCo show that FLAME outperforms Gaussian baselines and matches multistep diffusion policies with significantly lower inference cost. Code is available at https: //github.com/lzqw/FLAME.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2602.01606")
get_code_for_paper("2602.01606")
have("2602.01606")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2602.01606.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2602.01606.svg)](https://syntology.ai/paper/2602.01606)

Connect an agent — have() is free.