SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2310.08278 · 2023

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 3 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
time-series-foundation-models/lag-llama canonical 2 of 2
copy not recorded — 1 of 1
FunctionStatusWhere it lives
apply_rotary_pos_emb Ran time-series-foundation-models/lag-llama/lag_llama/model/module.py
code served (permissive licence) · get_code("9a65a30d006fc96e")
find_multiple Ran time-series-foundation-models/lag-llama/lag_llama/model/module.py
code served (permissive licence) · get_code("aba86ffbed27ba65")
rotate_half Ran this paper's copy was not recorded; identical code first harvested from Time-MoE/Time-MoE
pointer only · get_code("e03d53ba9d4f9ae5")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Over the past years, foundation models have caused a paradigm shift in machine learning due to their unprecedented capabilities for zero-shot and few-shot generalization. However, despite the success of foundation models in modalities such as natural language processing and computer vision, the development of foundation models for time series forecasting has lagged behind. We present Lag-Llama, a general-purpose foundation model for univariate probabilistic time series forecasting based on a decoder-only transformer architecture that uses lags as covariates. Lag-Llama is pretrained on a large corpus of diverse time series data from several domains, and demonstrates strong zero-shot generalization capabilities compared to a wide range of forecasting models on downstream datasets across domains. Moreover, when fine-tuned on relatively small fractions of such previously unseen datasets, Lag-Llama achieves state-of-the-art performance, outperforming prior deep learning approaches, emerging as the best general-purpose model on average. Lag-Llama serves as a strong contender to the current state-of-art in time series forecasting and paves the way for future advancements in foundation models tailored to time series data.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2310.08278")
get_code_for_paper("2310.08278")
have("2310.08278")

Connect an agent — have() is free.