awesome-vision-time-series

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #llm #go #android #machine-learning #linux #docker #windows #security #openai #mcp

awesome-vision-time-series

(★ 86)

This is an official repository for "Harnessing Vision Models for Time Series Analysis: A Survey".

awesome-vision-time-series Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Awesome Vision for Time Series (Vision4TS) Papers
[![Awesome](https://awesome.re/badge.svg)](https://awesome.re)
![PRs Welcome](https://img.shields.io/badge/PRs-Welcome-green)
[![arXiv](https://img.shields.io/badge/arXiv-2502.08869-b31b1b.svg)](https://www.arxiv.org/abs/2502.08869)
[![PyPI - Version](https://img.shields.io/pypi/v/version)](https://raw.githubusercontent.com/D2I-Group/awesome-vision-time-series/main/)

[[时序人](https://mp.weixin.qq.com/s/S0XENUWyGAKeywSlpwmWXA)] [[时空探索之旅](https://mp.weixin.qq.com/s/bHjPce44dWoQ7W-Dr7IZ3A)] [[时序之心](https://mp.weixin.qq.com/s/pFsCwut33CfLFlaKzdKFoA)]
</div>

This repository tracks the latest paper on Vision Models for Time series Analysis and serves as the official repository for [Harnessing Vision Models for Time Series Analysis: A Survey](https://www.arxiv.org/abs/2502.08869). This repository is actively maintained by **D2I Group@UH**. We will update our reposititory and survey regularly.

🌟 [News] Our survey paper is accepted by IJCAI 2025 survey track!

🌟 You're welcome to suggest new Vision4TS papers by contacting jni7 [at] uh [dot] edu!

🌟 Please consider [citing](#citation) our survey paper if you find it helpful :), and feel free to share this repository with others!

<p align="center">
    🏆&nbsp;<a href="#contribution">Contribution</a>
    | 📌&nbsp;<a href="#taxonomy">Taxonomy</a>
    | ⚙️&nbsp;<a href="#package">Package</a>
    | 🔗&nbsp;<a href="#citation">Citation</a>
</p>

***

### Contribution

Time series analysis has witnessed the inspiring development from traditional autoregressive models, deep learning models, to recent Transformers and Large Language Models (LLMs). Efforts in leveraging vision models for time series analysis have also been made along the way but are less visible to the community due to the predominant research on sequence modeling in this domain. However, the discrepancy between continuous time series and the discrete token space of LLMs, and the challenges in explicitly modeling the correlations of variates in multivariate time series have shifted some research attentions to the equally successful Large Vision Models (LVMs) and Vision Language Models (VLMs). To fill the blank in the existing literature, this survey discusses the advantages of vision models over LLMs in time series analysis and provides a comprehensive and in-depth overview of the existing methods.

Taxonomy are proposed as a dual view of *Time Series to Image Transformation* and *Imaged Time Series Modeling*. For the former, primary methods for imaging UTS or MTS are described and remarked on their pros and cons. For the latter, the existing methods are classified by conventional vision models, Large Vision Models (LVMs) and Large Multimodal Models (LMMs).

|[<img src="./fig/structure.png" width="450"/>](./fig/structure.png)|
|:--:| 
|Figure 1: The general process of leveraging vision models for time series analysis|
</div>

|[<img src="./fig/image_plot.png" width="550"/>](./fig/image_plot.png)|
|:--:| 
|Figure 2: Image Transformation of Time Series|
</div>

|[<img src="./fig/Pipeline.png" width="450"/>](./fig/Pipeline.png)|
|:--:| 
|Figure 3: Illustration of different modeling strategies on imaged time series |
</div>

The overall structure of our survey follows the general process of applying vision models for time series analysis as delineated in Figure 1. Based on the proposed dual view taxonomy, primary imaging methods on time series in Figure 2 and imaged modelling solutions in Figure 3, are reviewed in this survey, followed by the discussion including pre- & post-processing involved in this framework and future directions in this promising field.

***
### Package

This package provides the common visualization methods for time series, including Line Plot, Heatmap, Spectrogram (STFT, Wavelet Transform, Filterbank), GAP and RP. We have uploaded our code package to PyPI, run the following command for installation.

```bash
pip install time2img
```
Our code is compatible with all common benchmarks found in [Google Drive](https://drive.google.com/drive/folders/1ZOYpTUa82_jCcxIdTmyr0LXQfvaM9vIy). You can run [example](./src/main.py) to reproduce our illustration of different time series imaging methods (Figure 2) in the [paper](https://www.arxiv.org/abs/2502.08869).

***
### List of Vision4TS Papers

#### Surveys

* [2025] [IJCAI] Harnessing Vision Models for Time Series Analysis: A Survey [[paper](https://www.arxiv.org/abs/2502.08869)][[code](https://github.com/D2I-Group/awesome-vision-time-series)]
* [2025] [JILSA] Unsupervised Time-Series Signal Analysis with Autoencoders and Vision Transformers: A Review of Architectures and Applications [[paper](https://arxiv.org/abs/2504.16972)]

#### Tutorials

* [2025] [KDD] Multi-Model Time Series Analysis: Data, Methods, and Applications [[website](https://uconn-dsis.github.io/MMTSA_tutorial/)]

#### Papers

🗓️ **2026** ---
* [2026] [Arxiv] Time Series, Vision, and Language: Exploring the Limits of Alignment in Contrastive Representation Spaces [[paper](https://arxiv.org/abs/2602.19367)]
* [2026] [Arxiv] TimeOmni-VL: Unified Models for Time Series Understanding and Generation [[paper](https://arxiv.org/abs/2602.17149)]
* [2026] [AAAI] Harnessing Vision-Language Models for Time Series Anomaly Detection [[paper](https://arxiv.org/abs/2506.06836)]
* [2026] [AAAI] OccamVTS: Distilling Vision Models to 1% Parameters for Time Series Forecasting [[paper](https://www.arxiv.org/abs/2508.01727)][[code](https://github.com/sisuolv/OccamVTS)]

<br>

🗓️ **2025** ---
* [2025] [Arxiv] SVTime: Small Time Series Forecasting Models Informed by "Physics" of Large Vision Model Forecasters [[paper](https://arxiv.org/abs/2510.09780)]
* [2025] [Arxiv] ViFusionTST: Deep Fusion of Time-Series Image Representations from Load Signals for Early Bed-Exit Prediction [[paper](https://arxiv.org/abs/2506.22498)]
* [2025] [Arxiv] Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers [[paper](https://arxiv.org/abs/2506.08641)]
* [2025] [Arxiv] MLLM4TS: Leveraging Vision and Multimodal Language Models for General Time-Series Analysis [[paper](https://arxiv.org/abs/2510.07513)]
* [2025] [CAIE] TSSI: Time Series as Screenshot Images for multivariate time series classification using convolutional neural networks [[paper](https://www.sciencedirect.com/science/article/abs/pii/S036083522500539X)]
* [2025] [Arxiv] Vision-Enhanced Time Series Forecasting via Latent Diffusion Models [[paper](https://arxiv.org/abs/2502.14887)]
* [2025] [Arxiv] VisionTS++: Cross-Modal Time Series Foundation Model with Continual Pre-trained Visual Backbones [[paper](https://www.arxiv.org/abs/2508.04379)][[code](https://github.com/HALF111/VisionTSpp)]
* [2025] [Arxiv] From Images to Signals: Are Large Vision Models Useful for Time Series Analysis? [[paper](https://arxiv.org/abs/2505.24030)]
* [2025] [NeurIPS] A Diffusion Model for Regular Time Series Generation from Irregular Data with Completion and Masking [[paper](https://openreview.net/pdf?id=M9JmlA6Cgf)][[arxiv](https://arxiv.org/abs/2510.06699)][[code](https://github.com/azencot-group/ImagenI2R)]
* [2025] [NeurIPS] Multi-Modal View Enhanced Large Vision Models for Long-Term Time Series Forecasting [[paper](https://openreview.net/pdf/c03b46e53aba341582e8525a457a5893c8c3f9a5.pdf)][[arxiv](https://arxiv.org/abs/2505.24003)][[code](https://github.com/D2I-Group/dmmv)]
* [2025] [NeurIPS] GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Images [[paper](https://openreview.net/pdf/2b55553f2233d0f89ea4e560834a4bf40fa11f41.pdf)][[arxiv](https://arxiv.org/abs/2503.06073)][[code](https://github.com/lanxiang1017/GEM)]
* [2025] [NeurIPS Workshop] TimeMaster: Training Time-Series Multimodal LLMs to Reason via Reinforcement Learning [[paper](https://openreview.net/pdf?id=BaID9Ta6Ew)][[arxiv](https://arxiv.org/abs/2506.13705)][[code](https://github.com/langfengQ/TimeMaster)]
* [2025] [ICLR] TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis [[paper](https://openreview.net/pdf?id=1CLzLXSFNn)][[arxiv](https://arxiv.org/pdf/2410.16032)]
* [2025] [Arxiv] Can Multimodal LLMs Perform Time Series Anomaly Detection? [[paper](https://arxiv.org/abs/2502.17812)][[code](https://github.com/mllm-ts/VisualTimeAnomaly)]
* [2025] [ICML] Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting [[paper](https://arxiv.org/abs/2502.04395)][[code](https://github.com/CityMind-Lab/ICML25-TimeVLM)]
* [2025] [ICML] VisionTS: Visual masked autoencoders are free-lunch zero-shot time series forecasters [[paper](https://arxiv.org/abs/2408.17253)][[code](https://github.com/Keytoyze/VisionTS)]

<br>

🗓️ **2024** ---
* [2024] [KDD] CAFO: Feature-centric explanation on time series classification [[paper](https://arxiv.org/abs/2406.01833)][[code](https://github.com/eai-lab/CAFO)]
* [2024] [NeurIPS] Utilizing image transforms and diffusion models for generative modeling of short and long time series [[paper](https://openreview.net/pdf?id=2NfBBpbN9x)][[arxiv](https://arxiv.org/abs/2410.19538)][[code]](https://github.com/azencot-group/ImagenTime)
* [2024] [NeurIPS] Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Masking [[paper](https://proceedings.neurips.cc/paper_files/paper/2024/file/9c3828adf1500f5de3c56f6550dfe43c-Paper-Conference.pdf)][[arxiv](https://arxiv.org/abs/2409.19407)][[code](https://github.com/Eric-LRL/Brain-JEPA)]
* [2024] [NeurIPS Workshop] Vision language models are few-shot audio spectrogram classifiers [[paper](https://openreview.net/pdf?id=RnBAclRKOC)] [[arxiv](https://arxiv.org/abs/2411.12058)]
* [2024] [ICANN] Fusion of image representations for time series classification with deep learning [[paper](https://link.springer.com/chapter/10.1007/978-3-031-72347-6_16)][[code](https://sites.google.com/view/firts-paper)]
* [2024] [ICPR] ViT2 - Pre-training Vision Transformers for Visual Times Series Forecasting [[paper](https://link.springer.com/chapter/10.1007/978-3-031-78183-4_14)][[code](https://github.com/kochlisGit/VIT2)]
* [2024] [IEEE TKDE] Hierarchical context representation and self-adaptive thresholding for multivariate anomaly detection [[paper](https://ieeexplore.ieee.org/document/10417809)]
* [2024] [IEEE Sensors Journal] Multisensor data fusion and time series to image encoding for hardness recognition [[paper](https://ieeexplore.ieee.org/document/10600105)]
* [2024] [Finance Research Letters] Quantum-Enhanced Forecasting: Leveraging Quantum Gramian Angular Field and CNNs for Stock Return Predictions [[paper](https://www.sciencedirect.com/science/article/abs/pii/S1544612324008705)][[arxiv](https://arxiv.org/abs/2310.07427)]
* [2024] [Eng. Appl. Artif. Intell.] EEG channel selection using Gramian Angular Fields and spectrograms for energy data visualization [[paper](https://www.sciencedirect.com/science/article/abs/pii/S0952197624004639)]
* [2024] [Arxiv] Training-free time-series anomaly detection: Leveraging image foundation models [[paper](https://arxiv.org/abs/2408.14756)]
* [2024] [Arxiv] On the feasibility of vision-language models for time-series classification [[paper](https://arxiv.org/abs/2412.17304)][[code](https://github.com/vinayp17/VLM_TSC)]
* [2024] [Arxiv] See it, think it, sorted: Large multimodal models are few-shot time series anomaly analyzers [[paper](https://arxiv.org/abs/2411.02465)]
* [2024] [Arxiv] Plots unlock time-series understanding in multimodal models [[paper](https://arxiv.org/abs/2410.02637)]
* [2024] [Arxiv] ViTime: A visual intelligence-based foundation model for time series forecasting [[paper](https://arxiv.org/abs/2407.07311)][[code]](https://github.com/IkeYang/ViTime)
* [2024] [Arxiv] TimEHR: Image-based time series generation for electronic health records [[paper](https://arxiv.org/abs/2402.06318)][[code](https://github.com/esl-epfl/TimEHR)]

<br>

🗓️ **2023** ---
* [2023] [ICLR] TimesNet: Temporal 2d-variation modeling for general time series analysis [[paper](https://arxiv.org/abs/2210.02186)][[code](https://github.com/thuml/TimesNet)]
* [2023] [ICLR] BrainBERT: Self-supervised representation learning for intracranial recordings [[paper](https://openreview.net/pdf?id=xmcYx_reUn6)][[arxiv](https://arxiv.org/abs/2302.14367)][[code](https://github.com/czlwang/BrainBERT)]
* [2023] [NeurIPS] Time series as images: Vision transformer for irregularly sampled time series [[paper](https://arxiv.org/abs/2303.12799)][[code](https://github.com/Leezekun/ViTST)]
* [2023] [NeurIPS Workshop] Insight miner: A time series analysis dataset for cross-domain alignment with natural language [[paper](https://openreview.net/pdf?id=E1khscdUdH)]
* [2023] [ICASSP] AST-SED: An effective sound event detection method based on audio spectrogram transformer [[paper](https://arxiv.org/abs/2303.03689)]
* [2023] [ICAIF] From pixels to predictions: Spectrogram and vision transformer for better time series forecasting [[paper](https://arxiv.org/abs/2403.11047)]
* [2023] [BigDataService] ECG classification using Deep CNN and Gramian Angular Field [[paper](https://ieeexplore.ieee.org/document/10233925)][[arxiv](https://arxiv.org/abs/2308.02395)]
* [2023] [ASPAI] Classification of time series as images using deep convolutional neural networks: application to glitches in gravitational wave data [[paper](https://par.nsf.gov/servlets/purl/10411304)]
* [2023] [Neural Netw.] Image-based time series forecasting: A deep convolutional neural network approach [[paper](https://www.sciencedirect.com/science/article/abs/pii/S0893608022003902)]
* [2023] [Electr. Power Syst. Res.] The use of deep learning and 2-D wavelet scalograms for power quality disturbances classification [[paper](https://www.sciencedirect.com/science/article/pii/S0378779622008872)]
* [2023] [Arxiv] Leveraging vision-language models for granular market change prediction [[paper](https://arxiv.org/abs/2301.10166)]
* [2023] [Arxiv] Your time series is worth a binary image: machine vision assisted deep framework for time series forecasting [[paper](https://arxiv.org/abs/2302.14390)][[code](https://github.com/IkeYang/machine-vision-assisted-deep-time-series-analysis-MV-DTSA-)]

<br>

🗓️ **2022** ---
* [2022] [AAAI] SSAST: Self-supervised audio spectrogram transformer [[paper](https://arxiv.org/abs/2110.09784)][[code](https://github.com/YuanGongND/ssast)]
* [2022] [Interspeech] MAE-AST: Masked autoencoding audio spectrogram transformer [[paper](https://arxiv.org/abs/2203.16691)][[code](https://github.com/AlanBaade/MAE-AST-Public)]
* [2022] [EMBC] Encoding Cardiopulmonary Exercise Testing Time Series as Images for Classification using Convolutional Neural Network [[paper](https://ieeexplore.ieee.org/abstract/document/9871878)][[arxiv](https://arxiv.org/abs/2204.12432)][[code](https://github.com/YashSharma/MultivariateTimeSeries?tab=readme-ov-file)]
* [2022] [AIME] TTS-GAN: A transformer-based time-series generative adversarial network [[paper](https://arxiv.org/abs/2202.02691)][[code](https://github.com/imics-lab/tts-gan)]
* [2022] [Neural Process. Lett.] Time Series Classification Based on Image Transformation Using Feature Fusion Strategy [[paper](https://link.springer.com/article/10.1007/s11063-022-10783-z)]

<br>

🗓️ **2021** ---
* [2021] [Interspeech] AST: Audio spectrogram transformer [[paper](https://arxiv.org/abs/2104.01778)][[code](https://github.com/YuanGongND/ast)]
* [2021] [ICAIF] Visual time series forecasting: an image-driven approach [[paper](https://arxiv.org/abs/2011.09052)]
* [2021] [ICAIF] Deep video prediction for time series forecasting [[paper](https://arxiv.org/abs/2102.12061)]
* [2021] [IEEE ACM Trans. Audio Speech Lang. Process.] TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech [[paper](https://ieeexplore.ieee.org/document/9478264)][[arxiv](https://arxiv.org/abs/2007.06028)]

<br>

🗓️ **2020** ---
* [2020] [ICAIF] Trading via image classification [[paper](https://arxiv.org/abs/1907.10046)]
* [2020] [Expert Syst. Appl.] Forecasting with Time Series Imaging [[paper](https://arxiv.org/abs/1904.08064)][[code](https://github.com/lixixibj/forecasting-with-time-series-imaging)]
* [2020] [IEEE Access] Human Activity Recognition Based on Gramian Angular Field and Deep Convolutional Neural Network [[paper](https://ieeexplore.ieee.org/document/9234451)]
* [2020] [Energy] A novel ensemble method for hourly residential electricity consumption forecasting by imaging time series [[paper](https://www.sciencedirect.com/science/article/abs/pii/S0360544220309658)]
* [2020] [IEEE CAA J. Autom. Sinica] Deep learning and time series-to-image encoding for financial forecasting [[paper](https://ieeexplore.ieee.org/document/9080613)]

<br>

🗓️ **Before 2020** ---
* [2019] [AAAI] A Deep Neural Network for unsupervised anomaly detection and diagnosis in multivariate time series data [[paper](https://ojs.aaai.org/index.php/AAAI/article/view/3942)][[code](https://github.com/7fantasysz/MSCRED)]
* [2019] [Arxiv] Multivariate time series classification using dilated convolutional neural network [[paper](https://arxiv.org/abs/1905.01697)][[code](https://github.com/SonbolYb/multivariate_timeseries_dilated_conv)]
* [2017] [ICMV] Classification of Time-series Images using Deep Convolutional Neural Networks [[paper](https://arxiv.org/abs/1710.00886)]
* [2017] [Sensors] Learning Traffic as Images: A Deep Convolutional Neural Network for Large-scale Transportation Network Speed Prediction [[paper](https://arxiv.org/abs/1701.04245)]
* [2015] [IJCAI] Imaging Time-series to Improve Classification and Imputation [[paper](https://arxiv.org/abs/1506.00327)]
* [2015] [AAAI Workshop] Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks [[paper](https://coral-lab.umbc.edu/wp-content/uploads/2015/05/10179-43348-1-SM1.pdf)]
* [2014] [ICPR] Extracting Texture Features for Time Series Classification [[paper](https://ieeexplore.ieee.org/document/6976964)]
* [2013] [ICDM] Time Series Classification Using Compression Distance of Recurrence Plots [[paper](https://ieeexplore.ieee.org/document/6729553)]
* [2005] [SDM] Time-series Bitmaps: a Practical Visualization Tool for Working with Large Time Series Databases [[paper](https://epubs.siam.org/doi/abs/10.1137/1.9781611972757.55)]

<!-- #### Image Transformation of Time Series

* **Line Plot**
    - (Finance) Trading via image classification [[paper](https://arxiv.org/abs/1907.10046)]
    - (Finance) Visual time series forecasting: an image-driven approach [[paper](https://arxiv.org/abs/2011.09052)]
    - (Physics) Classification of time series as images using deep convolutional neural networks: application to glitches in gravitational wave data [[paper](https://par.nsf.gov/servlets/purl/10411304)]
    - (General) Image-based time series forecasting: A deep convolutional neural network approach [[paper](https://www.sciencedirect.com/science/article/abs/pii/S0893608022003902)]
    - (General) Time series as images: Vision transformer for irregularly sampled time series [[paper](https://arxiv.org/abs/2303.12799)][[code](https://github.com/Leezekun/ViTST)]
    - (General) Your time series is worth a binary image: machine vision assisted deep framework for time series forecasting [[paper](https://arxiv.org/abs/2302.14390)][[code](https://github.com/IkeYang/machine-vision-assisted-deep-time-series-analysis-MV-DTSA-)]
    - (General) ViTime: A visual intelligence-based foundation model for time series forecasting [[paper](https://arxiv.org/abs/2407.07311)][[code]](https://github.com/IkeYang/ViTime)
    - (General) Insight miner: A time series analysis dataset for cross-domain alignment with natural language [[paper](https://openreview.net/pdf?id=E1khscdUdH)]
    - (Finance) Leveraging vision-language models for granular market change prediction [[paper](https://arxiv.org/abs/2301.10166)]
    - (General) Plots unlock time-series understanding in multimodal models [[paper](https://arxiv.org/abs/2410.02637)]
    - (General) See it, think it, sorted: Large multimodal models are few-shot time series anomaly analyzers [[paper](https://arxiv.org/abs/2411.02465)]
    - (General) On the feasibility of vision-language models for time-series classification [[paper](https://arxiv.org/abs/2412.17304)][[code](https://github.com/vinayp17/VLM_TSC)]

* **Heatmap**
    - (Traffic) Learning Traffic as Images: A Deep Convolutional Neural Network for Large-scale Transportation Network Speed Prediction [[paper](https://arxiv.org/abs/1701.04245)]
    - (General) Multivariate time series classification using dilated convolutional neural network [[paper](https://arxiv.org/abs/1905.01697)][[code](https://github.com/SonbolYb/multivariate_timeseries_dilated_conv)]
    - (Finance) Deep video prediction for time series forecasting [[paper](https://arxiv.org/abs/2102.12061)]
    - (Health) TTS-GAN: A transformer-based time-series generative adversarial network [[paper](https://arxiv.org/abs/2202.02691)][[code](https://github.com/imics-lab/tts-gan)]
    - (General) TimesNet: Temporal 2d-variation modeling for general time series analysis [[paper](https://arxiv.org/abs/2210.02186)][[code](https://github.com/thuml/TimesNet)]
    - (Health) TimEHR: Image-based time series generation for electronic health records [[paper](https://arxiv.org/abs/2402.06318)][[code](https://github.com/esl-epfl/TimEHR)]
    - (General) VisionTS: Visual masked autoencoders are free-lunch zero-shot time series forecasters [[paper](https://arxiv.org/abs/2408.17253)][[code](https://github.com/Keytoyze/VisionTS)]

* **Spectrogram**
    - (Audio) AST: Audio spectrogram transformer [[paper](https://arxiv.org/abs/2104.01778)][[code](https://github.com/YuanGongND/ast)]
    - (Audio) SSAST: Self-supervised audio spectrogram transformer [[paper](https://arxiv.org/abs/2110.09784)][[code](https://github.com/YuanGongND/ssast)]
    - (Audio) MAE-AST: Masked autoencoding audio spectrogram transformer [[paper](https://arxiv.org/abs/2203.16691)][[code](https://github.com/AlanBaade/MAE-AST-Public)]
    - (Audio) AST-SED: An effective sound event detection method based on audio spectrogram transformer [[paper](https://arxiv.org/abs/2303.03689)]
    - (Finance) From pixels to predictions: Spectrogram and vision transformer for better time series forecasting [[paper](https://arxiv.org/abs/2403.11047)]
    - (General) Training-free time-series anomaly detection: Leveraging image foundation models [[paper](https://arxiv.org/abs/2408.14756)]
    - (Audio) Vision language models are few-shot audio spectrogram classifiers [[paper](https://arxiv.org/abs/2411.12058)]

* **Gramian Angular Field**
    - (General) Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks [[paper](https://coral-lab.umbc.edu/wp-content/uploads/2015/05/10179-43348-1-SM1.pdf)]
    - (Genearl) Imaging Time-series to Improve Classification and Imputation [[paper](https://arxiv.org/abs/1506.00327)]
    - (Finance) Deep learning and time series-to-image encoding for financial forecasting [[paper](https://ieeexplore.ieee.org/document/9080613)]
    - (Sensing) Multi-sensor data fusion and time series to image encoding for hardness recognition [[paper](https://ieeexplore.ieee.org/document/10600105)]

* **Recurrence Plot**
    - (General) Time Series Classification Using Compression Distance of Recurrence [[paper](https://ieeexplore.ieee.org/document/6729553)]
    - (General) Classification of Time-series Images using Deep Convolutional Neural Networks [[paper](https://arxiv.org/abs/1710.00886)]
    - (General) Forecasting with Time Series Imaging [[paper](https://arxiv.org/abs/1904.08064)][[code](https://github.com/lixixibj/forecasting-with-time-series-imaging)]
    - (General) Hierarchical context representation and self-adaptive thresholding for multivariate anomaly detection [[paper](https://ieeexplore.ieee.org/document/10417809)]
    - (General) CAFO: Feature-centric explanation on time series classification [[paper](https://arxiv.org/abs/2406.01833)][[code](https://github.com/eai-lab/CAFO)]

* **Other Methods**
    - (General) A Deep Neural Network for unsupervised anomaly detection and diagnosis in multivariate time series data [[paper](https://dl.acm.org/doi/10.1609/aaai.v33i01.33011409)][[code](https://github.com/7fantasysz/MSCRED)]
    - (General) Fusion of image representations for time series classification with deep learning [[paper](https://link.springer.com/chapter/10.1007/978-3-031-72347-6_16)][[code](https://sites.google.com/view/firts-paper)]
    - (General) Utilizing image transforms and diffusion models for generative modeling of short and long time series [[paper](https://arxiv.org/abs/2410.19538)][[code]](https://github.com/azencot-group/ImagenTime) -->

***
### Taxonomy

<sub>TS-Recover denotes recovering time series from predicted images. </sub> $*$<sub>: the method has been used to model the individual UTSs of an MTS. </sub>$^{\natural}$ <sub>: a new pre-trained model was proposed in the work. </sub>$^{\flat}$ : <sub>when pre-trained models were unused, Fine-tune refers to train a task-specific model from scratch. </sub>

Method|TS-Type|Imaging|Multimodal|Model|Pre-trained|Fine-tune|Prompt|TS-Recover|Task|Domain|Code
:-----|:---------:|:---:|:---:|:---:|:---:|:---:|:---:|:---:|:---:|:--:|:--:
[Kumar et al., 2005](https://epubs.siam.org/doi/abs/10.1137/1.9781611972757.55)|UTS|TS-Bitmap|✘|Multiple|✘|✘|✘|✘|Multiple|General|✘
[Silva et al., 2013](https://ieeexplore.ieee.org/document/6729553)|UTS|RP|✘|K-NN|✘|✘|✘|✘|Classification|General|✘
[Souza et al., 2014](https://ieeexplore.ieee.org/document/6976964) |UTS|RP|✘|SVM|✘|$✔^\flat$|✘|✘|Classification|General|✘
[Wang and Oates, 2015a](https://coral-lab.umbc.edu/wp-content/uploads/2015/05/10179-43348-1-SM1.pdf) |UTS|GAF|✘|CNN|✘|$✔^\flat$|✘|$✔$|Classification|General|✘
[Wang and Oates, 2015b](https://arxiv.org/abs/1506.00327) |UTS|GAF|✘|CNN|✘|$✔^\flat$|✘|$✔$|Classification & Imputation|General|✘
[Ma et al., 2017](https://arxiv.org/abs/1701.04245) |MTS|Heatmap|✘|CNN|✘|$✔^\flat$|✘|$✔$|Forecasting|Traffic|✘
[Hatami et al., 2018](https://arxiv.org/abs/1710.00886) |UTS|RP|✘|CNN|✘|$✔^\flat$|✘|✘|Classification|General|✘
[Yazdanbakhsh and Dick, 2019](https://arxiv.org/abs/1905.01697)|MTS|Heatmap|✘|CNN|✘|$✔^\flat$|✘|✘|Classification|General|[✔](https://github.com/SonbolYb/multivariate_timeseries_dilated_conv)
[MSCRED](https://dl.acm.org/doi/10.1609/aaai.v33i01.33011409) |MTS|Other|✘|ConvLSTM|✘|$✔^\flat$|✘|✘|Anomaly|General|[✔](https://github.com/7fantasysz/MSCRED)
[Li et al., 2020](https://arxiv.org/abs/1904.08064)|UTS|RP|✘|CNN|$✔$|$✔$|✘|✘|Forecasting|General|[✔](https://github.com/lixixibj/forecasting-with-time-series-imaging)
[Cohen et al., 2020](https://arxiv.org/abs/1907.10046) |UTS|LinePlot|✘|Ensemble|✘|$✔^\flat$|✘|✘|Classification|Finance|✘
[Barra et al., 2020](https://ieeexplore.ieee.org/document/9080613) |UTS|GAF|✘|CNN|✘|$✔^\flat$|✘|✘|Classification|Finance|✘
[VisualAE](https://arxiv.org/abs/2011.09052) |UTS|LinePlot|✘|CNN|✘|$✔^\flat$|✘|$✔$|Forecasting|Finance|✘
[Zeng et al., 2021](https://arxiv.org/abs/2102.12061) |MTS|Heatmap|✘|CNN, LSTM|✘|$✔^\flat$|✘|$✔$|Forecasting|Finance|✘
[AST](https://arxiv.org/abs/2104.01778) |UTS|Spectrogram|✘|DeiT|$✔$|$✔$|✘|✘|Classification|Audio|[✔](https://github.com/YuanGongND/ast)
[TTS-GAN](https://arxiv.org/abs/2202.02691)| MTS|Heatmap|✘|ViT|✘|$✔^\flat$|✘|$✔$|Ts-Generation|Health|[✔](https://github.com/imics-lab/tts-gan)
[SSAST](https://arxiv.org/abs/2110.09784) |UTS|Spectrogram|✘|ViT|$✔^\natural$|$✔$|✘|✘|Classification|Audio|[✔](https://github.com/YuanGongND/ssast)
[MAE-AST](https://arxiv.org/abs/2203.16691) |UTS|Spectrogram|✘|MAE|$✔^\natural$|$✔$|✘|✘|Classification|Audio|[✔](https://github.com/AlanBaade/MAE-AST-Public)
[AST-SED](https://arxiv.org/abs/2303.03689) |UTS|Spectrogram|✘|SSAST, GRU|$✔$|$✔$|✘|✘|EventDetection|Audio|✘
[Jin et al., 2023](https://par.nsf.gov/servlets/purl/10411304) |UTS|LinePlot|✘|CNN|$✔$|$✔$|✘|✘|Classification|Physics|✘
[ForCNN](https://www.sciencedirect.com/science/article/abs/pii/S0893608022003902) |UTS|LinePlot|✘|CNN|✘|$✔^\flat$|✘|✘|Forecasting|General|✘
[Vit-num-spec](https://arxiv.org/abs/2403.11047) |UTS|Spectrogram|✘|ViT|✘|$✔^\flat$|✘|✘|Forecasting|Finance|✘
[ViTST](https://arxiv.org/abs/2303.12799) |MTS|LinePlot|✘|Swin|$✔$|$✔$|✘|✘|Classification|General|[✔](https://github.com/Leezekun/ViTST)
[MV-DTSA](https://arxiv.org/abs/2302.14390)|UTS*|LinePlot|✘|CNN|✘|$✔^\flat$|✘|$✔$|Forecasting|General|[✔](https://github.com/IkeYang/machine-vision-assisted-deep-time-series-analysis-MV-DTSA-)
[TimesNet](https://arxiv.org/abs/2210.02186) |MTS|Heatmap|✘|CNN|✘|$✔^\flat$|✘|$✔$|Multiple|General|[✔](https://github.com/thuml/TimesNet)
[ITF-TAD](https://arxiv.org/abs/2408.14756)|UTS|Spectrogram|✘|CNN|$✔$|✘|✘|✘|Anomaly|General|✘
[Kaewrakmuk et al., 2024](https://ieeexplore.ieee.org/document/10600105)|UTS|GAF|✘|CNN|$✔$|$✔$|✘|✘|Classification|Sensing|✘
[HCR-AdaAD](https://ieeexplore.ieee.org/document/10417809) |MTS|RP|✘|CNN, GNN|✘|$✔^\flat$|✘|✘|Anomaly|General|✘
[FIRTS](https://link.springer.com/chapter/10.1007/978-3-031-72347-6_16) |UTS|Other|✘|CNN|✘|$✔^\flat$|✘|✘|Classification|General|[✔](https://sites.google.com/view/firts-paper)
[CAFO](https://arxiv.org/abs/2406.01833) |MTS|RP|✘|CNN, ViT|✘|$✔^\flat$|✘|✘|Explanation|General|[✔](https://github.com/eai-lab/CAFO)
[ViTime](https://arxiv.org/abs/2407.07311) |UTS*|LinePlot|✘|ViT|$✔^\natural$|$✔$|✘|$✔$|Forecasting|General|[✔](https://github.com/IkeYang/ViTime)
[ImagenTime](https://arxiv.org/abs/2410.19538) |MTS|Other|✘|CNN|✘|$✔^\flat$|✘|$✔$|Ts-Generation|General|[✔](https://github.com/azencot-group/ImagenTime)
[TimEHR](https://arxiv.org/abs/2402.06318) |MTS|Heapmap|✘|CNN|✘|$✔^\flat$|✘|$✔$|Ts-Generation|Health|[✔](https://github.com/esl-epfl/TimEHR)
 [VisionTS](https://arxiv.org/abs/2408.17253) |UTS*|Heatmap|✘|MAE|$✔$|$✔$|✘|$✔$|Forecasting|General|[✔](https://github.com/Keytoyze/VisionTS)
[InsightMiner](https://openreview.net/pdf?id=E1khscdUdH) |UTS|LinePlot|$✔$|LLaVA|$✔$|$✔$|$✔$|✘|Txt-Generation|General|✘
[Wimmer and Rekabsaz, 2023](https://arxiv.org/abs/2301.10166) |MTS|LinePlot|$✔$|CLIP, LSTM|$✔$|$✔$|✘|✘|Classification|Finance|✘
[Dixit et al., 2024](https://arxiv.org/abs/2411.12058) |UTS|Spectrogram|$✔$|GPT4o, Gemini & Claude3|$✔$|✘|$✔$|✘|Classification|Audio|✘
[Daswani et al., 2024](https://arxiv.org/abs/2410.02637) |MTS|LinePlot|$✔$|GPT4o, Gemini|$✔$|✘|$✔$|✘|Multiple|General|✘
[TAMA](https://arxiv.org/abs/2411.02465) |UTS|LinePlot|$✔$|GPT4o|$✔$|✘|$✔$|✘|Anomaly|General|✘
[Prithyani et al., 2024](https://arxiv.org/abs/2412.17304) |MTS|LinePlot|$✔$|LLaVA|$✔$|$✔$|$✔$|✘|Classification|General|[✔](https://github.com/vinayp17/VLM_TSC)

***
### Citation

```
@inproceedings{ni2025harnessing,
  title={Harnessing Vision Models for Time Series Analysis: A Survey},
  author={Ni, Jingchao and Zhao, Ziming and Shen, ChengAo and Tong, Hanghang and Song, Dongjin and Cheng, Wei and Luo, Dongsheng and Chen, Haifeng},
  booktitle={IJCAI},
  year={2025}
}
```

awesome-vision-time-series

awesome-vision-time-series Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

awesome-vision-time-series

awesome-vision-time-series Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README