LLMs4TS

LLMs4TS

None

Stars: 66

Visit
 screenshot

LLMs4TS is a repository focused on the application of cutting-edge AI technologies for time-series analysis. It covers advanced topics such as self-supervised learning, Graph Neural Networks for Time Series, Large Language Models for Time Series, Diffusion models, Mixture-of-Experts architectures, and Mamba models. The resources in this repository span various domains like healthcare, finance, and traffic, offering tutorials, courses, and workshops from prestigious conferences. Whether you're a professional, data scientist, or researcher, the tools and techniques in this repository can enhance your time-series data analysis capabilities.

README:

AI4TS

Awesome resources focus on the application of cutting-edge AI technologies for time-series analysis (**AI4TS **). They delve into advanced topics such as self-supervised learning (SSL), Graph Neural Networks for Time Series (GNN4TS), Large Language Models for Time Series (LLM4TS), Diffusion models, Mixture-of-Experts (MoE) architectures and Mamba models, Kolmogorov Arnold Networks (KAN) among others. These resources span various domains, including healthcare, finance, and traffic, offering a comprehensive view of the field. In addition, they feature top-notch tutorials, courses, and workshops from prestigious conferences, hosted by globally renowned scholars and research teams. Whether you're a professional, data scientist, or researcher, these tools and techniques can significantly enhance your time-series data analysis capabilities, providing a clear roadmap for your studies.

LLM4TS

Multimodal large models include TS

Patch && Tokenizers methods

GNN

  • Graph-Aware Contrasting for Multivariate Time-Series Classification AAAI2024 TSGAC
  • GinAR: An End-To-End Multivariate Time Series Forecasting Model Suitable for Variable Missing KDD2024

MLPer

  • TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting KDD2023PatchTSMixer
  • A Multi-Scale Decomposition MLP-Mixer for Time Series Analysis VLDB2024 zshhans/MSD-Mixer
  • Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series 8 Jan 2024
  • U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecasting AAAI2024 U-Mixer
  • LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation—Extended Version SIGMOD 2023
  • An Analysis of Linear Time Series Forecasting Models ICML2024
  • SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusion 22 Apr 2024 Secilia-Cxy/SOFTS

Mixture-of-Experts (MoE)

Mamba

  • Is Mamba Effective for Time Series Forecasting? 17 Mar 2024 wzhwzhwzh0921/S-D-Mamba
  • TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting 14 Mar 2024 Atik-Ahamed/TimeMachine
  • STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model 19 Mar 2024
  • SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series 22 Mar 2024 badripatro/simba
  • MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection 29 Mar 2024
  • Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models 8 May 2024
  • Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting 25 May 2024
  • TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification 6 Jun 2024

KAN

Multiple instance learning

  • TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learning ICML2024 xiwenc1/TimeMIL

NeXt (Classic networks make a comeback)

Biosignal dataset

  • Neuro-GPT: Developing A Foundation Model for EEG arxiv 7 Nov 2023
  • Brant: Foundation Model for Intracranial Neural Signal NeurIPS23
  • Brant-2: Foundation Model for Brain Signals 15 Feb 2024
  • Brant-X: A Unified Physiological Signal Alignment Framework KDD2024
  • PPi: Pretraining Brain Signal Model for Patient-independent Seizure Detection NeurIPS23
  • Large-scale training of foundation models for wearable biosignals submit ICLR 2024
  • BIOT: Cross-data Biosignal Learning in the Wild NeurIPS23 BIOT
  • Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI submit ICLR 2024
  • Practical intelligent diagnostic algorithm for wearable 12-lead ECG via self-supervised learning on large-scale dataset Nature Communications 2023
  • Large AI Models in Health Informatics: Applications, Challenges, and the Future IEEE Journal of Biomedical and Health Informatics Awesome-Healthcare-Foundation-Models
  • Data science opportunities of large language models for neuroscience and biomedicine Neuron
  • BioSignal Copilot: Leveraging the power of LLMs in drafting reports for biomedical signals July 06, 2023
  • Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data 12 Jan 2024
  • Self-supervised Learning for Electroencephalogram: A Systematic Survey 9 Jan 2024
  • Learning Topology-Agnostic EEG Representations with Geometry-Aware Modeling NeurIPS 2023 MMM
  • A Survey of Large Language Models in Medicine: Progress, Application, and Challenge 9 Nov 2023 AI-in-Health/MedLLMsPracticalGuide
  • EEG-GPT: Exploring Capabilities of Large Language Models for EEG Classification and Interpretation 31 Jan 2024
  • A Survey on Multimodal Wearable Sensor-based Human Action Recognition 14 Apr 2024
  • Unveiling Thoughts: A Review of Advancements in EEG Brain Signal Decoding into Text 26 Apr 2024
  • AI for Biomedicine in the Era of Large Language Models 23 Mar 2024

Foundation for other domains

Multimodal TS

Benchmark && Analysis

  • TS-Benchmark: A Benchmark for Time Series Databases ICDE2021
  • TimeEval: a benchmarking toolkit for time series anomaly detection algorithms VLDB2022
  • Class-incremental Learning for Time Series: Benchmark and Evaluation KDD2024(ADS track) zqiao11/TSCIL
  • TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methods VLDB2024 TFB
  • The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecasting TKDE2024 channel_independent_MTSF
  • Deep Time Series Models: A Comprehensive Survey and Benchmark 18 Jul 2024 TSLib
  • UP2ME: Univariate Pre-training to Multivariate Fine-tuning as a General-purpose Framework for Multivariate Time Series Analysis ICML2024 UP2ME

Survey4TS

Workshop

Project

Self-supervised learning tools

Blog list

Laboratory

Course

Others

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for LLMs4TS

Similar Open Source Tools

For similar tasks

For similar jobs