Skip to content
BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
FinRL_DeepSeek_backtest.ipynb
FinRL_DeepSeek_backtest.ipynb
 
 
IMG_20250207_175434_001.jpg
IMG_20250207_175434_001.jpg
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
env_stocktrading.py
env_stocktrading.py
 
 
env_stocktrading_llama.py
env_stocktrading_llama.py
 
 
env_stocktrading_llama_risk.py
env_stocktrading_llama_risk.py
 
 
env_stocktrading_llm.py
env_stocktrading_llm.py
 
 
env_stocktrading_llm_01.py
env_stocktrading_llm_01.py
 
 
env_stocktrading_llm_1.py
env_stocktrading_llm_1.py
 
 
env_stocktrading_llm_risk.py
env_stocktrading_llm_risk.py
 
 
env_stocktrading_llm_risk_01.py
env_stocktrading_llm_risk_01.py
 
 
env_stocktrading_llm_risk_1.py
env_stocktrading_llm_risk_1.py
 
 
hugging_face_upload.py
hugging_face_upload.py
 
 
installation_script.sh
installation_script.sh
 
 
output_cppo.log
output_cppo.log
 
 
output_cppo_deepseek_risk_100_epochs.log
output_cppo_deepseek_risk_100_epochs.log
 
 
output_cppo_deepseek_risk_100_epochs_01.log
output_cppo_deepseek_risk_100_epochs_01.log
 
 
output_cppo_deepseek_risk_100_epochs_99_101.log
output_cppo_deepseek_risk_100_epochs_99_101.log
 
 
output_cppo_llama_risk.log
output_cppo_llama_risk.log
 
 
output_cppo_llama_risk_100_epochs_98_95.log
output_cppo_llama_risk_100_epochs_98_95.log
 
 
output_cppo_risk_deepseek.log
output_cppo_risk_deepseek.log
 
 
output_ppo.log
output_ppo.log
 
 
output_ppo_deepseek.log
output_ppo_deepseek.log
 
 
output_ppo_deepseek_100_epochs_01.log
output_ppo_deepseek_100_epochs_01.log
 
 
output_ppo_deepseek_100_epochs_96_104_bumps.log
output_ppo_deepseek_100_epochs_96_104_bumps.log
 
 
output_ppo_deepseek_100_epochs_99_101_bumps.log
output_ppo_deepseek_100_epochs_99_101_bumps.log
 
 
output_ppo_llama.log
output_ppo_llama.log
 
 
output_ppo_llama_100_epochs_98_95_sentiment.log
output_ppo_llama_100_epochs_98_95_sentiment.log
 
 
output_ppo_llm_deepseek.log
output_ppo_llm_deepseek.log
 
 
train_cppo.py
train_cppo.py
 
 
train_cppo_llama_risk.py
train_cppo_llama_risk.py
 
 
train_cppo_llm_old.py
train_cppo_llm_old.py
 
 
train_cppo_llm_risk.py
train_cppo_llm_risk.py
 
 
train_cppo_llm_risk_01.py
train_cppo_llm_risk_01.py
 
 
train_ppo.py
train_ppo.py
 
 
train_ppo_llama.py
train_ppo_llama.py
 
 
train_ppo_llm.py
train_ppo_llm.py
 
 
train_trade_data.py
train_trade_data.py
 
 
train_trade_data_deepseek_risk.py
train_trade_data_deepseek_risk.py
 
 
train_trade_data_deepseek_sentiment.py
train_trade_data_deepseek_sentiment.py
 
 
train_trade_data_deepseek_sentimwnt.py
train_trade_data_deepseek_sentimwnt.py
 
 
train_trade_data_llama_risk.py
train_trade_data_llama_risk.py
 
 
train_trade_data_qwen_risk.py
train_trade_data_qwen_risk.py
 
 
train_trade_data_sentiment_chunk.py
train_trade_data_sentiment_chunk.py
 
 

Repository files navigation

FinRL-DeepSeek: LLM-Infused Risk-Sensitive Reinforcement Learning for Trading Agents

Blog: https://melwy.com/finrl_deepseek

Paper: https://arxiv.org/abs/2502.07393

Update: The project is integrated to the original FinRL project by AI4Finance!

Installation script: installation_script.sh

Data: https://huggingface.co/datasets/benstaf/nasdaq_2013_2023/tree/main

Trading agents: https://huggingface.co/benstaf/Trading_agents/tree/main

Backtesting Notebook: Open In Colab

Results

Alt Text

Preliminary conclusion

Bull market -> PPO

Bear market -> CPPO-DeepSeek

About

Code for the paper "FinRL-DeepSeek: LLM-Infused Risk-Sensitive Reinforcement Learning for Trading Agents" arXiv:2502.07393

arxiv.org/abs/2502.07393

Resources

Readme
License
Activity
Custom properties

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

Packages

Contributors

Languages