Skip to main navigation Skip to search Skip to main content

Toward Multiple-Phase MDP Model for Charging Station Recommendation

  • Hai Lin*
  • , Xiang Lin
  • , Houda Labiod
  • , Lin Chen
  • *Corresponding author for this work
  • Telecom Paris
  • Sun Yat Sen Univ

Research output: Contribution to journal › Article › peer-review

25 Scopus citations

Abstract

There is an increasing need for charging station recommendation to minimize the overall charging time for electric vehicles and balance load for the charging stations. To grant this need, we model the recommendation problem as a Markov Decision Process (MDP) problem. However, the traditional MDP model has the issue of `curse of dimensionality'. To address this issue, we propose an extension of MDP: multiple-phase MDP, in which the state transition of MDP is decomposing into several phases, so as to reduce the state space and state transition complexities. This is done by introducing two states other than the normal state defined in MDP: post decision state and intermediate decision state. Then, we propose an online learning based algorithm to solve the formulated multiple-phase MDP model. Thanks to the reduced complexities of the state space and state transition, the proposed online algorithm can converge fast. By comparing to other recommendation mechanisms, such as game theory based recommendation and Q-learning based recommendation, our simulation evaluation demonstrates that our proposition can bring good performance.
Original languageEnglish
Pages (from-to)10583-10595
Number of pages13
JournalIEEE Transactions on Intelligent Transportation Systems
Volume23
Issue number8
Early online dateJul 2021
DOIs
StatePublished - Aug 2022

Funding

This work was supported by the National Natural Science Foundation of China under Grant 62072344.

Keywords

  • Computational modeling
  • Optimization
  • Public transportation
  • Complexity theory
  • Quality of experience
  • Charging stations
  • Approximation algorithms
  • Electric vehicle
  • charging station recommendation
  • Markov decision process
  • online learning

Indexed by

  • Scopus
  • EI
  • SCIE

Fingerprint

Dive into the research topics of 'Toward Multiple-Phase MDP Model for Charging Station Recommendation'. Together they form a unique fingerprint.

Cite this