Pages

Sunday, December 21, 2014

Long Term Retail Energy Forecasting with Consideration of Residential Customer Attrition

Most of my professional experience has been on energy forecasting. I have also worked on retail forecasting in the CPG (consumer package goods) industry for large retailers who have thousands of stores and millions of SKUs (store keeping units). This paper is a perfect combination of the two - energy forecasting for electricity retailers. In this paper, we tackle the challenge of customer attrition. A significant contribution of this paper is that it sets a role model of putting business needs in front of designing and developing load forecasting models.

Unfortunately, this paper went through 4 revisions before it was finally accepted. It could have been accepted in the second round if I had tried to please the three reviewers. One of them was excellent, but the other two were nonsense. To maintain my publication quality and keep the dignity of the paper, I decided to argue with the nonsense ones. Although it wasted me a lot of time, I didn't change more than three sentences in the last three rounds of revisions.

The paper was accepted by IEEE Transactions on Smart Grid last week. The working paper is available HERE. I will update the citation once the paper is on IEEE Xplore.

Citation
Jingrui Xie, Tao Hong and Josh Stroud, "Long term retail energy forecasting with consideration of residential customer attrition", IEEE Transactions on Smart Grid, vol.6, no.5, pp. 2245-2252, September, 2015. working paper available from http://www.drhongtao.com/articles.

Long Term Retail Energy Forecasting with Consideration of Residential Customer Attrition

Jingrui Xie, Tao Hong and Josh Stroud

Abstract

Deregulation of the electric power industry has created both wholesale markets and retail markets. Most load forecasting studies in the literature are on the wholesale side. Minimal research efforts have been devoted to tackling the challenges on the retail side, such as limited data history and high customer attrition rate. This paper proposes a comprehensive methodology to long term retail energy forecasting in order to feed the forecasts to a conservative trading strategy. We dissect the problem into two sub-problems: load per customer forecasting and tenured customer forecasting. Regression analysis and survival analysis are applied to each sub-problem respectively. The proposed methodology has been implemented at a fast growing retailer in the US showing superior performance, in terms of Mean Absolute Percentage Error (MAPE) of hourly demand, and daily and monthly energy, over a commonly used method that assumes constant customer attrition rate.