Skip to content
2000
  1. Home
  2. A-Z Publications
  3. Recent Advances in Electrical & Electronic Engineering
  4. Volume 18, Issue 4
  5. Article
Volume 18, Issue 4
  • ISSN: 2352-0965
  • E-ISSN: 2352-0973

Abstract

Background

The development of energy storage networks has facilitated the rapid expansion of new energy-based power systems. However, the emergence of large-scale energy storage devices has also led to a significant increase in energy data volumes. Federated learning provides a solution by allowing energy data owners to train AI models without sharing local energy data, which is particularly advantageous for handling heterogeneous data.

Objective

This paper explores the application of federated learning in managing energy data within distributed energy storage networks. Specifically, we leverage deep reinforcement learning algorithms to optimize the selection of device subsets, aiming to mitigate data bias caused by non-identically and independently distributed (non-IID) data while enhancing convergence rates.

Methods

To achieve our objectives, we employ deep reinforcement learning to dynamically select the optimal subset of devices in the federated learning process. Additionally, we introduce a reputation replay array mechanism to address the issue of free-rider users and ensure fair modeling without payment penalties. We analyze energy data characteristics within distributed energy storage networks and simulate unstructured short data fragments using datasets such as 20 Newsgroups and AG News.

Results

Our experiments show that our proposed model outperforms FedAvg and TiFL on the 20 Newsgroups and AG News datasets, especially under non-iid conditions. Our model significantly reduces communication rounds by up to 47% and 39%, respectively. It also maintains high accuracy and resilience against dishonest nodes, ensuring the quality of the training model.

Conclusion

Our research concludes that combining federated learning with deep reinforcement learning not only solves the problems of data management and privacy protection in distributed energy storage networks, but also promotes the sustainable development of new energy systems.

© 2025 Bentham Science Publishers
Loading

Article metrics loading...

/content/journals/eeng/10.2174/0123520965325440240925051735
2025-05-01
2025-07-04

  • From This Site

    /content/journals/eeng/10.2174/0123520965325440240925051735
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. TanK.M. BabuT.S. RamachandaramurthyV.K. KasinathanP. SolankiS.G. RaveendranS.K. Empowering smart grid: A comprehensive review of energy storage technology and application with renewable energy integration.J. Energy Storage20213910259110.1016/j.est.2021.102591
     [Google Scholar]
  2. BrickellJ. ShmatikovV. The cost of privacy: Destruction of data-mining utility in anonymized data publishing.KDD2008707810.1145/1401890.1401904
     [Google Scholar]
  3. FungB.C.M. WangK. YuP.S. Anonymizing classification data for privacy preservation.IEEE Trans. Knowl. Data Eng.200719571172510.1109/TKDE.2007.1015
     [Google Scholar]
  4. ChenM. ShlezingerN. PoorH.V. EldarY.C. CuiS. Communication-efficient federated learning.Proc. Natl. Acad. Sci. USA202111817e202478911810.1073/pnas.202478911833888586
     [Google Scholar]
  5. BokkisamH.R. SinghS. AcharyaR.M. SelvanM.P. Blockchain-based peer-to-peer transactive energy system for community microgrid with demand response management.CSEE J. Power Energy Syst.202281198211
     [Google Scholar]
  6. McMahanB. MooreE. RamageD. HampsonS. ArcasB.A.Y. Communication-efficient learning of deep networks from decentralized data.Proc. 20th Int. Conf. Artif. Intell. Stat.20175412731282
     [Google Scholar]
  7. SmithV. ChiangC-K. SanjabiM. TalwalkarA. Federated multi-task learning.Proc. Adv. Neural Inf. Process. Syst.201744244434
     [Google Scholar]
  8. BonawitzK. EichnerH. GrieskampW. HubaD. IngermanA. IvanovV. KiddonC. KonecnyJ. Towards federated learning at scale: System design.arXiv: 1902.01046,2019
     [Google Scholar]
  9. QiuZ. Charging-rate-based battery energy storage system in wind farm and battery storage cooperation bidding problem.CSEE J. Power Energy Syst.202283659668
     [Google Scholar]
  10. ZhaoZ. System optimization of federated learning networks with a constrained latency.IEEE Trans. Vehicular Technol.20219915
     [Google Scholar]
  11. McMahanH.B. MooreE. RamageD. ArcasB.A.Y. Federated learning of deep networks using model averaging.arxiv2016
     [Google Scholar]
  12. LoS.K. LuQ. WangC. PaikH. ZhuL. A systematic literature review on federated machine learning: From a software engineering perspective.arxiv2020
     [Google Scholar]
  13. KairouzP. Advances and open problems in federated learningarxiv2019
     [Google Scholar]
  14. PanQ. WuJ. BashirA.K. LiJ. YangW. Al-OtaibiY.D. Joint protection of energy security and information privacy for energy harvesting: An incentive federated learning approach.IEEE Trans. Industr. Inform.20221853473348310.1109/TII.2021.3105492
     [Google Scholar]
  15. LiuQ. YangB. WangZ. ZhuD. WangX. MaK. GuanX. Asynchronous decentralized federated learning for collaborative fault diagnosis of PV stations.IEEE Trans. Netw. Sci. Eng.20229316801696[J].10.1109/TNSE.2022.3150182
     [Google Scholar]
  16. YuH. LiuZ. LiuY. ChenT. CongM. WengX. NiyatoD. YangQ. A Sustainable incentive scheme for federated learning.IEEE Intell. Syst.2020354586910.1109/MIS.2020.2987774
     [Google Scholar]
  17. LeiL. TanY. DahlenburgG. XiangW. ZhengK. Dynamic energy dispatch based on deep reinforcement learning in IoT-driven smart isolated microgrids.IEEE Internet Things J.20218107938795310.1109/JIOT.2020.3042007
     [Google Scholar]
  18. HuangQ. HuangR. HaoW. TanJ. FanR. HuangZ. Adaptive power system emergency control using deep reinforcement learning.IEEE Trans. Smart Grid20201121171118210.1109/TSG.2019.2933191
     [Google Scholar]
  19. HuangB. WangJ. Deep-reinforcement-learning-based capacity scheduling for PV-battery storage system.IEEE Trans. Smart Grid20211232272228310.1109/TSG.2020.3047890
     [Google Scholar]
  20. WangH. KaplanZ. NiuD. Optimizing federated learning on non-IID data with reinforcement learning.IEEE INFOCOM 2020 - IEEE Conference on Computer Communications, Toronto, ON, Canada, 06-09 July 2020, pp. 1698-1707.
     [Google Scholar]
  21. ZhanY. LiP. GuoS. Experience-driven computational resource allocation of federated learning by deep reinforcement learning.2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS), New Orleans, LA, USA, 18-22 May 2020, pp. 234-243.
     [Google Scholar]
  22. ZengM. WangX. PanW. ZhouP. Heterogeneous training intensity for federated learning: A deep reinforcement learning approach.IEEE Trans. Netw. Sci. Eng.20231029901002[J].10.1109/TNSE.2022.3225444
     [Google Scholar]
  23. WeiW. LiuF. MeiS. HouY. Robust energy and reserve dispatch under variable renewable generation.IEEE Trans. Smart Grid20156136938010.1109/TSG.2014.2317744
     [Google Scholar]
  24. FortenbacherP. UlbigA. KochS. AnderssonG. “Grid-constrained optimal predictive power dispatch in large multi-level power systems with renewable energy sources and storage devices,” in IEEE PES Innov. Smart Grid Technol.Europe2014Oct16
     [Google Scholar]
  25. ZhuL. LiuZ. HanS. Deep leakage from gradients.Proceedings of the 33rd International Conference on Neural Information Processing Systems.Red Hook, NY, USA, 08 December 2019, pp 14774 - 14784.
     [Google Scholar]
  26. LuY. HuangX. DaiY. MaharjanS. ZhangY. Blockchain and federated learning for privacy-preserved data sharing in industrial IoT.IEEE Trans. Industr. Inform.202016641774186[J].10.1109/TII.2019.2942190
     [Google Scholar]
  27. KonečnýJ. McMahanH.B. YuF.X. Federated learning: Strategies for improving communication efficiency.Preprint arXiv: 1610.05492.2016
     [Google Scholar]
  28. ChaiZ. AliA. ZawadS. Tifl: A tier-based federated learning system.Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed ComputingStockholm, Sweden, 23 June 2020, pp.125–136.
     [Google Scholar]
/content/journals/eeng/10.2174/0123520965325440240925051735
Loading
Optimizing Federated Reinforcement Learning Algorithm for Data Management of Distributed Energy Storage Network
Recent Advances in Electrical & Electronic Engineering 18, 441 (2025); https://doi.org/10.2174/0123520965325440240925051735
/content/journals/eeng/10.2174/0123520965325440240925051735
/content/journals/eeng/10.2174/0123520965325440240925051735
Loading

Data & Media loading...


  • Article Type:     Research Article
Keyword(s): Data management; energy storage; federated reinforcement learning; new energy systems; non-independent and identically distributed; reinforcement learning

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error
Please enter a valid_number test