Skip to main navigation Skip to search Skip to main content

Green Communications: RIS-Assisted Fixed-Wing UAV Coverage Scheme Based on Deep Reinforcement Learning

  • Na Lin
  • , Chunxiao Liu
  • , Tianxiong Wu
  • , Ammar Hawbani*
  • , Liang Zhao*
  • , Shaohua Wan
  • , Mohsen Guizani
  • *Corresponding author for this work
  • School of Computer Science
  • Shenyang Aerospace University
  • University of Electronic Science and Technology of China
  • Mohamed Bin Zayed University of Artificial Intelligence

Research output: Contribution to journal › Article › peer-review

14 Scopus citations

Abstract

Recently, fixed-wing unmanned aerial vehicles (UAVs) are able to extend the communications mission time and ease of deployment due to their powerful onboard capabilities and flexibility, and reflective intelligent surfaces (RISs) are capable of reflecting links to avoid obstacles and thus improve channel gain. Therefore, RIS-assisted fixed-wing UAVs are widely used in wireless communications. Nevertheless, fixed-wing UAVs have limited energy, so improving energy efficiency is critical. This article focuses on energy efficiency optimization problems under RIS-assisted fixed-wing UAV communications. In communications coverage systems, the flight trajectory of fixed-wing UAVs and service scheduling to ground nodes (GNs) significantly impact energy efficiency. Existing work often adopts circular trajectory and traditional deep reinforcement learning (DRL) algorithms for optimizing trajectory and service scheduling. However, circular trajectory can not adapted to the GN distribution well. In addition, the traditional DRL algorithm has two drawbacks: 1) the efficiency of exploring the empirical process is low and 2) the accuracy of handling the hybrid action space needs to be higher. Thus, we propose the midpoint iteration convex hull (MICH) algorithm based on the Graham scan to design trajectories that can be adapted to the distribution of the GNs. In addition, we propose the action screening virtual and real experience (AS-VRE) mechanism and the N-steps hybrid deep Q and policy network (NsHQPN) algorithm to address the low-exploration efficiency and the low-fetch accuracy in handling the hybrid action space. Experiments show that our proposed MICH algorithm, AS-VRE mechanism, and NsHQPN algorithm can effectively improve the system energy efficiency and outperform other baseline schemes.

Original languageEnglish
Pages (from-to)4115-4127
Number of pages13
JournalIEEE Internet of Things Journal
Volume12
Issue number4
DOIs
StatePublished - 2025
Externally publishedYes

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Keywords

  • Deep reinforcement learning (DRL)
  • energy efficiency
  • reconfigurable intelligent surface (RIS)
  • trajectory
  • unmanned aerial vehicle (UAV)

Fingerprint

Dive into the research topics of 'Green Communications: RIS-Assisted Fixed-Wing UAV Coverage Scheme Based on Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this