| Due to the flexibility,maneuverability,and low cost of unmanned aerial vehicles(UAVs),they play a key role in real-time applications within Internet of Things(Io T)networks.In applications such as intelligent transportation and disaster relief,it is required to transmit real-time data generated by Io T devices to the receivers as fresh as possible.Therefore,ensuring timely reception of data is a huge challenge for UAV-assisted Io T networks.This paper uses Age of information to measure the freshness of data received by UAVs from Io T devices.The paper studies the information gathering problem based on UAV energy constraints and UAV wireless power supply for Io T devices,with the aim of minimizing Age of information to ensure the freshness of the collected information.The specific work is as follows:(1)This paper proposes an information gathering problem based on UAV energy constraints in Io T networks.Existing research only considers the minimization of Io T device Age of information in the problem of UAV information gathering,without considering the energy consumption of UAVs or the insufficient use of UAV energy,which leads to high overall Age of Information(Ao I)in Io T devices.This paper jointly optimizes the UAV trajectory and the association strategy between UAVs and Io T devices to minimize the weighted sum of Age of information while ensuring that the cumulative energy consumption of UAVs meets the budget requirements.Due to the short-term and long-term constraints on the above problem,this paper models it as a constrained Markov Decision Process(CMDP)and uses Safe Actor-Critic to solve it.A large number of simulation results show that the proposed algorithm can effectively minimize Age of information while ensuring energy budget compared with other reinforcement learning(RL)algorithms.(2)In emerging IoT networks,the limited battery capacity of energy-constrained devices cannot guarantee their lifespan.This paper studies a multi-user wireless power transfer system based on unmanned aerial vehicle(UAV).The system uses an energy transmitter installed on the UAV to charge multiple Io T devices on the ground,while the UAV collects information from the Io T devices on the ground.To ensure the timeliness of the information,this paper uses Age of information to measure the freshness of the data received by the UAV from the Io T devices.By jointly optimizing the UAV trajectory,energy transmission,and resource allocation strategies to minimize the Age of information of all ground Io T devices,the problem is modeled as a Markov decision process(MDP)and solved using Soft Actor-Critic.Simulation results show that the proposed algorithm has superior performance. |