top of page

Research Blog

Buscar

Search-and-rescue missions often take place in environments where GPS signals are unavailable, unreliable, or severely degraded, such as collapsed buildings, underground facilities, tunnels, and dense urban areas. Ultra-Wideband (UWB) technology offers an effective solution by enabling accurate short-range distance measurements and relative localization between drones, fixed anchors, and rescue personnel. The proposed application combines autonomous drones, ESP32-S3 embedded controllers, and DWM3000 UWB transceivers to establish a cooperative localization network. Each drone can operate as a mobile anchor or tag and exchange ranging information with nearby devices. Single-Sided Two-Way Ranging (SS-TWR) can provide rapid distance updates with relatively low communication overhead, while Double-Sided Two-Way Ranging (DS-TWR) improves accuracy by reducing clock-offset errors.






During a rescue mission, the UWB measurements can be fused with visual–inertial odometry, LiDAR, or onboard computer vision to estimate each drone’s position in GPS-denied environments. The resulting coordinates can be displayed on a real-time map showing drone trajectories, anchor locations, detected victims, hazardous areas, and access routes. Multiple drones may also share their measurements through a cooperative communication network, increasing coverage and improving localization robustness.


UWB-enabled architecture can support:

  • Indoor drone navigation and trajectory tracking

  • Cooperative localization among multiple drones

  • Victim and rescuer position estimation

  • Relative distance measurement in low-visibility environments

  • Real-time rescue-scene mapping

  • Navigation assistance when GNSS is unavailable

  • SS-TWR and DS-TWR performance comparison

  • Integration with visual, inertial, LiDAR, and RF sensing systems


By combining UWB ranging with autonomous aerial platforms, the system can provide rescue teams with timely and spatially referenced information while reducing their exposure to unstable or dangerous structures. The application therefore represents a practical foundation for intelligent, collaborative, and resilient UAV operations in urban search-and-rescue scenarios.


Drone-to-Drone UWB Localization for Search-and-Rescue Operations


Drone-to-drone Ultra-Wideband (UWB) communication enables a group of unmanned aerial vehicles to estimate their relative positions in search-and-rescue environments where GNSS signals are unavailable or unreliable. Each drone is equipped with a UWB transceiver, such as the DWM3000, and an embedded controller for exchanging timestamped ranging messages with nearby UAVs. This cooperative architecture creates a mobile localization network that can operate inside collapsed buildings, tunnels, dense urban areas, and other GPS-denied environments. Relative distances between drones can be estimated using Single-Sided Two-Way Ranging (SS-TWR) or Double-Sided Two-Way Ranging (DS-TWR). SS-TWR requires fewer message exchanges and is suitable for rapid network updates, whereas DS-TWR compensates more effectively for clock-offset errors and generally provides greater ranging accuracy. For DS-TWR, the estimated time of flight can be expressed as




In a cooperative rescue mission, one UAV can operate as a temporary reference node while the other drones use inter-drone ranges to maintain formation and estimate their relative coordinates. When at least three geometrically distributed reference nodes or range constraints are available, multilateration can be applied to determine a drone’s position. The measurements may also be fused with visual–inertial odometry, LiDAR, optical flow, or inertial sensor data using an extended or unscented Kalman filter. This fusion reduces position drift and maintains navigation continuity when rubble, walls, smoke, or non-line-of-sight propagation degrades individual UWB links.


The resulting drone-to-drone network allows the swarm to distribute victim coordinates, obstacle information, local maps, and mission status among its members. A drone detecting a trapped person can associate the observation with its estimated position and relay the location to the rescue command station via neighboring UAVs. Other drones can then adjust their trajectories, improve scene coverage, or act as communication relays. UWB performance depends on antenna placement, synchronization, network scheduling, and propagation conditions. Metallic debris and reinforced concrete can produce multipath and non-line-of-sight bias. Robust operation therefore requires link-quality monitoring, outlier rejection, time-slotted ranging, collision avoidance, and confidence-weighted sensor fusion. With these measures, drone-to-drone UWB localization provides a resilient foundation for coordinated aerial mapping, victim localization, formation control, and navigation in GPS-denied search-and-rescue operations.



Integration of Reinforcement-Learning Agents with a UWB-Enabled Drone Localization System


The UWB-enabled localization architecture can be integrated with a reinforcement-learning (RL) agent to support autonomous drone navigation in GPS-denied search-and-rescue environments. In this framework, each drone operates as an intelligent agent that observes its local environment, estimates its position using UWB ranging, and selects navigation actions according to a learned control policy. This integration allows the drone to adapt its trajectory to obstacles, localization uncertainty, communication conditions, and mission priorities.

At time step t, the agent receives a state vector combining UWB and onboard sensor measurements:



The agent uses this state to select a control action:



The RL policy is optimized using a reward function that represents the principal objectives and constraints of the rescue mission:




Before the state is supplied to the agent, SS-TWR or DS-TWR measurements can be fused with inertial, visual, LiDAR, or optical flow data using an extended Kalman filter, an unscented Kalman filter, or a factor graph estimator. This sensor-fusion stage produces a more stable pose estimate and prevents noisy or non-line-of-sight UWB measurements from directly destabilizing the learned controller. Link-quality indicators and localization covariance should also be retained because they allow the RL agent to reason explicitly about measurement reliability.


In a multi-drone implementation, each UAV executes an individual policy while exchanging relative ranges, estimated poses, detected-victim coordinates, local maps, and link-status information. A centralized-training and decentralized-execution strategy can be employed: the agents have access to global mission information during training but make decisions using only locally available observations during deployment. The drones can consequently learn cooperative behaviors such as maintaining favorable ranging geometry, acting as temporary mobile anchors, relaying information, avoiding duplicated coverage, and approaching detected victims from different directions.




For safety-critical operation, the RL controller should not directly override the flight controller’s protective mechanisms. Its commands should pass through a safety layer that checks minimum obstacle clearance, geofencing limits, velocity constraints, battery condition, localization confidence, and communication availability. If UWB uncertainty exceeds an established threshold, the system can reduce speed, hover, reposition to restore line of sight, switch to visual–inertial navigation, or initiate a controlled return procedure. The integration of RL with cooperative UWB localization therefore creates an adaptive navigation architecture that balances exploration, victim search, positioning accuracy, energy consumption, and network connectivity. This approach is particularly valuable in dynamic and partially observable rescue environments where fixed navigation rules may be insufficient to address debris, multipath propagation, moving agents, and changing mission priorities.


Conclusion


The integration of UWB localization, reinforcement learning, sensor fusion, and autonomous UAV control provides a promising framework for search-and-rescue operations in GPS-denied environments. UWB ranging enables accurate relative positioning between drones and anchors, while onboard cameras, LiDAR, and inertial sensors improve navigation continuity under non-line-of-sight, multipath, and uncertain operating conditions. Combining these measurements through sensor fusion produces a more reliable state estimate for autonomous decision-making.

The reinforcement-learning agent enables the drone to adapt its trajectory to mission objectives, obstacles, localization uncertainty, energy availability, and communication quality. In multi-drone missions, cooperative UWB ranging can also support formation control, distributed mapping, victim localization, and information exchange. A safety layer remains essential for validating the agent’s commands and enforcing collision avoidance, velocity limits, geofencing, battery constraints, and emergency procedures.

Overall, the proposed UWB-enabled intelligent drone system can improve situational awareness, reduce localization errors, expand mission coverage, and limit rescuers’ exposure to hazardous areas. Future work should focus on real-world testing in complex disaster environments, non-line-of-sight error mitigation, multi-agent coordination, robust communication, energy-efficient planning, and validation of the complete system under realistic search-and-rescue conditions.


Urban Search and Rescue (USAR) operations require rapid and reliable identification of victims in complex disaster environments. Earthquakes, structural collapses, explosions, and other emergencies can create highly cluttered scenes in which people may be partially occluded, trapped beneath debris, or visible only through small portions of the body. Conventional object-detection models are often limited to a predefined set of classes and may therefore struggle to recognize unusual victim conditions that were not explicitly represented during training.




Open-Vocabulary USAR Victim Detection and Rescue Scene Understanding explores an AI-assisted approach that combines open-vocabulary object detection, deep-learning-based victim localization, and Vision-Language Models (VLMs) to provide richer situational awareness for rescue teams. Instead of detecting only a generic person class, the system can use semantic prompts such as “trapped person,” “partially buried victim,” “injured person,” “person under debris,” or “visible human body part.”


The proposed framework integrates visual detection with rescue-scene interpretation. Detected victims are localized using bounding boxes and confidence scores, while the vision-language component analyzes the broader environment to identify rubble, structural damage, obstacles, possible access routes, and operational hazards. This information can then be organized into a structured USAR report to support first responders' decision-making. A typical processing pipeline includes:


  • Image acquisition from UAVs, mobile robots, fixed cameras, or rescue personnel.

  • Image preprocessing for efficient inference in resource-constrained or real-time environments.

  • Victim detection using a dedicated deep-learning detector such as a SimAM-FPN Faster R-CNN architecture.

  • Open-vocabulary detection to search for victim conditions that are not restricted to predefined labels.

  • IoU and confidence evaluation for assessing localization quality.

  • Vision-language scene understanding for describing debris, hazards, accessibility, and victim context.

  • Structured USAR reporting to present victim observations and operationally relevant information to rescue personnel.


The key advantage of an open-vocabulary approach is its ability to extend victim recognition beyond the categories available in the original training dataset. Rescue operators can dynamically introduce textual concepts according to the current mission, allowing the perception system to adapt to different disaster scenarios without retraining the entire detector. For UAV-assisted rescue missions, this capability can be particularly valuable. A drone can inspect areas that may be dangerous or inaccessible to human responders while the AI system highlights potential victims and generates contextual information about their surroundings. Rather than replacing rescue specialists, the system serves as a decision-support tool, helping teams prioritize areas requiring further inspection.


Ultimately, Open-Vocabulary USAR Victim Detection and Rescue Scene Understanding represents a step toward more flexible and context-aware AI systems for disaster response. By combining conventional victim detection, semantic open-vocabulary recognition, and vision-language reasoning, the framework aims to transform raw imagery into actionable information to support faster, better-informed USAR operations.



Foto del escritor: Carlos Osorio
Carlos Osorio
23 ago
3 min de lectura

Accurate localization is one of the main challenges for autonomous drones operating in GPS-denied environments, including indoor spaces, urban canyons, disaster zones, tunnels, and collapsed structures. Conventional GNSS-based navigation can become unreliable or completely unavailable in these scenarios. This project explores a compact localization architecture based on the ESP32-S3-WROOM-1 microcontroller and the Qorvo DWM3000 Ultra-Wideband (UWB) transceiver for real-time drone ranging and relative positioning.




The proposed system combines the communication and embedded processing capabilities of the ESP32-S3 with the precise time-of-flight measurement capabilities of UWB. The DWM3000 operates using IEEE 802.15.4 UWB technology and enables distance estimation between mobile and fixed nodes with centimeter-level potential under favorable line-of-sight conditions.


System Architecture

The experimental platform is organized around three primary nodes:

  • Anchor 1 — ESP32-S3 + DWM3000

  • Anchor 2 — ESP32-S3 + DWM3000

  • Mobile Tag — ESP32-S3 + DWM3000


The anchors provide known or continuously updated reference positions, while the tag can be installed on the drone. Distance measurements between the tag and anchors are used to estimate the drone's relative position. Communication between the ESP32-S3 and DWM3000 is implemented through the SPI interface.


UWB Distance Measurement

The system can support different UWB ranging strategies, particularly Single-Sided Two-Way Ranging (SS-TWR) and Double-Sided Two-Way Ranging (DS-TWR). In two-way ranging, the distance is estimated from the propagation time of the UWB signal: [d = c,t_p], where (d) is the estimated distance, (c) is the speed of light, and (t_p) represents the estimated UWB signal propagation time. DS-TWR is particularly attractive for drone localization because it mitigates the effects of clock offsets between independent UWB nodes. SS-TWR requires fewer message exchanges and thus incurs lower communication overhead, whereas DS-TWR generally provides better ranging robustness when accurate synchronization is difficult.


Drone Localization

For two anchors with known coordinates, [A_1=(x_1,y_1), \qquad A_2=(x_2,y_2),] the UWB system measures the distances [r_1=|P-A_1|,\qquadr_2=|P-A_2|,] where [P=(x,y)] represents the estimated drone position. With additional anchors, the architecture can be extended to 2D multilateration or 3D localization. Position estimates can also be fused with onboard information such as:


  • Visual-Inertial Odometry (VIO)

  • IMU measurements

  • Optical flow

  • LiDAR

  • Camera-based navigation

  • Barometric altitude

  • Extended or Unscented Kalman Filtering

This fusion is particularly useful for reducing errors caused by UWB non-line-of-sight propagation and multipath effects.


Drone-to-Drone Localization

An important extension of the platform is its use in multi-UAV networks. Rather than treating all anchors as permanently fixed infrastructure, ESP32-S3 + DWM3000 nodes can be mounted on multiple drones. For example:


Drone 1 → UWB Anchor 1Drone 2 → UWB Anchor 2Drone 3 → Mobile Tag

The drones can exchange ranging and localization information to construct a dynamic relative-positioning network. Such a configuration is attractive for cooperative exploration and search-and-rescue missions where installing permanent localization infrastructure may not be possible.


Applications


The ESP32-S3 + DWM3000 architecture is particularly suitable for research involving:

  • GPS-denied UAV navigation

  • Indoor drone localization

  • Search-and-rescue robotics

  • Cooperative UAV navigation

  • Drone swarm relative positioning

  • UWB-based mapping

  • Infrastructure inspection

  • Disaster-area exploration

  • Autonomous landing

  • Sensor-fusion research


Conclusion

The ESP32-S3 + DWM3000 UWB Drone Localization System provides a low-cost and flexible experimental platform for investigating precise ranging and relative navigation in environments where GNSS cannot be trusted. By combining UWB ranging, embedded processing, and sensor fusion, the platform can support both fixed-anchor localization and cooperative drone-to-drone positioning. The next development stage can integrate DS-TWR/SS-TWR measurements, real-time USB telemetry, multilateration, and UKF-based sensor fusion to generate a live map of anchor and drone positions. This architecture can ultimately serve as a building block for autonomous and cooperative UAV operations in complex GPS-denied search-and-rescue environments.






bottom of page