We present a recognition-based user tracking and augmented reality system that works in extreme large scale areas. The system will provide a user who captures an image of a building facade with precise location of the building and augmented information about the building. While GPS cannot provide information about camera poses, it is needed to aid reducing the searching ranges in image database. A patch-retrieval method is used for efficient computations and real-time camera pose recovery. With the patch matching as the prior information, the whole image matching can be done through propagations in an efficient way so that a more stable camera pose can be generated. Augmented information such as building names and locations are then delivered to the user. The proposed system mainly contains two parts, offline database building and online user tracking. The database is composed of images for different locations of interests. The locations are clustered into groups according to their UTM coordinates. An overlapped clustering method is used to cluster these locations in order to restrict the retrieval range and avoid ping pong effects. For each cluster, a vocabulary tree is built for searching the most similar view. On the tracking part, the rough location of the user is obtained from the GPS and the exact location and camera pose are calculated by querying patches of the captured image. The patch property makes the tracking robust to occlusions and dynamics in the scenes. Moreover, due to the overlapped clusters, the system simulates the 'soft handoff' feature and avoid frequent swaps inmemory resource. Experiments show that the proposed tracking and augmented reality system is efficient and robust in many cases.
GPS-aided recognition-based user tracking system with augmented reality in extreme large-scale areas
GPS-basierte Erfassung, Erkennungssysteme mit errweiterter Realität bei extrem großen Flächen.
2010
10 Seiten, 13 Bilder, 2 Tabellen, 19 Quellen
Aufsatz (Konferenz)
Datenträger
Englisch
AUGMENTED REALITY DEVICE AND AUGMENTED REALITY SYSTEM
Europäisches Patentamt | 2020
|