A Concept of a Vision System for Position DeterminationUsing Spatial-Time-Frequency Analysis
Abstract
This paper presents the concept of a vision system designed to determine the position of a camera within a given coordinate system. The system focuses on identifying pulsating light markers in images recorded by the camera. These markers are characterized by specific colors, pulsation frequencies and known locations. Detection is achieved using a spatial-time-frequency processing method developed by the authors. The identified markers serve as input data for a mathematical model that determines the camera’s position within the reference system. The article discusses the theoretical foundations of the proposed system design. The system was subjected to testing to verify its operational accuracy and precision in position determination. The results of these tests are presented. The article concludes with a summary of the work and a discussion of the system’s further development and practical applications.
Keywords:
image processing, spectrum analysis, light markers, localizationReferences
- Liu H.S., Pang G., Positioning beacon system using digital camera and LEDs, IEEE Transactions on Vehicular Technology, 52(2): 406–419, 2003, https://doi.org/10.1109/TVT.2002.808800.
- Yoshino M., Haruyama S., Nakagawa M., High-accuracy positioning system using visible LED lights and image sensor, 2008 IEEE Radio and Wireless Symposium, RWS, Orlando, FL, pp. 439–442, 2008, https://doi.org/10.1109/RWS.2008.4463523.
- Hassan N.U., Naeem A., Pasha M.A., Jadoon T., Yuen C., Indoor positioning using visible LED lights: A survey, ACM Computing Surveys, 48(2): Article 20, 2015, https://doi.org/10.1145/2835376.
- Li Y., He L., Zhang X., Zhu L., Zhang H., Guan Y., Multi-sensor fusion localization of indoor mobile robot, IEEE International Conference on Real-time Computing and Robotics (RCAR), Irkutsk, Russia, 2019, pp. 481–486, 2019, https://doi.org/10.1109/RCAR47638.2019.9044006.
- Tanaka H., Ultra-high-accuracy visual marker for indoor precise positioning, 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, pp. 2338–2343, 2020, https://doi.org/10.1109/ICRA40945.2020.9196535.
- Lu Z., Wu Y., Yang S., Zhang K., Quan Q., Fast and Omnidirectional relative position estimation with circular markers for UAV swarm, IEEE Transactions on Instrumentation and Measurement, 73: 5034911, 2024, https://doi.org/10.1109/TIM.2024.3472903.
- Guan W., Wen S., Zhang H., Liu L., A novel three-dimensional indoor localization algorithm based on visual visible light communication using single LED, 2018 IEEE International Conference on Automation, Electronics and Electrical Engineering (AUTEEE), Shenyang, China, pp. 202–208, 2018, https://doi.org/10.1109/AUTEEE.2018.8720798.
- Li Y., Zhu S., Yu Y., Wang Z., An improved graph-based visual localization system for indoor mobile robot using newly designed markers, International Journal of Advanced Robotic Systems, 15(2): 1729881418769191, 2018, https://doi.org/10.1177/1729881418769191.
- Novák M., Dobesch A., Wilfert O., Janík L., Visible light communication transmitter position detection for use in ITS, Optical Switching and Networking, 33: 161–168, 2019, https://doi.org/10.1016/j.osn.2018.04.002.
- Zhuang Y., Hua L., Qi L., Yang J., Cao P., Cao Y., Wu Y., Thompson J., Haas H., A survey of positioning systems using visible LED lights, IEEE Communications Surveys and Tutorials, 20(3): 1963–1988, 2018, https://doi.org/10.1109/COMST.2018.2806558.
- Soner B., Karakas M., Noyan U., Sahbaz F., Coleri S., Vehicular visible light positioning for collision avoidance and platooning: A survey, IEEE Transactions on Intelligent Transportation Systems, 25(7): 6328–6344, 2024, https://doi.org/10.1109/TITS.2023.3349160.
- Zekavat S.R., Buehrer R.M., Durgin G.D., Lovisolo L., Wang Z., Goh S.T., Ghasemi A., An overview on position location: past, present, future, International Journal of Wireless Information Networks, 28(1): 45–76, 2021, https://doi.org/10.1007/s10776-021-00504-z.
- Khan M.N., Jamil M., Gilani S.O., Ahmad I., Uzair M., Omer H., Photo detector-based indoor positioning systems variants: A new look, Computers & Electrical Engineering, 83: 106607, 2020, https://doi.org/10.1016/j.compeleceng.2020.106607.
- Rego M., Fonseca P., OCC based indoor positioning system using a smartphone camera, [in:] Santos V., Lau N., Neto P., Lopes A.C. [Eds.], Proceedings of IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC, pp. 31–36, 2021, https://doi.org/10.1109/ICARSC52212.2021.9429782.
- Nguyen N.H., Dinh Nguyen Q., Enhanced Bit-Rate Performance for Visible Light Communication Systems Between Led and Mobile Camera, [in:] Jeong S.H., Loc H.D., Fdida S., Le-Ngoc T. [Eds.], Proceedings of Tenth International Conference on Communications and Electronics (ICCE), pp. 544–549, 2024, https://doi.org/10.1109/ICCE62051.2024.10634616.
- Zhou Z., Liang B., Cao Y., Zhang M., MPPM spectrum analysis based on PPM, [in:] Proceedings of 14th International Conference on Computer Research and Development (ICCRD), pp. 356–362, 2022, https://doi.org/10.1109/ICCRD54409.2022.9730597.
- Das S., Mandal S.K., Spectral Analysis of dimming controlled MH-HPPM for visible light communication, Sixth International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), pp. 291–296, 2021, https://doi.org/10.1109/WiSPNET51692.2021.9419413.
- Bui T.-C., Biagi M., Kiravittaya S., Theoretical analysis of optical spatial multiple pulse position modulation, IEEE Global Communications Conference (GLOBECOM), 2018, https://doi.org/10.1109/GLOCOM.2018.8647138.
- Miś P., Szulim P., Analysis of the possibility of using markers emitting pulsating light in the task of localization, Applied Computer Science, 17(1): 26–39, 2021, https://doi.org/10.23743/acs-2021-03.
- Miś P., Szulim P., The effect of camera exposure on the results of spatial-frequency processing and the quality of the obtained amplitude images, [in:] Szewczyk R., Zieliński C., Kaliczyńska M. [Eds.], Automation 2022: New Solutions and Technologies for Automation, Robotics and Measurement Techniques, Springer International Publishing, Cham, pp. 306–316, 2022.
- Zhu B., Cheng J., Wang Y., Yan J., Wang J., Three-dimensional VLC positioning based on angle difference of arrival with arbitrary tilting angle of receiver, IEEE Journal on Selected Areas in Communications, 36(1): 8–22, 2018, https://doi.org/10.1109/JSAC.2017.2774435.
- Rahman M.H., Sejan M.A.S., Kim J.-J., Chung W.-Y., Reduced tilting effect of smartphone CMOS image sensor in visible light indoor positioning, Electronics (Switzerland), 9(10): 1–19, 2020, https://doi.org/10.3390/electronics9101635.
- Hossen M.S., Park Y., Kim K.-D., Performance improvement of indoor positioning using light-emitting diodes and an image sensor for light-emitting diode communication, Optical Engineering, 54(4): 045101, 2015, https://doi.org/10.1117/1.OE.54.4.045101.
- Basler ace Classic acA1600-60gc, n.d., https://www.baslerweb.com/en-us/shop/aca1600-60gc/. (accessed on 2024.12.18).
- 8.5mm, 200mm-∞ Primary WD, HR Series Fixed Focal Length Lens, n.d., https://www.edmundoptics.com/p/85mm-200mm-infin-primary-wd-hp-series-fixed-focal-length-lens/22903/. (accessed on 2024.12.18).