research-article

When Visible Light (Backscatter) Communication Meets Neuromorphic Cameras in V2X

Authors:

Shanghang Zhang,

Chenren XuAuthors Info & Claims

HotMobile '23: Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications

Pages 42 - 48

https://doi.org/10.1145/3572864.3580333

Published: 22 February 2023 Publication History

Abstract

Intelligent transportation systems are predicted to change the way people live in the foreseeable future. Vehicular networks are one of the key enablers for such systems, yet no status-quo solutions of vehicular networks make practical deployments possible. This paper proposes NeuromorphicVLC, a visible light communication system equipped with neuromorphic cameras as optical receivers to improve its performance. Compared with conventional photodiodes or cameras, the new type of bio-inspired CMOS vision sensors highlight high temporal resolution, large dynamic range, and adequate spatial resolution to filter out ambient noise. We develop a complete signal processing pipeline to detect the VLC transmitters and demodulate the messages. Preliminary experimental results demonstrate NeuromorphicVLC achieves a 4.8 Kbps bit rate and ensures reliability in various range and mobile scenarios.

References

[1]

Wireless access in vehicular environments. IEEE Std 802.11p, 2010.

[2]

Shanzhi Chen, Jinling Hu, Yan Shi, Ying Peng, Jiayi Fang, Rui Zhao, and Li Zhao. Vehicle-to-everything (V2X) services supported by LTE-based systems and 5G. IEEE Communications Standards Magazine, 2017.

[3]

Mohsen Kavehrad. Optical wireless applications: A solution to ease the wireless airwaves spectrum crunch. In SPIE Broadband Access Communication Technologies Vii, 2013.

[4]

Behnaam Aazhang et al. Key drivers and research challenges for 6G ubiquitous wireless intelligence (white paper). 2019.

[5]

Wei Jiang and Fa-Long Luo. Optical and visible light wireless communications in 6G. 2023.

[6]

Luiz Eduardo Mendes Matheus, Alex Borges Vieira, Luiz FM Vieira, Marcos AM Vieira, and Omprakash Gnawali. Visible light communication: concepts, applications and challenges. IEEE Communications Surveys & Tutorials, 2019.

[7]

Airbus, Latécoère bring LiFi IFE to the business jet market. https://paxex.aero/airbus-latecoere-lifi-business-jet/, 2021.

[8]

IEEE standard for local and metropolitan area networks-part 15.7: Short-range optical wireless communications. IEEE Std 802.15.7, 2019.

[9]

High-speed indoor visible light communication transceiver - system architecture, physical layer and data link layer specification. ITU-T G.9991, 2019.

[10]

Agon Memedi and Falko Dressler. Vehicular visible light communications: A survey. IEEE Communications Surveys & Tutorials, 2020.

[11]

Alin-Mihai Căilean and Mihai Dimian. Current challenges for visible light communications usage in vehicle applications: A survey. IEEE Communications Surveys & Tutorials, 2017.

[12]

Pengfei Luo, Min Zhang, Zabih Ghassemlooy, et al. Experimental demonstration of RGB LED-based optical camera communications. IEEE Photonics Journal, 2015.

[13]

Peng Ji, Hsin-Mu Tsai, Chao Wang, and Fuqiang Liu. Vehicular visible light communications with LED taillight and rolling shutter camera. In IEEE Vehicular Technology Conference, 2014.

[14]

Takaya Yamazato, Isamu Takai, Hiraku Okada, et al. Image-sensor-based visible light communication for automotive applications. IEEE Communications Magazine, 2014.

[15]

Wen-Hsuan Shen and Hsin-Mu Tsai. RayTrack: enabling interference-free outdoor mobile vlc with dynamic field-of-view. In ACM MobiSys, 2021.

[16]

Shinya Itoh, Isamu Takai, Md Shakowat Zaman Sarker, Moeta Hamai, Keita Yasutomi, Michinori Andoh, and Shoji Kawahito. A CMOS image sensor for 10Mb/s 70m-range led-based spatial optical communication. In IEEE ISSCC, 2010.

[17]

Fuyou Liao, Feichi Zhou, and Yang Chai. Neuromorphic vision sensors: Principle, progress and perspectives. Journal of Semiconductors, 2021.

[18]

Guillermo Gallego, Tobi Delbrück, Garrick Orchard, et al. Event-based vision: A survey. IEEE TPAMI, 2020.

[19]

Wen-Hsuan Shen, Po-Wen Chen, and Hsin-Mu Tsai. Vehicular visible light communication with dynamic vision sensor: A preliminary study. In IEEE VNC, 2018.

[20]

Zhengqiang Tang, Takaya Yamazato, and Shintaro Arai. A preliminary investigation for event camera-based visible light communication using the propeller-type rotary LED transmitter. In IEEE ICC Workshops, 2022.

[21]

Tiejun Huang, Yajing Zheng, Zhaofei Yu, et al. 1000x faster camera and machine vision with ordinary devices. Engineering, 2022.

[22]

Lin Zhu, Siwei Dong, Jianing Li, Tiejun Huang, and Yonghong Tian. Ultra-high temporal resolution visual reconstruction from a fovea-like spike camera via spiking neuron model. IEEE TPAMI, 2022.

[23]

Xieyang Xu, Yang Shen, Junrui Yang, Chenren Xu, Guobin Shen, Guojun Chen, and Yunzhe Ni. PassiveVLC: Enabling practical visible light backscatter communication for battery-free IoT applications. In ACM MobiCom, 2017.

Digital Library

[24]

Purui Wang, Lilei Feng, Guojun Chen, et al. Renovating road signs for infrastructure-to-vehicle networking: A visible light backscatter communication and networking approach. In ACM MobiCom, 2020.

Digital Library

[25]

Ashwin Ashok, Marco Gruteser, Narayan Mandayam, Jayant Silva, Michael Varga, and Kristin Dana. Challenge: Mobile optical networks through visual MIMO. In ACM MobiCom, 2010.

[26]

Cen B Liu, Bahareh Sadeghi, and Edward W Knightly. Enabling vehicular visible light communication (V²LC) networks. In ACM VANET, 2011.

Digital Library

[27]

Alin-Mihai Căilean, Barthélemy Cagneau, Luc Chassagne, Mihai Dimian, and Valentin Popa. Novel receiver sensor for visible light communications in automotive applications. IEEE Sensors Journal, 2015.

[28]

Liwen Hu, Rui Zhao, Ziluo Ding, Lei Ma, Boxin Shi, Ruiqin Xiong, and Tiejun Huang. Optical flow estimation for spiking camera. In IEEE/CVF CVPR, 2022.

[29]

Jiyuan Zhang, Lulu Tang, Zhaofei Yu, Jiwen Lu, and Tiejun Huang. Spike transformer: Monocular depth estimation for spiking camera. In ECCV, 2022.

[30]

Jing Zhao, Jiyu Xie, Ruiqin Xiong, Jian Zhang, Zhaofei Yu, and Tiejun Huang. Super resolve dynamic scene from continuous spike streams. In IEEE/CVF ICCV, 2021.

[31]

Yue Wu, Purui Wang, Kenuo Xu, Lilei Feng, and Chenren Xu. Turboboosting visible light backscatter communication. In ACM SIGCOMM, 2020.

Digital Library

[32]

Kenuo Xu, Chen Gong, Bo Liang, Yue Wu, Boya Di, Lingyang Song, and Chenren Xu. Low-latency visible light backscatter networking with RetroMUMIMO. In ACM SenSys, 2022.

Digital Library

[33]

Wei Li, Tuochao Chen, Zhe Ou, Xin Wen, Zichen Xu, and Chenren Xu. RetroFlex: enabling intuitive human-robot collaboration with flexible retroreflective tags. CCF Transactions on Pervasive Computing and Interaction, 2022.

[34]

Lin Zhu, Siwei Dong, Tiejun Huang, and Yonghong Tian. A retina-inspired sampling method for visual texture reconstruction. In IEEE ICME, 2019.

[35]

Etienne Perot, Pierre de Tournemire, Davide Nitti, Jonathan Masci, and Amos Sironi. Learning to detect objects with a 1 megapixel event camera. In NeurIPS, 2020.

[36]

Abdelhamid Nafaa, Tarik Taleb, and Liam Murphy. Forward error correction strategies for media streaming over wireless networks. IEEE Communications Magazine, 2008.

[37]

Clayton Shepard, Josh Blum, Ryan E Guerra, Rahman Doost-Mohammady, and Lin Zhong. Design and implementation of scalable massive-MIMO networks. In ACM MobiSys Workshops, 2020.

Digital Library

[38]

Jiamin Wu, Yuduo Guo, Chao Deng, Anke Zhang, Hui Qiao, Zhi Lu, Jiachen Xie, Lu Fang, and Qionghai Dai. An integrated imaging sensor for aberration-corrected 3D photography. Nature, 2022.

[39]

Zhe Jiang, Yu Zhang, Dongqing Zou, Jimmy Ren, Jiancheng Lv, and Yebin Liu. Learning event-based motion deblurring. In IEEE/CVF CVPR, 2020.

[40]

Ziwei Liu, Tianyue Zheng, Chao Hu, Yanbing Yang, Yimao Sun, Yi Zhang, Zhe Chen, Liangyin Chen, and Jun Luo. CORE-Lens: Simultaneous communication and object recognition with disentangled-gan cameras. In ACM MobiCom, 2022.

Digital Library

Cited By

Wang YShen YXu KHassan MZhao GXu CHu WShu YLiu JTan RHe YChen J(2024)Towards High-Speed Passive Visible Light Communication with Event Cameras and Digital Micro-MirrorsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699368(704-717)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699368
Mohamed Nishar APaul SAshok A(2024)Poster Abstract: Joint Optical Wireless Communication and Sensing using Neuromorphic Cameras2024 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)10.1109/IPSN61024.2024.00053(305-306)Online publication date: 13-May-2024
https://doi.org/10.1109/IPSN61024.2024.00053
Zhang PLiu ZHu XSun YDeng XZhu BYang Y(2023)Constraints and Recent Solutions of Optical Camera Communication for Practical ApplicationsPhotonics10.3390/photonics1006060810:6(608)Online publication date: 24-May-2023
https://doi.org/10.3390/photonics10060608

Index Terms

When Visible Light (Backscatter) Communication Meets Neuromorphic Cameras in V2X

Recommendations

A Visible Light Backscatter Communication Solution for Low-cost Parking Space Detection
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers

We introduce an intelligent parking space detection system based on PassiveVLC, a visible light backscatter communication technology. Its substrate is retroreflection -- by instrumenting retroreflector in each parking space, we are able to detect the ...
Using consumer LED light bulbs for low-cost visible light communication systems
VLCS '14: Proceedings of the 1st ACM MobiCom workshop on Visible light communication systems

LED-to-LED Visible Light Communication (VLC) based on Light Emitting Diodes (LEDs) and microcontrollers provide a foundation for networking using visible light as communication medium. We describe a low-complexity smart LED light bulb prototype that is ...
Towards a Laser Warning System in the Visible Spectrum using a Neuromorphic Camera
ICONS '22: Proceedings of the International Conference on Neuromorphic Systems 2022

We present an assessment of the use of a neuromorphic camera in a Laser Warning Systems (LWS). The tested configuration is composed of a fisheye lens mounted onto a neuromorphic camera, yielding hemispherical coverage. We show that the tested ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotMobile '23: Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications

February 2023

306 pages

ISBN:9798400700170

DOI:10.1145/3572864

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 February 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
National Key Research and Development Plan, China

Conference

HotMobile '23

Sponsor:

SIGMOBILE

HotMobile '23: The 24th International Workshop on Mobile Computing Systems and Applications

February 22 - 23, 2023

California, Newport Beach

Acceptance Rates

Overall Acceptance Rate 96 of 345 submissions, 28%

Upcoming Conference

HOTMOBILE '25

Sponsor:
sigmobile

The 26th International Workshop on Mobile Computing Systems and Applications

February 26 - 27, 2025

La Quinta , CA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
338
Total Downloads

Downloads (Last 12 months)92
Downloads (Last 6 weeks)10

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang YShen YXu KHassan MZhao GXu CHu WShu YLiu JTan RHe YChen J(2024)Towards High-Speed Passive Visible Light Communication with Event Cameras and Digital Micro-MirrorsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699368(704-717)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699368
Mohamed Nishar APaul SAshok A(2024)Poster Abstract: Joint Optical Wireless Communication and Sensing using Neuromorphic Cameras2024 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)10.1109/IPSN61024.2024.00053(305-306)Online publication date: 13-May-2024
https://doi.org/10.1109/IPSN61024.2024.00053
Zhang PLiu ZHu XSun YDeng XZhu BYang Y(2023)Constraints and Recent Solutions of Optical Camera Communication for Practical ApplicationsPhotonics10.3390/photonics1006060810:6(608)Online publication date: 24-May-2023
https://doi.org/10.3390/photonics10060608

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten