沉默的羔羊

Chinese team develops intelligent vision sensor that turns light signals into AI-ready tokens, reducing use of energy_我的网站

一 |     

    The new ultra-low-power intelligent vision sensor chip "LightTok" developed by a research team from Nanjing University. Photo: from Science and Technology Daily
A Chinese research team from Nanjing University has developed a new ultra-low-power intelligent vision sensor chip, dubbed "LightTok," that can convert light signals into tokens within the sensor, significantly reducing the high energy consumption caused by frequent transfers of massive amounts of redundant data, the principal investigator told the Global Times.
According to a release from the Institute of Brain-Inspired Intelligence of Nanjing University, tokens generated by the LightTok chip can be directly fed into a Transformer encoder for image recognition.
"Our design idea was to move token generation onto the sensor itself, allowing the chip to directly produce tokens that AI models can process once light reaches the sensor," Miao Feng, director of the Institute of Brain-Inspired Intelligence at Nanjing University, told the Global Times on Thursday. "These tokens contain complete image information."
Physical AI refers to intelligent systems capable of autonomously perceiving, reasoning, acting and receiving feedback in the real world, representing a key pathway for AI to move from the digital realm into the physical world. Vision-based physical AI systems powered by large AI models need to convert visual information from real-world environments into tokens that can be processed by AI models before feeding these tokens into Transformers for subsequent tasks.
In traditional visual perception pipelines, light signals must go through multiple stages, including image sensing, analog-to-digital conversion, data buffering and transfer, digital image patching and embedding, before being transformed into tokens that AI models can process. The frequent transfer of massive amounts of redundant data has resulted in high energy consumption at the edge, according to a report by Science and Technology Daily.
The LightTok chip directly addresses a key challenge in physical AI hardware: how to efficiently acquire and tokenize visual information from the physical world with low energy consumption, Miao said.
The LightTok chip consists of a photosensitive memory array and peripheral circuits. The team built the array based on single-layer molybdenum disulfide (MoS₂) floating-gate phototransistors, with each pixel capable of sensing light, storing information and performing analog computing. By processing optical information directly within the chip, the device can convert captured visual signals into tokens for AI models, according to the research team.
The current LightTok prototype has a resolution of 32×32 pixels, or 1,024 photosensitive pixels, which is still smaller than that of smartphone cameras and industrial imaging systems. However, Miao said the technology is compatible with CMOS manufacturing processes and can be scaled up. With wafer-level growth of molybdenum disulfide materials, the chip could potentially achieve a scale comparable to existing imaging devices.
Miao said the chip also draws inspiration from the information-processing mechanism of human vision. Similar to how the retina extracts key visual information before transmitting it to the brain, the chip also aims to process visual information at an early stage. 
The research was conducted in collaboration with another research team from the National University of Singapore. The findings were published on Wednesday in Nature Sensors, an internationally renowned journal in the field of sensing technology, according to the release.
Potential applications for LightTok include drone systems, autonomous remote sensing and small-scale embodied AI systems, Miao said. In these scenarios, devices need to continuously detect, understand and track targets, generating massive amounts of visual data. By reducing the energy required for visual processing, the technology could extend the operating time of drones, satellites and small robots with limited power supplies, the expert said.    
。据新浪财经1月11日新闻报道，10月10日晚，由中国企业家俱乐部主办的“商业春节晚会：2019年道农会”隆重举行。中国企业俱乐部的董事会成员马云、刘传志、曹国伟、王忠军、刘永浩等都表现出了巨大的才华。刘传志和余谦交谈，马云唱了一首歌《空城计》。其中，刘传志在相声中与余谦交谈，刘传志是一个调笑者，余谦是一个恭维者。刘传志嘲笑马云说：“（马云）有一站，玉树林峰啊，一笑，大家的风度。你看得越多，你就越喜欢它。关键不是我喜欢它。你看得越多，你就越喜欢它。马云是中国妇女的敌人。除了刘传志的相声之外，中国企业家俱乐部主席马云还展示了他的家政技巧。他出生在一个民间艺术家庭，表演京剧《空城计划》，以超强的生命力结束。据了解，中化集团董事长宁高宁、亚信集团董事长田顺宁、民生银行董事长红旗、友友网前董事长李东生、友海昌车间董事长王文静、智前董事长毛大庆等，除马云、刘传志上台演出外，还有友友网前董事长田顺宁、友海昌车间董事长王文静。招商银行、华谊兄弟、新浪董事长王忠军。曹国伟董事长、新物流董事会执行主席沈国军、黑土集团创始人孙强、中国企业家俱乐部创始人总经理程宏、正合岛创始人刘东华、新奥集团董事长王玉锁、新希望集团董事长刘永浩、清华控股有限公司专职董事徐景宏，复兴集团董事长郭广昌、高晓松等，戴玉强、郎朗、陆思清、于谦等同台演出。

Current article:http://www.shangfochengcongshuaizhuang.buzz/list_mcia/6z01in.pptx

Published on:11:06:58