Efficient Dataflow Modeling of Peripheral Encoding in the Human Visual System
Эффективное моделирование потоков данных кодирования периферического зрения в системе человека
2022-11-09
SCID: 54.1/hxuthg8u
Discuss with AI
dataflow computationend-stopped feature encodingperipheral crowdingperipheral texture perception datasetpooling models
Figures from the paper
Abstract (AI)
Computer graphics seeks to deliver compelling images, generated within a computing budget, targeted at a specific display device, and ultimately viewed by an individual user. The foveated nature of human vision offers an opportunity to efficiently allocate computation and compression to appropriate areas of the viewer’s visual field, of particular importance with the rise of high-resolution and wide field-of-view display devices. However, while variations in acuity and contrast sensitivity across the field of view have been well-studied and modeled, a more consequential variation concerns peripheral vision’s degradation in the face of clutter, known as crowding. Understanding of peripheral crowding has greatly advanced in recent years, in terms of both phenomenology and modeling. Accurately leveraging this knowledge is critical for many applications, as peripheral vision covers a majority of pixels in the image. We advance computational models for peripheral vision aimed toward their eventual use in computer graphics. In particular, researchers have recently developed high-performing models of peripheral crowding, known as “pooling” models, which predict a wide range of phenomena but are computationally inefficient. We reformulate the problem as a dataflow computation, which enables faster processing and operating on larger images. Further, we account for the explicit encoding of “end stopped” features in the image, which was missing from previous methods. We evaluate our model in the context of perception of textures in the periphery, including a novel texture dataset and updated textural descriptors. Our improved computational framework may simplify development and testing of more sophisticated, complete models in more robust and realistic settings relevant to computer graphics.
Key Findings
1
Evaluation on peripheral texture perception used a novel texture dataset and updated textural descriptors, demonstrating applicability to texture perception tasks relevant to graphics.
2
Existing high-performing peripheral crowding "pooling" models predict many phenomena but are computationally inefficient for large images and graphics applications.
3
Peripheral crowding (degradation due to clutter) is a consequential variation in human vision that must be modeled for efficient graphics targeting most pixels.
4
Reformulating peripheral crowding as a dataflow computation enables faster processing and operation on larger images, improving computational efficiency.
5
The proposed model explicitly encodes "end stopped" features, addressing a missing component in previous peripheral crowding methods.
Research Object
Peripheral encoding mechanisms of the human visual system (models of peripheral crowding / pooling models)
Research Subject
Efficient dataflow computational modeling and implementation of peripheral encoding including pooling-based crowding and end-stopped feature encoding for faster, scalable perception prediction in peripheral texture perception
Publication Details
Publication Date
2022-11-09
Journal
Publisher
ISSN
Cited by
6
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest