Parallel light field: the framework and processes

Fei-Yue WANG; Xiangbing MENG; Sicong DU; Zheng GENG

doi:10.11959/j.issn.2096-6652.202112

您当前的位置：

首页 >

文章列表页 >

Parallel light field: the framework and processes

Papers and Reports | 更新时间：2024-06-05

- Parallel light field: the framework and processes
- Chinese Journal of Intelligent Science and Technology Vol. 3, Issue 1, Pages: 110-122(2021)
- 作者机构：
  
  1. 中国科学院自动化研究所复杂系统管理与控制国家重点实验室，北京 100190
  2. 青岛智能产业技术研究院平行光学技术创新中心，山东青岛 266000
  3. 中国科学院大学人工智能学院，北京 100049
  4. Genex科技公司，美国马里兰州肯辛顿 20895
- 作者简介：
- 基金信息：
  
  The National Key Research and Development Program of China(2018AAA0101502)
- DOI：10.11959/j.issn.2096-6652.202112
  CLC： TP37
- Published Online：2021-03，
  
  Published：15 March 2021
- 稿件说明：
移动端阅览
Fei-Yue WANG, Xiangbing MENG, Sicong DU, et al. Parallel light field: the framework and processes[J]. Chinese journal of intelligent science and technology, 2021, 3(1): 110-122.
DOI：

Fei-Yue WANG, Xiangbing MENG, Sicong DU, et al. Parallel light field: the framework and processes[J]. Chinese journal of intelligent science and technology, 2021, 3(1): 110-122. DOI： 10.11959/j.issn.2096-6652.202112.

摘要

光场是环境中光线的集合，对光场信息的采集、计算以及显示是极具挑战性的复杂问题。基于 ACP 的平行光场理论为解决此问题提供了一条新的有效途径。平行光场利用采集得到的实际物理世界的光场信息构建了增强的人工世界的光场，并且以采集得到的实际物理世界的光场信息为引导，在增强的人工世界的光场中进行光场实验，得到最优的光场采集方案或者显示虚实方案，最后通过平行执行的过程建立起物理世界的光场和人工世界的光场的联动优化，使整个系统成为闭环，实现智能的光场采集和显示，建立光场信息处理和应用的虚实结合的全新理论体系。

Abstract

The light field is the collection of lights in the environment

and the acquisition

calculation and display of light field information are extremely challenging and complex issues.The ACP-based theory of parallel light field provides a new and effective way to solve this problem.It used the acquired light field information from the actual physical world to construct an enhanced light field of artificial world.And guided by the light field and other information from the actual physical world

light field experiments were conducted in the enhanced light field in all artificial world to obtain the optimal light field acquisition or display schemes.Finally

the parallel optimization of the physical and artificial light fields was established through the process of parallel execution

so that the entire system become a closed-loop system.In this way

intelligent light field acquisition and display were achieved

and a real-virtual theoretical framework for light field information processing and utilization was established.

关键词

Keywords

references

ELAINE M , KATJA H , PEARSON E , et al . Human anatomy ＆ physiology:pearson new international edition/interactive physiology 10-syste [J ] . Enfermedades Infecciosas y Microbiología Clínica , 2013 , 29 ( 1 ): 72 - 73 .

GERSHUN A . The light field [J ] . Studies in Applied Mathematics , 1939 , 18 ( 1-4 ): 51 - 151 .

MOON P , SPENCER D E . The photic field [M ] . Cambridge : MIT Press , 1981 .

HONAUER K , JOHANNSEN O , KONDERMANN D , et al . A dataset and evaluation methodology for depth estimation on 4d light fields [C ] // Proceedings of the Asian Conference on Computer Vision . Berlin:Springer , 2016 .

GENG J . Volumetric 3D display for radiation therapy planning [J ] . Journal of Display Technology , 2008 , 4 ( 4 ): 437 - 450 .

GENG J . Three-dimensional display technologies [J ] . Advances in Optics and Photonics , 2013 , 5 ( 4 ): 456 - 535 .

LEE B . Three-dimensional displays,past and present [J ] . Physics Today , 2013 , 66 ( 4 ): 36 - 41 .

LEVOY M , . Light field rendering [C ] // Proceedings of the ACM SIGGRAPH Conference . New York:ACM Press , 1996 .

ADELSON E H , . The plenoptic function and the elements of early vision [C ] // Proceedings of the Computational Models of Visual Processing .[S.l.:s.n. ] , 1991 : 3 - 20

CHAI J X , TONG X , CHAN S C , et al . Plenoptic sampling [C ] // Proceedings of the ACM SIGGRAPH Conference . New York:ACM Press , 2000 : 307 - 318 .

王飞跃 . 平行系统方法与复杂系统的管理和控制 [J ] . 控制与决策 , 2004 , 19 ( 5 ): 485 - 489 , 514 .

WANG F Y . Parallel system methods for management and control of complex systems [J ] . Control and Decision , 2004 , 19 ( 5 ): 485 - 489 , 514 .

WANG F Y . Parallel control and management for intelligent transportation systems:concepts,architectures,and applications [J ] . IEEE Transactions on Intelligent Transportation Systems , 2010 , 11 ( 3 ): 630 - 638 .

王飞跃 . 平行控制:数据驱动的计算控制方法 [J ] . 自动化学报 , 2013 ( 4 ): 5 - 14 .

WANG F Y . Parallel control:a method for data-driven and computational control [J ] . Acta Automatica Sinica , 2013 ( 4 ): 5 - 14 .

王飞跃 . 计算实验方法与复杂系统行为分析和决策评估 [J ] . 系统仿真学报 , 2004 , 16 ( 5 ): 893 - 897 .

WANG F Y . Computational experiments for behavior analysis and decision evaluation of complex systems [J ] . Journal of System Simulation , 2004 , 16 ( 5 ): 893 - 897 .

LAM EDMUND Y . Computational photography with plenoptic camera and light field capture:tutorial [J ] . Journal of the Optical Society of America a Optics Image Science ＆ Vision , 2015 , 32 ( 11 ): 2021 - 2032 .

SHI L X , HASSANIEH H , DAVIS A , et al . Light field reconstruction using sparsity in the continuous fourier domain [J ] . ACM Transactions on Graphics , 2014 , 34 ( 1 ): 1 - 13 .

GEORGEIV T , ZHENG K C , CURLESS B , et al . Spatio-angular resolution tradeoffs in integral photography [C ] // Proceedings of the 17th Eurographics Symposium on Rendering Techniques,Nicosia,Cyprus .[S.l. ] : The Eurographics Association , 2006 .

GEORGEIV T , INTWALA C . Light field camera design for integral view photography [R ] . 2008 .

LUMSDAINE A , GEORGIEV T , SYSTEMS A . Full resolution lightfield rendering [R ] . 2008 .

WILBURN B , JOSHI N , VAISH V , et al . High performance imaging using large camera arrays [J ] . ACM Transactions on Graphics , 2005 , 24 ( 3 ): 765 - 776 .

CAO X , GENG Z , LI T T . Dictionary-based light field acquisition using sparse camera array [J ] . Optics Express , 2014 , 22 ( 20 ): 24081 - 24095 .

MARWAH K , WETZSTEIN G , BANDO Y , et al . Compressive light field photography using over complete dictionaries and optimized projections [J ] . ACM Transactions on Graphics , 2013 , 32 ( 4 ): 1 - 12 .

刘浩敏 , 章国锋 , 鲍虎军 . 基于单目视觉的同时定位与地图构建方法综述 [J ] . 计算机辅助设计与图形学学报 , 2016 , 28 ( 6 ): 855 - 868 .

LIU H M , ZHANG G F , BAO H J . A survey of monocular simultaneous localization and mapping [J ] . Journal of Computer-Aided Design ＆Computer Graphics , 2016 , 28 ( 6 ): 855 - 868 .

CADENA C , CARLONE L , CARRILLO H , et al . Past,present,and future of simultaneous localization and mapping:toward the robust-perception age [J ] . IEEE Transactions on Robotics , 2016 , 32 ( 6 ): 1309 - 1332 .

BRESSON G , ALSAYED Z , YU L , et al . Simultaneous localization and mapping:a survey of current trends in autonomous driving [J ] . IEEE Transactions on Intelligent Vehicles , 2017 , 2 ( 3 ): 194 - 220 .

YOUNES G , ASMAR D , SHAMMAS E , et al . Keyframe-based monocular SLAM:design,survey,and future directions [J ] . Robotics and Autonomous Systems , 2017 :S0921889017300647.

孟祥冰 , 王蓉 , 张梅 , 等 . 平行感知:ACP 理论在视觉SLAM 技术中的应用 [J ] . 指挥与控制学报 , 2017 , 3 ( 4 ): 350 - 358 .

MENG X B , WANG R , ZHANG M , et al . Parallel perception:an ACP-based approach to visual SLAM [J ] . Journal of Command and Control , 2017 , 3 ( 4 ): 350 - 358 .

LEE S , JANG C , MOON S , et al . Additive light field displays:realization of augmented reality with holographic optical elements [J ] . ACM Transactions on Graphics , 2016 , 35 ( 4 ): 1 - 13 .

DEBEVEC P , WENGER A , TCHOU C , et al . A lighting reproduction approach to live-action compositing [C ] // Proceedings of the 29th Conference on Computer Graphics and Interactive Techniques . New York:ACM Press , 2002 : 547 - 556 .

TIM H , JONATHAN C , CHRIS T , et al . Light stage 2.0 [C ] // SIGGRAPH Technical Sketches .[S.l.:s.n. ] , 2001 .

ALEXANDER O , ROGERS M , LAMBETH W , et al . Creating a photoreal digital actor:the digital Emily project [C ] // Proceedings of the 2010 Conference for Visual Media Production . Piscataway:IEEE Press , 2010 : 176 - 187 .

ALEXANDER O , ROGERS M , LAMBETH W , et al . The digital Emily project:achieving a photorealistic digital actor [J ] . IEEE Computer Graphics ＆ Applications , 2010 , 30 ( 4 ): 20 - 31 .

STEUER J . Defining virtual reality:dimensions determining telepresence [J ] . Journal of Communication , 1992 , 42 ( 4 ): 73 - 93 .

MILGRAM P , KISHINO F . A taxonomy of mixed reality visual displays [J ] . IEICE Transactions on Information and Systems , 1994 , 77 ( 12 ): 1321 - 1329 .

AZUMA R , BAILLOT Y , BEHRINGER R , et al . Recent advances in augmented reality [J ] . IEEE Computer Graphics and Applications , 2001 , 21 ( 6 ): 34 - 47 .

ZHANGA Z , GENGA Z , LIA T , et al . Integration of real-time 3D image acquisition and multiview 3D display [J ] . Proceedings of SPIE the International Society for Optical Engineering , 2014 : 8979 .

CAO X , GENG Z , LI T T . Dictionary-based light field acquisition using sparse camera array [J ] . Optics Express , 2014 , 22 ( 20 ): 24081 - 24095 .

PEI R J , GENG Z , ZHANG Z X . Subpixel multiplexing method for 3D lenticular display [J ] . Journal of Display Technology , 2016 , 12 ( 10 ): 1 .

PEI R J , GENG Z , MA K , et al . Three dimensional lenticular display synthetic image rendering based on light field acquisition [J ] . Journal of the Society for Information Display , 2017 , 25 ( 1-3 ): 117 - 125 .

WANG R , GENG Z , ZHANG Z X , et al . Visualization techniques for augmented reality in endoscopic surgery [C ] // International Conference on Medical Imaging and Augmented Reality . Berlin:Springer , 2016 .

WANG R , ZHANG M , MENG X B , et al . 3D tracking for augmented reality using combined region and dense cues in endoscopic surgery [J ] . IEEE Journal of Biomedical and Health Informatics , 2017 : 1540 - 1551 .

王飞跃 . 平行光场与平行光学,从光学计算实验到光学引导智能 [R ] . 2018 .

WANG F Y . Parallel light field and parallel optics,from optical computing experiment to optical guided intelligence [R ] . 2018 .

康孟珍 , 王秀娟 , 华净 , 等 . 平行农业:迈向智慧农业的智能技术 [J ] . 智能科学与技术学报 , 2019 , 1 ( 2 ): 107 - 117 .

KANG M Z , WANG X J , HUA J , et al . Parallel agriculture:intelligent technology toward smart agriculture [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 2 ): 107 - 117 .

吕宜生 , 陈圆圆 , 金峻臣 , 等 . 平行交通:虚实互动的智能交通管理与控制 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 21 - 33 .

LYU Y S , CHEN Y Y , JIN J C , et al . Parallel transportation:virtual-real interaction for intelligent traffic management and control [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 21 - 33 .

王飞跃 , 张梅 , 孟祥冰 , 等 . 平行手术:基于 ACP 的智能手术计算方法 [J ] . 模式识别与人工智能 , 2017 , 30 ( 11 ): 961 - 970 .

WANG F Y , ZHANG M , MENG X B , et al . Parallel surgery:an acp-based approach for intelligent operations , 2017 , 30 ( 11 ): 961 - 970 .

AGARWAL S , SNAVELY N , SIMON I , et al . Building romein a day [J ] . Communications of the ACM , 2011 , 54 ( 10 ): 105 - 112 .

GOODFELLOW I J , POUGET-ABADIE J , MIRZA M , et al . Generative adversarial networks [J ] . Advances in Neural Information Processing Systems , 2014 , 3 : 2672 - 2680 .

束越新 . 颜色光学基础理论 [M ] . 山东 : 山东科学技术出版社 , 1981 .

SHU Y X . Basic theory of color optics [M ] . Shandong : Shandong Science and Technology Press , 1981 .

WYSZECKI G , STILES W S . Color science [M ] . New York : Wiley , 1982 .

FAIRCHILD M D . Color appearance models [M ] . New York : Wiley , 2013 .

BERNS R S . Billmeyer and Saltzman’s principles of color technology [M ] . New York : Wiley , 2019 .

FINN C , ABBEEL P , LEVINE S . Model-agnostic meta-learning for fast adaptation of deep networks [J ] . arXiv preprint , 2017 ,arXiv:1703.03400.

RADFORD A , METZ L , CHINTALA S . Unsupervised representation learning with deep convolutional generative adversarial networks [J ] . Computer Science , 2015 .

ZHU J Y , PARK T , ISOLA P , et al . Unpaired image-to-image translation using cycle-consistent adversarial networks [C ] // Proceedings of the 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2242 - 2251 .

MITRA S , ACHARYA T . Gesture recognition:a survey [J ] . IEEE Transactions on Systems,Man,and Cybernetics,Part C , 2007 , 37 ( 3 ): 311 - 324 .

RAUTARAY S S , AGRAWAL A . Vision based hand gesture recognition for human computer interaction:a survey [J ] . Artificial Intelligence Review , 2015 , 43 ( 1 ): 1 - 54 .

LIU Y J , ZHANG J K , YAN W J , et al . A main directional mean optical flow feature for spontaneous micro-expression recognition [J ] . IEEE Transactions on Affective Computing , 2015 , 7 ( 4 ): 299 - 310 .

XU K , BA J , KIROS R , et al . Show,attend and tell:neural image caption generation with visual attention [J ] . Computer Science , 2015 : 2048 - 2057 .

POTAPOV D , DOUZE M , HARCHAOUI Z , et al . Category-specific video summarization [C ] // Proceedings of the 13th European Conference on Computer Vision . Berlin:Springer , 2014 : 540 - 555 .

李力 , 林懿伦 , 曹东璞 , 等 . 平行学习——机器学习的一个新型理论框架 [J ] . 自动化学报 , 2017 , 43 ( 1 ): 1 - 8 .

LI L , LIN Y L , CAO D P , et al . Parallel learning:a new framework for machine learning [J ] . Acta Automatica Sinica , 2017 , 43 ( 1 ): 1 - 8 .

LI X , WANG K F , TIAN Y L , et al . The paralleleye dataset:a large collection of virtual images for traffic vision research [J ] . IEEE Transactions on Intelligent Transportation Systems , 2018 , 20 ( 6 ): 2072 - 2084 .

Views

969

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Parallel Sharhili: a new approach to sustainable development and intelligent management of ecological resources

Architecture and key techniques of parallel creation through the fusion of human-cyber-physical intelligence in CPSS

Parallel security:generative adversarial systems for intelligent security in CPSS

Parallel art:artistic creation under human-machine collaboration

Parallel machine:a framework for the control and management for intelligent machines

Related Author

Qinghua NI

Jing YANG

Mengzhen KANG

Xuanhao LI

Yingkun DU

Fei-Yue WANG

Peiding PI

Fei-Yue WANG

Related Institution

State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences

Qingdao Academy of Intelligent Industries

Faculty of Land and Food Systems, University of British Columbia

School of Social ＆Political Sciences, The University of Glasgow, Scotland G12 8QQ, the United Kingdom

The People’s Government of Bortala Mongolian Autonomous Prefecture, Bortala Mongolian

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35685 Visits Today：160

⁰