平行光场：基本框架与流程

王飞跃; 孟祥冰; 杜思聪; 耿征

doi:10.11959/j.issn.2096-6652.202112

您当前的位置：

首页 >

文章列表页 >

平行光场：基本框架与流程

学术论文 | 更新时间：2024-06-05

- 平行光场：基本框架与流程
- Parallel light field: the framework and processes
- 智能科学与技术学报 2021年3卷第1期页码：110-122
- 作者机构：
  
  1. 中国科学院自动化研究所复杂系统管理与控制国家重点实验室，北京 100190
  2. 青岛智能产业技术研究院平行光学技术创新中心，山东青岛 266000
  3. 中国科学院大学人工智能学院，北京 100049
  4. Genex科技公司，美国马里兰州肯辛顿 20895
- 作者简介：
  
  [ "王飞跃（1961- ），男，博士，中国科学院自动化研究所复杂系统管理与控制国家重点实验室主任，中国科学院大学中国经济与社会安全研究中心主任，青岛智能产业技术研究院院长，主要研究方向为平行系统的方法与应用、社会计算、平行智能以及知识自动化。" ]
  [ "孟祥冰（1990- ），男，博士，中国科学院自动化研究所复杂系统管理与控制国家重点实验室助理研究员，主要研究方向为视觉SLAM、真三维显示。" ]
  [ "杜思聪（1996- ），男，中国科学院自动化研究所复杂系统管理与控制国家重点实验室硕士生，主要研究方向为视觉SLAM。" ]
  [ "耿征（1957- ），男，博士，Genex 科技公司创始人，主要研究方向为真三维显示、三维成像、生物医学工程、智能视频监控系统、智能机器人。" ]
- 基金信息：
  
  国家重点研发计划(2018AAA0101502)
- DOI：10.11959/j.issn.2096-6652.202112
  中图分类号： TP37
- 网络出版日期：2021-03，
  
  纸质出版日期：2021-03-15
- 稿件说明：
移动端阅览
王飞跃, 孟祥冰, 杜思聪, 等. 平行光场：基本框架与流程[J]. 智能科学与技术学报, 2021,3(1):110-122.

Fei-Yue WANG, Xiangbing MENG, Sicong DU, et al. Parallel light field: the framework and processes[J]. Chinese journal of intelligent science and technology, 2021, 3(1): 110-122.
王飞跃, 孟祥冰, 杜思聪, 等. 平行光场：基本框架与流程[J]. 智能科学与技术学报, 2021,3(1):110-122. DOI： 10.11959/j.issn.2096-6652.202112.

Fei-Yue WANG, Xiangbing MENG, Sicong DU, et al. Parallel light field: the framework and processes[J]. Chinese journal of intelligent science and technology, 2021, 3(1): 110-122. DOI： 10.11959/j.issn.2096-6652.202112.

摘要

光场是环境中光线的集合，对光场信息的采集、计算以及显示是极具挑战性的复杂问题。基于 ACP 的平行光场理论为解决此问题提供了一条新的有效途径。平行光场利用采集得到的实际物理世界的光场信息构建了增强的人工世界的光场，并且以采集得到的实际物理世界的光场信息为引导，在增强的人工世界的光场中进行光场实验，得到最优的光场采集方案或者显示虚实方案，最后通过平行执行的过程建立起物理世界的光场和人工世界的光场的联动优化，使整个系统成为闭环，实现智能的光场采集和显示，建立光场信息处理和应用的虚实结合的全新理论体系。

Abstract

The light field is the collection of lights in the environment

and the acquisition

calculation and display of light field information are extremely challenging and complex issues.The ACP-based theory of parallel light field provides a new and effective way to solve this problem.It used the acquired light field information from the actual physical world to construct an enhanced light field of artificial world.And guided by the light field and other information from the actual physical world

light field experiments were conducted in the enhanced light field in all artificial world to obtain the optimal light field acquisition or display schemes.Finally

the parallel optimization of the physical and artificial light fields was established through the process of parallel execution

so that the entire system become a closed-loop system.In this way

intelligent light field acquisition and display were achieved

and a real-virtual theoretical framework for light field information processing and utilization was established.

关键词

Keywords

references

ELAINE M , KATJA H , PEARSON E , et al . Human anatomy ＆ physiology:pearson new international edition/interactive physiology 10-syste [J ] . Enfermedades Infecciosas y Microbiología Clínica , 2013 , 29 ( 1 ): 72 - 73 .

GERSHUN A . The light field [J ] . Studies in Applied Mathematics , 1939 , 18 ( 1-4 ): 51 - 151 .

MOON P , SPENCER D E . The photic field [M ] . Cambridge : MIT Press , 1981 .

HONAUER K , JOHANNSEN O , KONDERMANN D , et al . A dataset and evaluation methodology for depth estimation on 4d light fields [C ] // Proceedings of the Asian Conference on Computer Vision . Berlin:Springer , 2016 .

GENG J . Volumetric 3D display for radiation therapy planning [J ] . Journal of Display Technology , 2008 , 4 ( 4 ): 437 - 450 .

GENG J . Three-dimensional display technologies [J ] . Advances in Optics and Photonics , 2013 , 5 ( 4 ): 456 - 535 .

LEE B . Three-dimensional displays,past and present [J ] . Physics Today , 2013 , 66 ( 4 ): 36 - 41 .

LEVOY M , . Light field rendering [C ] // Proceedings of the ACM SIGGRAPH Conference . New York:ACM Press , 1996 .

ADELSON E H , . The plenoptic function and the elements of early vision [C ] // Proceedings of the Computational Models of Visual Processing .[S.l.:s.n. ] , 1991 : 3 - 20

CHAI J X , TONG X , CHAN S C , et al . Plenoptic sampling [C ] // Proceedings of the ACM SIGGRAPH Conference . New York:ACM Press , 2000 : 307 - 318 .

王飞跃 . 平行系统方法与复杂系统的管理和控制 [J ] . 控制与决策 , 2004 , 19 ( 5 ): 485 - 489 , 514 .

WANG F Y . Parallel system methods for management and control of complex systems [J ] . Control and Decision , 2004 , 19 ( 5 ): 485 - 489 , 514 .

WANG F Y . Parallel control and management for intelligent transportation systems:concepts,architectures,and applications [J ] . IEEE Transactions on Intelligent Transportation Systems , 2010 , 11 ( 3 ): 630 - 638 .

王飞跃 . 平行控制:数据驱动的计算控制方法 [J ] . 自动化学报 , 2013 ( 4 ): 5 - 14 .

WANG F Y . Parallel control:a method for data-driven and computational control [J ] . Acta Automatica Sinica , 2013 ( 4 ): 5 - 14 .

王飞跃 . 计算实验方法与复杂系统行为分析和决策评估 [J ] . 系统仿真学报 , 2004 , 16 ( 5 ): 893 - 897 .

WANG F Y . Computational experiments for behavior analysis and decision evaluation of complex systems [J ] . Journal of System Simulation , 2004 , 16 ( 5 ): 893 - 897 .

LAM EDMUND Y . Computational photography with plenoptic camera and light field capture:tutorial [J ] . Journal of the Optical Society of America a Optics Image Science ＆ Vision , 2015 , 32 ( 11 ): 2021 - 2032 .

SHI L X , HASSANIEH H , DAVIS A , et al . Light field reconstruction using sparsity in the continuous fourier domain [J ] . ACM Transactions on Graphics , 2014 , 34 ( 1 ): 1 - 13 .

GEORGEIV T , ZHENG K C , CURLESS B , et al . Spatio-angular resolution tradeoffs in integral photography [C ] // Proceedings of the 17th Eurographics Symposium on Rendering Techniques,Nicosia,Cyprus .[S.l. ] : The Eurographics Association , 2006 .

GEORGEIV T , INTWALA C . Light field camera design for integral view photography [R ] . 2008 .

LUMSDAINE A , GEORGIEV T , SYSTEMS A . Full resolution lightfield rendering [R ] . 2008 .

WILBURN B , JOSHI N , VAISH V , et al . High performance imaging using large camera arrays [J ] . ACM Transactions on Graphics , 2005 , 24 ( 3 ): 765 - 776 .

CAO X , GENG Z , LI T T . Dictionary-based light field acquisition using sparse camera array [J ] . Optics Express , 2014 , 22 ( 20 ): 24081 - 24095 .

MARWAH K , WETZSTEIN G , BANDO Y , et al . Compressive light field photography using over complete dictionaries and optimized projections [J ] . ACM Transactions on Graphics , 2013 , 32 ( 4 ): 1 - 12 .

刘浩敏 , 章国锋 , 鲍虎军 . 基于单目视觉的同时定位与地图构建方法综述 [J ] . 计算机辅助设计与图形学学报 , 2016 , 28 ( 6 ): 855 - 868 .

LIU H M , ZHANG G F , BAO H J . A survey of monocular simultaneous localization and mapping [J ] . Journal of Computer-Aided Design ＆Computer Graphics , 2016 , 28 ( 6 ): 855 - 868 .

CADENA C , CARLONE L , CARRILLO H , et al . Past,present,and future of simultaneous localization and mapping:toward the robust-perception age [J ] . IEEE Transactions on Robotics , 2016 , 32 ( 6 ): 1309 - 1332 .

BRESSON G , ALSAYED Z , YU L , et al . Simultaneous localization and mapping:a survey of current trends in autonomous driving [J ] . IEEE Transactions on Intelligent Vehicles , 2017 , 2 ( 3 ): 194 - 220 .

YOUNES G , ASMAR D , SHAMMAS E , et al . Keyframe-based monocular SLAM:design,survey,and future directions [J ] . Robotics and Autonomous Systems , 2017 :S0921889017300647.

孟祥冰 , 王蓉 , 张梅 , 等 . 平行感知:ACP 理论在视觉SLAM 技术中的应用 [J ] . 指挥与控制学报 , 2017 , 3 ( 4 ): 350 - 358 .

MENG X B , WANG R , ZHANG M , et al . Parallel perception:an ACP-based approach to visual SLAM [J ] . Journal of Command and Control , 2017 , 3 ( 4 ): 350 - 358 .

LEE S , JANG C , MOON S , et al . Additive light field displays:realization of augmented reality with holographic optical elements [J ] . ACM Transactions on Graphics , 2016 , 35 ( 4 ): 1 - 13 .

DEBEVEC P , WENGER A , TCHOU C , et al . A lighting reproduction approach to live-action compositing [C ] // Proceedings of the 29th Conference on Computer Graphics and Interactive Techniques . New York:ACM Press , 2002 : 547 - 556 .

TIM H , JONATHAN C , CHRIS T , et al . Light stage 2.0 [C ] // SIGGRAPH Technical Sketches .[S.l.:s.n. ] , 2001 .

ALEXANDER O , ROGERS M , LAMBETH W , et al . Creating a photoreal digital actor:the digital Emily project [C ] // Proceedings of the 2010 Conference for Visual Media Production . Piscataway:IEEE Press , 2010 : 176 - 187 .

ALEXANDER O , ROGERS M , LAMBETH W , et al . The digital Emily project:achieving a photorealistic digital actor [J ] . IEEE Computer Graphics ＆ Applications , 2010 , 30 ( 4 ): 20 - 31 .

STEUER J . Defining virtual reality:dimensions determining telepresence [J ] . Journal of Communication , 1992 , 42 ( 4 ): 73 - 93 .

MILGRAM P , KISHINO F . A taxonomy of mixed reality visual displays [J ] . IEICE Transactions on Information and Systems , 1994 , 77 ( 12 ): 1321 - 1329 .

AZUMA R , BAILLOT Y , BEHRINGER R , et al . Recent advances in augmented reality [J ] . IEEE Computer Graphics and Applications , 2001 , 21 ( 6 ): 34 - 47 .

ZHANGA Z , GENGA Z , LIA T , et al . Integration of real-time 3D image acquisition and multiview 3D display [J ] . Proceedings of SPIE the International Society for Optical Engineering , 2014 : 8979 .

CAO X , GENG Z , LI T T . Dictionary-based light field acquisition using sparse camera array [J ] . Optics Express , 2014 , 22 ( 20 ): 24081 - 24095 .

PEI R J , GENG Z , ZHANG Z X . Subpixel multiplexing method for 3D lenticular display [J ] . Journal of Display Technology , 2016 , 12 ( 10 ): 1 .

PEI R J , GENG Z , MA K , et al . Three dimensional lenticular display synthetic image rendering based on light field acquisition [J ] . Journal of the Society for Information Display , 2017 , 25 ( 1-3 ): 117 - 125 .

WANG R , GENG Z , ZHANG Z X , et al . Visualization techniques for augmented reality in endoscopic surgery [C ] // International Conference on Medical Imaging and Augmented Reality . Berlin:Springer , 2016 .

WANG R , ZHANG M , MENG X B , et al . 3D tracking for augmented reality using combined region and dense cues in endoscopic surgery [J ] . IEEE Journal of Biomedical and Health Informatics , 2017 : 1540 - 1551 .

王飞跃 . 平行光场与平行光学,从光学计算实验到光学引导智能 [R ] . 2018 .

WANG F Y . Parallel light field and parallel optics,from optical computing experiment to optical guided intelligence [R ] . 2018 .

康孟珍 , 王秀娟 , 华净 , 等 . 平行农业:迈向智慧农业的智能技术 [J ] . 智能科学与技术学报 , 2019 , 1 ( 2 ): 107 - 117 .

KANG M Z , WANG X J , HUA J , et al . Parallel agriculture:intelligent technology toward smart agriculture [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 2 ): 107 - 117 .

吕宜生 , 陈圆圆 , 金峻臣 , 等 . 平行交通:虚实互动的智能交通管理与控制 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 21 - 33 .

LYU Y S , CHEN Y Y , JIN J C , et al . Parallel transportation:virtual-real interaction for intelligent traffic management and control [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 21 - 33 .

王飞跃 , 张梅 , 孟祥冰 , 等 . 平行手术:基于 ACP 的智能手术计算方法 [J ] . 模式识别与人工智能 , 2017 , 30 ( 11 ): 961 - 970 .

WANG F Y , ZHANG M , MENG X B , et al . Parallel surgery:an acp-based approach for intelligent operations , 2017 , 30 ( 11 ): 961 - 970 .

AGARWAL S , SNAVELY N , SIMON I , et al . Building romein a day [J ] . Communications of the ACM , 2011 , 54 ( 10 ): 105 - 112 .

GOODFELLOW I J , POUGET-ABADIE J , MIRZA M , et al . Generative adversarial networks [J ] . Advances in Neural Information Processing Systems , 2014 , 3 : 2672 - 2680 .

束越新 . 颜色光学基础理论 [M ] . 山东 : 山东科学技术出版社 , 1981 .

SHU Y X . Basic theory of color optics [M ] . Shandong : Shandong Science and Technology Press , 1981 .

WYSZECKI G , STILES W S . Color science [M ] . New York : Wiley , 1982 .

FAIRCHILD M D . Color appearance models [M ] . New York : Wiley , 2013 .

BERNS R S . Billmeyer and Saltzman’s principles of color technology [M ] . New York : Wiley , 2019 .

FINN C , ABBEEL P , LEVINE S . Model-agnostic meta-learning for fast adaptation of deep networks [J ] . arXiv preprint , 2017 ,arXiv:1703.03400.

RADFORD A , METZ L , CHINTALA S . Unsupervised representation learning with deep convolutional generative adversarial networks [J ] . Computer Science , 2015 .

ZHU J Y , PARK T , ISOLA P , et al . Unpaired image-to-image translation using cycle-consistent adversarial networks [C ] // Proceedings of the 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2242 - 2251 .

MITRA S , ACHARYA T . Gesture recognition:a survey [J ] . IEEE Transactions on Systems,Man,and Cybernetics,Part C , 2007 , 37 ( 3 ): 311 - 324 .

RAUTARAY S S , AGRAWAL A . Vision based hand gesture recognition for human computer interaction:a survey [J ] . Artificial Intelligence Review , 2015 , 43 ( 1 ): 1 - 54 .

LIU Y J , ZHANG J K , YAN W J , et al . A main directional mean optical flow feature for spontaneous micro-expression recognition [J ] . IEEE Transactions on Affective Computing , 2015 , 7 ( 4 ): 299 - 310 .

XU K , BA J , KIROS R , et al . Show,attend and tell:neural image caption generation with visual attention [J ] . Computer Science , 2015 : 2048 - 2057 .

POTAPOV D , DOUZE M , HARCHAOUI Z , et al . Category-specific video summarization [C ] // Proceedings of the 13th European Conference on Computer Vision . Berlin:Springer , 2014 : 540 - 555 .

李力 , 林懿伦 , 曹东璞 , 等 . 平行学习——机器学习的一个新型理论框架 [J ] . 自动化学报 , 2017 , 43 ( 1 ): 1 - 8 .

LI L , LIN Y L , CAO D P , et al . Parallel learning:a new framework for machine learning [J ] . Acta Automatica Sinica , 2017 , 43 ( 1 ): 1 - 8 .

LI X , WANG K F , TIAN Y L , et al . The paralleleye dataset:a large collection of virtual images for traffic vision research [J ] . IEEE Transactions on Intelligent Transportation Systems , 2018 , 20 ( 6 ): 2072 - 2084 .

浏览量

969

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

平行夏尔希里：生态资源智能管护及其可持续发展新途径

人机物CPSS智能融合的平行创作架构与关键技术研究

平行安全：基于CPSS的生成式对抗安全智能系统

平行艺术：人机协作的艺术创作

平行机器：一种智能机器的管理与控制框架