idea>> foveated-360-video>> 返回
项目作者： AugmentariumLab

项目描述 ：
Codebase for A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming
高级语言： C
项目地址: git://github.com/AugmentariumLab/foveated-360-video.git
创建时间： 2020-12-05T23:09:07Z
项目社区：https://github.com/AugmentariumLab/foveated-360-video
开源协议：MIT License
下载


Foveated 360 Video

Foveated 360 Video is a client-server system prototype for streaming 360° videos which leverages parallel algorithms over real-time video transcoding.
See https://augmentariumlab.github.io/foveated-360-video for the corresponding video, paper, and slides published in IEEE Virtual Reality 2021.

Requirements

  • Ubuntu 20.04 system with an NVIDIA GPU
  • OpenCL headers and NVIDIA drivers
  • C++ build tools including g++

Libraries

  • FFmpeg libraries (libavformat-dev, libavcodec-dev, libswscale-dev, …)
  • SDL
  • Boost
  • Eigen
  • zlib
  1. sudo apt install ocl-icd-opencl-dev opencl-headers opencl-c-headers opencl-clhpp-headers
  2. sudo apt install libavformat-dev libavcodec-dev libswscale-dev libavfilter-dev libavutil-dev libavresample-dev
  3. sudo apt install libsdl2-dev libglew-dev libglvnd-dev freeglut3-dev
  4. sudo apt install libboost-dev
  5. sudo apt install zlib1g-dev

Getting started

Download and extract the 1080p video dataset.

Install all prerequisites and run the following:

  • make clean
  • make all

Then the server can be started with:

  • ./driver.x

The client can be started with:

  • ./client_driver.x <server_addr>
  • For example, to run on localhost ./client_driver.x ws://localhost:9562

Source code layout

  • All source files are in the src folder.
  • The transformation functions are written in the OpenCL .cl files.
  • 1080p versions of benchmark videos are in the 1080p_videos folder.

Please refer to https://augmentariumlab.github.io/foveated-360-video for our paper published in IEEE VR 2021 (TVCG): “A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming”.

References

If you use this in your research, please reference it as:

  1. @article{Li2021LogRectilinear,
  2.   author={Li, David and Du, Ruofei and Babu, Adharsh and Brumar, Camelia D. and Varshney, Amitabh},
  3.   journal={IEEE Transactions on Visualization and Computer Graphics},
  4.   title={A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming},
  5.   year={2021},
  6.   volume={27},
  7.   number={5},
  8.   pages={2638-2647},
  9.   doi={10.1109/TVCG.2021.3067762}
  10. }

or

  1. David Li, Ruofei Du, Adharsh Babu, Camelia Brumar, and Amitabh Varshney. 2021. A Log-Rectilinear Transformation for Foveated 360-Degree Video Streaming. IEEE Transactions on Visualization and Computer Graphics, 27(5), 2638-2647. DOI: <https://doi.org/10.1109/TVCG.2021.3067762>