libyami NEWS -- summary of changes. 2018-09-19
Copyright (c) 2010, The WebM Project authors.
Copyright (C) 2011-2018 Intel Corporation
Copyright (C) 2015-2016 Alibaba
libyami 1.3.1(API:0.6.0) release, work with libva 2.2.1.pre1 release
=====================
Major improvements:
+af43e95 h264dec: fix low lantecy mode
+160286a Add flags for SDL signoff called SDL325 - Compile With Defenses Enabled
+727db97 common: add RGB 10 bits support
+46c15b1 common: add RGB565 support
+946b7ac common: add XRGB, ARGB, XBGR, ABGR support
+9e1fc1d android: re-enable android build
+3745982 yamivpp: add rotation function for vpp
libyami 1.2.0(API:0.5.0) release, work with libva 1.8.1 release
=====================
Major improvements:
+180c3d5 improve vp9 10 bit decoder conformance
+8d29d2d improve h265 8/10 bit decoder conformance
+5b09484 add decoder/display zero-copy API.
+e46f03b use decoder/display zero copy API in v4l2 decoder
+441ee54 expose vp9 qp setting to the user.
We change API to from 0.4.0 to 0.5.0 for following interface changes.
+1fe162e get/set surface in SurfaceAllocParams
+7560ce7 add VIDEO_DATA_MEMORY_TYPE_EXTERNAL_DMA_BUF
libyami 1.1.0(API:0.4.0) release, work with libva 1.7.3 release
=====================
We add following major features:
+c8299ca add h265 10 bits decoder
+ea3bc34 add vp9 10 bits decoder
+c7364f0 add h265 10 bits encoder
+3daae20 add Hue, Saturation, Brightness and Contrast to vpp
+0c8299c fix memory leak issue in v4l2
+71ec018 fix h264 baseline encoder fail issue
+d39104d fix h264/h265 encoder generate invalid frame for long GOP
-h265,vp9 10 bits conformance pass rate is not high.
We change API from 0.3.2 to 0.4.0 since following interface change
+7c6050b add enablePrefixNalUnit to h264 encoder
+3daae20 add Hue, Saturation, Brightness and Contrast to vpp
+c7364f0 add h265 10 bits encoder
libyami 1.0.1(API:0.3.2) release, work with libva 1.7.3 release
=====================
This release mainly for SVC-T CBR support.We add following features:
+0a241d2 add h264 SVC-T CBR support. This need libva 1.7.3.
+77ba612 fix h264/h265 nalread issue in 32 bits arch
+2c1fcf3 h264parser: change luma_weight_lx from int8_t to int16_t to avoid overflow
+e2a9e07 vp8parser: fix one decoder conformance issue.
+fb83012 make yocto buildable
+518088e add wireframe function to ocl filters
+other small issues.
We change API from 0.3.0 to 0.3.2 since following interface change
+518088e add wireframe function to ocl filters
+0a241d2 add h264 SVC-T CBR support.
libyami 1.0.0(API:0.3.0) release, work with libva 2016Q3 release
=====================
We add following major features:
+ 7423a97 add vp9 encoder
+ f6f1483 add sharpening, denoise, deinterlace for vpp
+ 366d909 add support for 422H, 422V and 444P
+ 2d4a536 add wayland support to v4l2decoder
+ 784ea0f improve h264 encoder speed for memory limited system
+ e57989f improve mpeg2 pass rate from 70% to 100%
+ 112b921 improve vc1 pass rate from 70% to 92%
+ 7f2e032 add profile setting for h264encoder
+ some more encoder setting for h264 and h265
+ more bugs fix and features please refer to git log
- convert odd resolution from NV12 to I420 will make output yuv twisted
- some unittest will failed.
We change API from 0.2.0 to 0.3.0 since following interface change
9f45ee7 add vp9 encoder
765cb6d add single header Yami.h/YamiC.h for user to include
99b85bc map tr1 name space to std name space
ea0b5fd add SVC-T support for h264 CQP mode
366d909 add support for jpeg 422H, 422V and 444P
2d4a536 add wayland support to v4l2decoder
1b53e29 deleted some unused encoder API
3147d36 enc264: implement I/P/B QP setting on CQP mode
f6f1483 vpp: add denoise,sharpening and deinterlace
libyami 0.4.0 release, work with libva 2016Q2 release
=====================
We relicensed entire project from LGPL to Apache V2
+add mpeg2 decoder
+add vc1 decoder
+merge all so to single libyami.so
-mpeg2/vc1 pass conformance rate is 70%
fix patch should ready in near future.
libyami 0.3.1 release, work with libva 2015Q4 release
=====================
+b frame for h264 encoder
+CBR for h265 encoder
+yamitransocde application, it will do zero copy transcode, much faster than yamiencode
+fix static library link issue
+fix various issue in vaapidisplay, vp8dec, h264enc, h265enc, factory
-transocde application will use default configuration, it did not use user set one.
-if you use latest ffmpeg, vp9 decoder will failed for some clips.mentioned in #347.
it's not core library's issue. It's a yamidecode's issue.
You can use ffmpeg 2.6 as workaround.
libyami 0.3.0 release, work with libva 2015Q3 release
=====================
+h265 decoder
+h265 encoder
+new mode -2 for yamidecode, it will output per frame md5 for decoded yuv
+some bug fix for vp8,vp9,h264 conformance.
+simplify configure.ac
libyami 0.2.5 release, work with libva 2015Q2 release
=====================
+update codec parser to latest version
+fix all compile warnings.
+add CBR for h264 and vp8 encoder.
+add "SharedPtr<VideoFrame> getOutput()" to decoder
+fix one loop filter issue in vp8dec
+1 bug in NativeDisplayDrm
+handle annexb format codec data in h264 decoder
+one “deref NULL” bug in v4l2 encoder.
+self-register enc/dec/vpp with their factories.
+add a simple player to demo decoder api usage(200 lines)
+add grid application to demo MxN ways decode + dipslay
+select driver name base on decoder profile
libyami 0.2.4 release
=====================
+add vpp interface for c++
+fix momory leak, uinitilized variable and invalid read reported by valgrind
+3 bug fix for vp8 encoder.
+.gitignore file
+ update correct profile name for vp9 since libva updated.
+fix "resolution changed in v4l2 egl mode makes yami crash" issue
-decode output dump can't gusss output fourcc from file extension
libyami 0.2.3 release
=====================
+add VIDIOC_G_CROP to io ctrl
+fix one ImagePtr leak issue, since ImagePtr hold DisplayPtr, it also leak VaapiDisplay
libyami 0.2.2 release
=====================
features update
---------------
+fix one include issue in capi header
+3 fixes for vp9 decoder and parser
+use cabac as default entropy mode for h264 encoder
+fix servral issues when we use v4l2 decoder in gles mode
libyami 0.2.1 release
=====================
the main target of this release is bug fix, especially the busy waiting issue.
features update
---------------
+fix one busy waiting bug in v4l2decoder.
-It will drain out cpu resource even we pause the video.
+4 patches apply to fix vp9 conformance test.
+add fakedec, it's good start for performance measure.
+fix random crash bug when we use "yamidecoder -m -1"
libyami 0.2.0 release
=====================
features update
---------------
+ add VP9 decoder
+ add VP8 encoder
+ add JPEG encoder
+ add Demux support leverage libavformat,: --enable-avformat
- yamidecode runs ok when there is no xwindow rendering (-m -1/0)
- v4l2decode is ok when there is with or w/o rendering
- support libvaformat from the version installed in Ubuntu13.10
- known issue: when there is video rendering, yamidecode blocks at
XGetWindowAttributes() after libva dlopen(i965_drv).
Add XInitThreads() make things worse. It is strange.
+ Fps update for "-m -1", we get stable performance data now
+ V4l2 fixes: seek, unconditionally stop
+ enable FFmpeg to use libyami for h264 decoding, create example player to
demonstrate it, especially on rendering video as texture through dma_buf
https://github.com/01org/player-ffmpeg-yami
known issues
---------------
- for avformat support in yamidecode, when there is video rendering,
yamidecode blocks at XGetWindowAttributes() after libva dlopen(i965_drv).
Add XInitThreads() make things worse. It is strange.
v4l2decode doesn't have such issue. (yamidecode is one thread application)
thoughts on libyami (media framework and window system support)
--------------------------------------------------
these points are not our priority yet.
+ Wayland support
We did a lot to support Wayland before:
- add Wayland platform support in libva and driver, does hack to
copy wayland-drm protocol from mesa/egl
- add Wayland platform in middleware, gstreamer-vaapi for example
the detects are:
- so far, only plain rendering is supported: wl_surface_attach/wl_surface_damage;
texture video rendering is still a gap
- the shared wl_display/wl_window/wl_event_queue are complex and problematic
it should be much easier with dma_buf.
We neend't do anything special for native window system in either vaapi driver or
codec library. with dma_buf handle exported, application can draw the video
frame (dma_buf) by EGL/GLES, EGL handle native window system automatically(including
wrap it into a wl_buffer internally).
+ GStreamer support
We usually do a lot on hw video buffer sharing in GStreamer, hw video buffer are
platform dependent, but the framework requires to wrap them in a generic way. we do
a lot in decoder to wrap a platform dependent handle into a subclass of base
video buffer, then unwrap it in video sink. and tries best to hide hw detail when
a sw component request to access the frame data.
it becomes simple when hw codec support dma_buf, since dma_buf is Linux generic.
it is possible that hw video become not the 2nd class citizen any more. we don't
need additional wrapper in decoder side, and we don't need a special video sink
for each hw video type.
+ dma_buf rendering for legacy support
in the above ideas, we usually consider EGL/GLES rendering context, how about
legacy usage? it is simple as well.
DRI3 protocol support dma_buf, it means a dma_buf handle can be sent to server
for window update. Keith said mesa is using it, and on server side glamor handle
the dma_buf. the remaining gap is that YUV buffer hasn't been supported yet, but
not hard to add it.
libyami 0.1.4 release
=====================
features update
---------------
- Additional fixes(most are thread race condition) for v4l2 wrapper (egl/gles)
- Add glx support in v4l2 wrapper
- Basic transcoding support: encoder test accepts input data from decoder output
- Testscript is added, it supports one-run-for-all: with a folder including h264/vp8/jpeg/raw-ref,
we can test them in one run. It serves as BAT (basic acceptance test) for pull request merge.
- Report fps in decode test, support decoding only test (skip rendering)
- Vp8/jpeg are supported in v4l2 decoder as well
- Decode test can be built/run without X11
- Code refinement for decoder test output and encoder classes
- dma_buf fixes, when video frame is exported as dma_buf, it renders well as texture
- with additional patch for chrome:
V4L2VDA/V4L2VEA pass chrome video unit test
video playback in browser draft ok
- for v4l2 wrapper, see: https://github.com/halleyzhao/yami-share/blob/master/Yami_V4L2_wrapper_for_Chrome.pdf
known issues
---------------
- this release is fully tested by validation team
- some jpeg file similarity <0.99 (~0.98) after decoding
https://github.com/01org/libyami/issues/108
future release plan:
====================
Dec: v0.2
jpeg encoder
vp9 decoder
vp8 encoder (depends on driver availability)
initial ffmpeg support
Feb'15: v0.3
unified input/output buffer of yami
transcoding support with unified input/output buffer
camera dma_buf support, camera with jpeg input
use yami in ffmpeg for hw codec
Future:
h265 decoder
Libyami 0.1 release note
===========================
Libyami is core video library to accelerate decoding/encoding based on libva.
Libyami can be treated as development kit for VAAPI. It is developed by C++ language, with simple/efficient APIs, without external dependencies.
libyami targets two type of usage:
- Hardware accelerated codec is the major gap (there is existing media framework ), for example: Chromeos/Android, maybe ffmpeg.
- Usage is simple enough that codec is the major interest, for example: remote desktop client/server, video surveillance.
So far H.264 decode/encode, VP8 and JPEG decode are supported. VP8/JPEG encode support is under development.
There are rich tests/examples in yami for a try. The tests can run without Window system (X11/Wayland etc),
some modes of video output are supported: including raw data dump and some modes of texture (TFP, drm flink name, dma_buf).
More details see: https://github.com/01org/libyami/wiki
Known issues:
some jpeg file similarity <0.99 (~0.98) after decoding
https://github.com/01org/libyami/issues/108
playback performance through gst-omx is not good:
https://github.com/01org/libyami/issues/34
Encodeing quality through gst-omx is not good:
https://github.com/01org/libyami/issues/36
legacy codec: mpeg2 decoder/encoder, vc1 decoder, mpeg4/h263 decoder/encoder