Recently, I am interested in the possibility of writing a plugin for AviUtl to achieve “Motion Tracking” like the one in After Effect.
Writing from scratch is impossible, so I am using the OpenCV2 library.
Since it is the first time I tried to write a full-fledged plugin, a lot of problem was encountered. So far, I managed to get the RGB image of any frame from AviUtl and feed it into OpenCV’s Mat object.
Both AviUtl and OpenCV have their unique ways handling coordinates and image, so it is quite hard to get them working together(esp. for first time).
If I get its core function working, I may release its source so that other people can improve on it. After all, many OpenCV examples are either too old(OpenCV v1.x) or too complicated and lacking sufficient comments.
(I am planning to use CamShift in the simplest sense, so do not expect the tracking work as well as commercial software.)