KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #ai-agents #developer-tools #typescript #codex #cli #claude-code #mcp #rust #deepseek-harness #ai-agent

ofxMIOFlowGLSL

★ 85 Open GitHub ↗

Optical Flow GPU Version - based upon Andrew Benson's solution

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

ofxMIOFlowGLSL
==============

Optical Flow GPU Version - based upon Andrew Benson's solution.
This is a simple GLSL based solution for calculating optical flow. The main benefit is to calculate the flow on GPU and then 
keep the results within a raw texture to forward it for further Shader based processing.

![Optical Flow](https://github.com/princemio/ofxMIOFlowGLSL/blob/master/opticalFlow.png)

Advantages
======================
It is possible to define Ping pong shaders with particles or complex objects in Geometry shader who are feeded by the flow texture.
Another advantage of this GPU solution is its speed. It is appropriate for detecting flow in Full HD images or on top of depth data.

Installation
======================
- copy the content of the zip file in your OF addon path. 
- link it in your project in additional header files.
- include the header
  
  include "ofxMIOFlowGLSL.h"

and you are ready to go.

HOW TO
======================
try the example file you will see that everything is pretty straight forward and doesnt require more then

1) setup(w,h) - to setup the context in (w)idth and (h)eight

2) update(myCamTexture) - your current texture

3) getFlowBlurTexture() - to access the texture of your optical flow

you can also simply preview your results by the use of drawReposition(0,0); 
Please refer to the example_Basic provided. There is anything you need plus the ability to see how adjustments lead
to different results

HOW TO USE IN SHADER
======================
The direction of the current flow per pixel is coded in each fragment color. If you pass the flow texture to the next 
shader then youll have to lookup the flow offset coordinates in 2d space just like that:

vec2 get2DOff(sampler2DRect tex ,vec2 coord) {
		vec4 col = texture2DRect(tex, coord);
		if (col.w >0.95)  col.z=col.z*-1;
		return vec2(-1*(col.y-col.x),col.z);
	}

the return 2 dimensional vector is your offset in 2d Space...play with it...

FUTURE WORK
======================
im going to try my best to add scene flow functionalities to the current algorithm. Hence it would be possible to detect
the flow of pointclouds in 3D Space. My current idea is to measure the depth values of the pixels in refernce to its 2d offset.
Hence it would be some kind of 2 1/2 scene flow ;). i do believe that this could be very easily achieved and very fast. If you
have alternative ideas - please let me know!

ENJOY

prince mio
New Media Dance

princemio.net

ofxMIOFlowGLSL

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README