ios - Efficient use of Core Image with AV Foundation -

-

i'm writing ios app applies filters existing video files , outputs results new ones. initially, tried using brad larson's nice framework, gpuimage. although able output filtered video files without effort, output wasn't perfect: videos proper length, frames missing, , others duplicated (see issue 1501 more info). plan learn more opengl es can better investigate dropped/skipped frames issue. however, in meantime, i'm exploring other options rendering video files.

i'm familiar core image, decided leverage in alternative video-filtering solution. within block passed avassetwriterinput requestmediadatawhenreadyonqueue:usingblock:, filter , output each frame of input video file so:

cmsamplebufferref samplebuffer = [self.assetreadervideooutput copynextsamplebuffer]; if (samplebuffer != null) {     cmtime presentationtimestamp = cmsamplebuffergetoutputpresentationtimestamp(samplebuffer);      cvpixelbufferref inputpixelbuffer = cmsamplebuffergetimagebuffer(samplebuffer);     ciimage* frame = [ciimage imagewithcvpixelbuffer:inputpixelbuffer];     // cifilter created outside "isreadyformoremediadata" loop     [screenblend setvalue:frame forkey:kciinputimagekey];      cvpixelbufferref outputpixelbuffer;     cvreturn result = cvpixelbufferpoolcreatepixelbuffer(null, assetwriterinputpixelbufferadaptor.pixelbufferpool, &outputpixelbuffer);      // verify everything's gonna ok     nsassert(result == kcvreturnsuccess, @"cvpixelbufferpoolcreatepixelbuffer failed error code");     nsassert(cvpixelbuffergetpixelformattype(outputpixelbuffer) == kcvpixelformattype_32bgra, @"wrong pixel format");      [self.coreimagecontext render:screenblend.outputimage tocvpixelbuffer:outputpixelbuffer];     bool success = [assetwriterinputpixelbufferadaptor appendpixelbuffer:outputpixelbuffer withpresentationtime:presentationtimestamp];     cvpixelbufferrelease(outputpixelbuffer);     cfrelease(samplebuffer);     samplebuffer = null;     completedorfailed = !success; }

this works well: rendering seems reasonably fast, , resulting video file doesn't have missing or duplicated frames. however, i'm not confident code efficient be. specifically, questions are

  1. does approach allow device keep frame data on gpu, or there methods (e.g. imagewithcvpixelbuffer: or render:tocvpixelbuffer:) prematurely copy pixels cpu?
  2. would more efficient use cicontext's drawimage:inrect:fromrect: draw opengles context?
  3. if answer #2 yes, what's proper way pipe results of drawimage:inrect:fromrect: cvpixelbufferref can appended output video file?

i've searched example of how use cicontext drawimage:inrect:fromrect: render filtered video frames, haven't found any. notably, source gpuimagemoviewriter similar, since a) don't understand yet, , b) it's not working quite right use case, i'm wary of copying solution.


Comments

Post a Comment

Popular posts from this blog

Change the color of an oval at click in Java AWT -

-
i have draw ovals in java, , @ click change color. beginning tried change color after 20 ms, doesn't work. my code is: public class mycomponentnew extends frame { public graphics2d g2d; public mycomponentnew(string title) { super(title); setsize(400, 550); } @override public void paint(graphics g) { this.g2d = (graphics2d) g; this.g2d.setcolor(color.red); this.g2d.filloval(10, 55, 50, 100); } public void changecolor () { this.g2d.setcolor(color.blue); this.g2d.filloval(10, 55, 50, 100); } } and in class main method have: mycomponentnew m; m = new mycomponentnew("fereastra cu baloane"); m.setvisible(true); m.addwindowlistener(new windowadapter() { @override public void windowclosing(windowevent we) { system.exit(0); } }); try { thread.sleep(20); } catch(interruptedexception e) {} m.changecolor(); the color of oval remains red. ...
Read more

c# - Unity IoC Lifetime per HttpRequest for UserStore -

-
i'm trying clean default implementation of accountcontroller.cs comes out of box in new mvc5/owin security implementation. have modified constructor this: private usermanager<applicationuser> usermanager; public accountcontroller(usermanager<applicationuser> usermanager) { this.usermanager = usermanager; } also, have created lifetime manager unity looks this: public class httpcontextlifetimemanager<t> : lifetimemanager, idisposable { private httpcontextbase _context = null; public httpcontextlifetimemanager() { _context = new httpcontextwrapper(httpcontext.current); } public httpcontextlifetimemanager(httpcontextbase context) { if (context == null) throw new argumentnullexception("context"); _context = context; } public void dispose() { this.removevalue(); } public override object get...
Read more

I am trying to solve the error message 'incompatible ranks 0 and 1 in assignment' in a fortran 95 program. -

-
i writing program in fortran find velocity of parachuting person in relation time. keep getting error can't fix. new programming , appreciated. the error is v(i+1)=v(i)+[32-((c*v(i)*v(i))/m)]*(h) 1 error: incompatible ranks 0 , 1 in assignment @ (1) and program is program para integer :: real :: v(11) !velocity real :: q !initial velocity real :: h !time step real :: c !drag coefficient real :: m !mass ! gravity equal 32 ft/s^2 write (*,*)'enter time step' read(*,*)h write(*,*)'enter initial velocity' read(*,*)q write(*,*)'enter drag coefficient' read(*,*)c write(*,*)'enter mass' read(*,*)m i=1,10 ! 1 10, 1 being interval. end v(i+1)=v(i)+[32-((c*v(i)*v(i))/m)]*(h) q=v(1) end program you cannot use [] normal parenthesis in expressions. array constructor, [ items ] means array items elements. end do should after line.
Read more