unpack(C*,data) Eats Memory [php exhausting memory on unpack function] -

-

i want read binary file byte[] in php , suggested here unpack'ed fread's output . have like:

$file=fopen($filename,'r'); fseek($file, $offset);  //file 500mb take 10mb @ time $tmp = fread($file,$len); //so far , $tmp includes 10mb of data var_dump(strlen($tmp));    //int(10485760) 10mb var_dump(memory_get_usage(true)); //int(11272192) 11mb $data = unpack('c*',$tmp);

this throws 

php fatal error:  allowed memory size of 536870912 bytes exhausted (tried allocate 32 bytes) in [myfile.php] on line [unpack line]

as error suggests memory limit set @ 512mb , according memory_get_usage 11/512mb used , unpacking 10mb string . @ should need 30mb (10mb $tmp , 10mb $data , 10mb internal variables). why explode , can't unpack $tmp 512mb ram ?

so question is , doing wrong here or bug? , there other way array of bytes (0 255) read binary files in php or should switch language this?

additional notes : code works 117kb file.

php -v php 5.5.3-1ubuntu2.2 (cli) (built: feb 28 2014 20:06:05)  copyright (c) 1997-2013 php group zend engine v2.5.0, copyright (c) 1998-2013 zend technologies     zend opcache v7.0.3-dev, copyright (c) 1999-2013, zend technologies

in php variables stored internally zvals. each element in array take more memory expect. due php being weakly typed language , therefore requiring ability swap type of variable internally. there overhead of gc , fact array in php hash table.

you can find in-depth details here:

http://nikic.github.io/2011/12/12/how-big-are-php-arrays-really-hint-big.html

however, create array of 10485760 elements require approx. 760mb on 32bit , 1440mb on 64bit.

your best option not unpack string , instead when require element in array access position in string.

for example library use uses concept:

https://github.com/reiner-dolp/php-memory-efficient-arrays


Comments

Post a Comment

Popular posts from this blog

c# - Unity IoC Lifetime per HttpRequest for UserStore -

-
i'm trying clean default implementation of accountcontroller.cs comes out of box in new mvc5/owin security implementation. have modified constructor this: private usermanager<applicationuser> usermanager; public accountcontroller(usermanager<applicationuser> usermanager) { this.usermanager = usermanager; } also, have created lifetime manager unity looks this: public class httpcontextlifetimemanager<t> : lifetimemanager, idisposable { private httpcontextbase _context = null; public httpcontextlifetimemanager() { _context = new httpcontextwrapper(httpcontext.current); } public httpcontextlifetimemanager(httpcontextbase context) { if (context == null) throw new argumentnullexception("context"); _context = context; } public void dispose() { this.removevalue(); } public override object get...
Read more

Change the color of an oval at click in Java AWT -

-
i have draw ovals in java, , @ click change color. beginning tried change color after 20 ms, doesn't work. my code is: public class mycomponentnew extends frame { public graphics2d g2d; public mycomponentnew(string title) { super(title); setsize(400, 550); } @override public void paint(graphics g) { this.g2d = (graphics2d) g; this.g2d.setcolor(color.red); this.g2d.filloval(10, 55, 50, 100); } public void changecolor () { this.g2d.setcolor(color.blue); this.g2d.filloval(10, 55, 50, 100); } } and in class main method have: mycomponentnew m; m = new mycomponentnew("fereastra cu baloane"); m.setvisible(true); m.addwindowlistener(new windowadapter() { @override public void windowclosing(windowevent we) { system.exit(0); } }); try { thread.sleep(20); } catch(interruptedexception e) {} m.changecolor(); the color of oval remains red. ...
Read more

I am trying to solve the error message 'incompatible ranks 0 and 1 in assignment' in a fortran 95 program. -

-
i writing program in fortran find velocity of parachuting person in relation time. keep getting error can't fix. new programming , appreciated. the error is v(i+1)=v(i)+[32-((c*v(i)*v(i))/m)]*(h) 1 error: incompatible ranks 0 , 1 in assignment @ (1) and program is program para integer :: real :: v(11) !velocity real :: q !initial velocity real :: h !time step real :: c !drag coefficient real :: m !mass ! gravity equal 32 ft/s^2 write (*,*)'enter time step' read(*,*)h write(*,*)'enter initial velocity' read(*,*)q write(*,*)'enter drag coefficient' read(*,*)c write(*,*)'enter mass' read(*,*)m i=1,10 ! 1 10, 1 being interval. end v(i+1)=v(i)+[32-((c*v(i)*v(i))/m)]*(h) q=v(1) end program you cannot use [] normal parenthesis in expressions. array constructor, [ items ] means array items elements. end do should after line.
Read more