Thursday, 15 August 2013

performance - R read.table() extremely slow -



performance - R read.table() extremely slow -

i have simple r code looks this:

for(b in 1:length(files)){ inputdaten[,b]<-read.table(files[b],header=false,dec=".",skip=12,sep = ",",colclasses=c("numeric")) }

so read 1.39gb of files memory , process them. however, takes hr read. when watch memory space occupied increases every 10 minutes. lastly 2 minutes result in linear increment in memory space in dependence of time. why might be? can create faster?

edit 1 inputdaten<-data.frame(c(1:15360),444)

this how initialised inputdaten

i used fread now, result looks same. here screenshot of memory usage when started fread, memory usage doesn't increment @ while. (fread started approximately @ middle of timeframe)

http://pic-hoster.net/upload/57790/unbenannt.png

r performance input read.table

No comments:

Post a Comment