performance - R read.table() extremely slow -
i have simple r code looks this:
for(b in 1:length(files)){ inputdaten[,b]<-read.table(files[b],header=false,dec=".",skip=12,sep = ",",colclasses=c("numeric")) } so read 1.39gb of files memory , process them. however, takes hr read. when watch memory space occupied increases every 10 minutes. lastly 2 minutes result in linear increment in memory space in dependence of time. why might be? can create faster?
edit 1inputdaten<-data.frame(c(1:15360),444) this how initialised inputdaten
i used fread now, result looks same. here screenshot of memory usage when started fread, memory usage doesn't increment @ while. (fread started approximately @ middle of timeframe)
http://pic-hoster.net/upload/57790/unbenannt.png
r performance input read.table
No comments:
Post a Comment