3

1

I'm just starting to work on a relatively large dataset after ML course in Coursera. Trying to work on https://archive.ics.uci.edu/ml/datasets/YearPredictionMSD. Got an accuracy of 5.2 in training and test set with linear regression using gradient descent in octave.

I tried adding all possible quadratic features (515345 instances and 4275 features), but the code just won't stop executing in my HP Pavilion g6 2320tx, with 4GB RAM in Ubuntu 14.04.

Is this beyond the data size capacity of Octave ?

How many columns did you get after including the quadratic features? Was it 180? Also, what was the maximum memory usage without including the quadratic term? – Nitesh – 2014-11-07T04:52:37.700

I'm trying to add all possible quadratic features. That should give about 4275 features I think. Adding just the squared features works fine. That would be 180. btw how do we check the max memory usage ? – abhivij – 2014-11-07T05:08:12.373

see http://ubuntuforums.org/showthread.php?t=1161120

– Nitesh – 2014-11-07T05:55:48.770