Using machine learning in backtesting

Did you ever figure this out?

Sorry at this time it's not possible to save objects and retrieve those objects. It's a feature we've designed out and are almost done implementing but it is not ready quite yet sorry!

Thanks for quick reply! I'm new to QuantConnect -- is it possible to use train and use an ML algorithm within the standard algorithm framework versus the research framework? 

Yes, many people do this; training in warm-up etc and then running with the model in memory. The missing piece we're working on is saving that model so you don't need to run the training each time.

Can we actually save a trained model on an external source, for example a dropbox http url ?

You're right Adrien. May be you can store the Pickle serialization in dropbox and load it on backtest with self.Download method.

Hi Adrien, you cannot export the serialization to dropbox unless it is a tiny volume of data (less than 10kb). Exporting data isn't allowed sadly due to our data licensing agreements that make it possible to provide the data. 

We are working on a way to save and fetch objects; it'll be ready soon. 

Have there been any uppdates to this issue ? 

Hi Christian,

Sorry, for now it's not possible to save and retrieve trained ML models. However, QC supports a lot of Machine Learning libraries, including TensorFlow, Pytorch, Scikit-Learn, Keras and etc. All the supported libraries can be found in the whitelist.

Moreover, it is actually convenient and easy to train ML models and create ML algorithms in QC. Here is one example of how to build an algorithm using TensorFlow. Hope it is helpful for you!

I'm trying to do this in the algorithm section and having issues with reading in a CSV?  It shoud just be (using pandas):

Right?  I'm just trying to make the data/target arrays really.  I thought this would be the easy part!  It looks like it's timing out though.  Is there any functionality that isn't allowed here that i'm trying to use?

Stephen unless i am missunderstanding this tread, that is the case that we are discussing, that you cant load a csv file into your program that contains the trained algorithem. 

And if i am understanding the example from above Qilong Chen, you make use of the Nettrain, and the training happends via a lookvack of 30 days ? 

However in many ML examples, it is usfull to train your algo for several years, so the csv option that was eluded to earlyer in this thread would be usufull. 

parhaps a way around this is to shedual a function to only run once on start up, and usa a simmilar example as above with a longer lookback ? 

Christian,

You're completely correct - I overlooked a bit here... I missed the import and only saw the export portion!  Sorry abou that.

I do see the example and agree that I could create a training array on price.  But, with the warm up, won't I only be able to access the Symbol attribuites like they have here?  How can I build true data and target arrays?  I would be looking at price points at different times of the day, consolidated price points, volume, and may even want to put in the day of the week or month.  Do you know of a way to do this? 

Sorry - to respond to myself here.  I guess I'm not fully understanding the warmup and I can't seem to find it in the documentation tab anymore.  I thought it was in there.  If I call for self.SetWarmUp(time,resolution) in my initialization - does it just run that algo, basically, for the time I've set for the lookback time?  So, if I have scheduled events storing into a global data array, a volume grab, etc. and then maybe onData grabbing some things as events happen or however I need to get that array filled on a day to to basis.  As long as I set a SetWarmUp it should basically run that and build that array over that time?

Hello Stephen and Christian,

Thank you for your responses on the ML example I made.

Stephen, SetWarmUp() just runs the data from whatever period it is set to before the start date to warm up Indicators, but it doesn't perform any of the trading code and won't execute the scheduled events. Besides, you can find details in our documentation here.

Christian, if you want a longer training period, one way to do this is to increase the lookback days. Also, it's really exciting to see you consider option contracts to take the basic example to a new level. To import custom data, you can use download() method to import the data stored in dropbox. You might follow the pattern in this example.  

The example only serves as a start for you guys to explore more on ML algorithms. You are free to set different parameters and improve the algorithm in different ways. For example, you can change the resolution from daily to minute-level, weekly or monthly. Besides, you can put the trading logic in OnData() to get a flexible trading time instead of using Schedule.On().

Hope this help!

Thank you!  I'm not sure how I was missing the documentation there... 

I am receiving a RunTime error saying my time rules are not callable. Am I able to backtest my ML algorithms?

Thanks