Is it normal for Algorithms to take a very long time to process in the que and then take even longer to go through the backtest on minute data?
I just upgraded my subscription a few days ago and thought it would help but it hasn't. It's very frustraiting to wait really long times to see simple changes to an algorithm. Reminds me back when I had a Tandy computer in the 80's!!!
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
If you check the Result dropdown and the queue is reporting zero(it usually is) then I suggest deleting and relaunching a backtest if it seems stuck in the queue/process stage.
The past couple days I have also seen this happen where a backtest will get stuck for a long time. I believed it was due to my oversized universe & heavy use of History or some init bug I had introduced. I've see this behavior on the public and dedicated QC cloud. Perhaps related to the History service?
Sometimes when I run a backtest, it will report the usual ram usage; for example let's say 2-4 over its backtest when charted. Then the exact same algo run again(just hit backtest again) will seem to mem leak and use 4-40+ gigs of ram after a slow startup. Could this odd behavior be related? I have seen this mem issue before the "stuck" issue appeared the past couple days.
Thanks Derek, Charles sorry about the issues. Demand has surged 300% in the last 3mo so we've had to reengineer our cloud architecture. We've come up with a nice scalable solution and it'll be live this week we hope. We're just waiting for the data to copy to the new architecture.
The new architecture will have reliable speeds (be predictable) but will be about 20% slower than current design when no one else is online. The reality is with 100-200 people online the current architecture starts to crawl so we hope the average speed will increase with the new design.
Also; due to limitations of the new cloud (AWS) we'll have RAM limits of 16/32gb max. We'll keep pondering the way around this especially as we want to support your case Derek.
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
Thanks Jared for the info!!
I have been spending a lot of time learning Quantconnect mostly because it connects with my broker and I hope to stay here! There have been lots of challenges so far for me and I might be able to look past that but the speed part added to waiting forever to find out there are erros sometimes, and then trying to figure out what the error could possibly be... is over the top. Looking forward to any changes that will help with the speed for sure.
100-200 people online sounds very small actually considering how rapidly the quant universe is growing, What would happen when you get into the thousands of users?
Does any of this affect live trading algorithms?
FYI my current algo I just tested ended up taking 625.44 seconds to deploy and hasn't even started to show trades yet. There are 129 users online.
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
When you say how much work you do on start, does that mean how much code goes in during the Initialize code?
If so - is it better to do more "work" in that code, or less for deploy speed?
Yes, that is what it means. For instance you could be adding a lot of securities and making History Data Requests to update indicators. In that case, it would be better to rely on SetWarmup.
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
To unlock posting to the community forums please complete at least 30% of Boot Camp.
You can
continue your Boot Camp training progress from the terminal. We
hope to see you in the community soon!
QuantConnect™ 2023. All Rights Reserved
|
Start New Discussion 
Back
Reward Discussion 
6
