I've been reading about Apache Spark recently - and especially the MLib module seems to be a very attractive tool for anyone interested in machine learning. How would you guys rate the overlap here? Obviously QC is based on the same paradigm, in that it is distributed and lives in the cloud. But in regards to machine learning specifically I wanted to get a sense as to whether there is a lot of overlap and/or if Spark could be leveraged via QC.
Apache Spark
Back
0
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
NOBODY here has any opinion on machine learning libs?? :-))
0
Hi Micheal,
We are very interested in machine learning libraries!
Currently, we support AForge.NET and Accord.NET.
Marco Espirulina has posted a fuzzy logic/inference example using AForge.Fuzzy in this thread: Fuzzy Logic Algorithm example.
From what I read about Spark MLlib is natively only supports Java, Scala, Python, and R. However Microsoft is developping C# language binding and extensions to Apache Spark called Mobius. We may look into Spark in the future.
0
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
Hello Alexandre - thanks for the update. Yes, Spark supports Java, Scala, and of course Python. Wasn't Python on the map for QC? Anyway, writing C# bridges/interfaces for the Java libs would be relatively trivial. I didn't know about Mobius and that's really good news!
Anyway, I strongly recommend you consider supporting it as it is quickly becoming the #1 big data framework. Here's a pertinent article on KDnuggets you may enjoy.
0
0
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
Loading...
To unlock posting to the community forums please complete at least 30% of Boot Camp.
You can
continue your Boot Camp training progress from the
terminal. We hope to see you in the community soon!
Send an award to
+
+
Choose a Credit Pack
QuantConnect Credit (QCC) can be applied to your cloud-invoices or gifted to others in the community with Community Awards in recognition of their contributions. Community Awards highlight the awesome work your fellow community members are doing and inspires high quality algorithm contributions to the community. Select an option below to add QuantConnect Credit to your account:
$5
500 Credit Points
$10
1,000 Credit Points
$18
2,000 Credit Points
10% bonus
$45
5,000 Credit Points
10% bonus
Billing Summary
| Credit Pack |
| Total |
