Machine Learning at Work

Machine Learning (ML), which is a subset of Artificial intelligence (AI), enhances the ability of a computer to learn, from data, without being explicitly programmed end-to-end. As ML and AI learn they acquire the ability to carry out cognitive functions, such as perceiving, learning, reasoning and automatically digging deeper to identify important insights or new novel discovery. With the advance in machine learning, in particular its Deep Learning (DL) subset, ML is rapidly spreading across sectors and will continue to do so at an even higher rate with the ever increasing growth of Big Data. Gartner predicts that companies will combine Big Data and Machine Learning to carry out some or most of their service processes by 40% in 2022, up from 5% in 2017.ML is used to accelerate data-driven discovery in research and development. Recently, it has enabled scientists to discover largely unknown diversity of viruses, amounting to thousands of previously unknown viruses. The book refers to previous as well recent research work, with colleagues, where ML was used to capture subtle variation and to discover rare items, such as rare genes which researchers have so long sought for in vain. Such processes to identify genes or medicine can be daunting, as it may take years and can be expensive and the outcome can be uncertain. ML is used today to shorten the time and even help to identify medicine that can be more effective for people with a particular gene, which will help in turn in personalized medicine. ML is a critical ingredient for intelligent applications and provides the opportunity to further accelerate discovery processes as well as enhancing decision making processes. These trends promise that every sector will be data-driven and will be using machine learning in the cloud to incorporate artificial intelligence applications and to ultimately supplement existing analytical and decision making tools. The book introduces ML and its potential along with some ML applications using Spark and R platforms combined. While Spark has the possibility to scale and speed up analytics, it harness R language