Originally posted on Tek-Tips forums by Zen here
I went to two meetups at H2O , which provides an open source predictive analytics platform. The second meetup was full of participants because its theme was an introduction to data science.
Data science is a new buzzword, and I feel like everyone claims to be a data scientist or something relating to that these days. But other than real data scientists, very few people really understand what a data scientist is or does. Bits and pieces of information are available, but it takes a basic understanding of the subject to exploit such fragmented information. Once you are up to a certain altitude, a series of blogs by Ricky Ho are very informative.
But first things first. There were three speakers at that meetup, but I’ll only elaborate on the first one, who described data science for laymen. The speaker was Dr. Erin LeDell , whose presentation title was Data Science for Non-Data Scientists.
In the following summary of her points, I stay at a bare-bones level so that a total amateur can grasp what data science is all about. Once you get it, I think you can reference other materials for more details. Her presentations and others are available here . The presentation was also videorecorded and is available here .
At the beginning, she introduced three Stanford professors who work closely with H2O:
The first two professors publish many books, but LeDell mentioned
that two ebooks on very relevant subjects are available free of charge.
You can download the books below:
###Data science process
LeDell gave a high-level view of the data science process:
A simple explanation of each step is given here, in my words.
This is a question asked by many non–data scientists. I have seen it many times, along with many answers. LeDell answered: mathematics and statistics, programming and database, communication and visualization, and domain knowledge and soft skills.
Drew Conway ‘s answer is well known. Actually, the second speaker referred to it.
This diagram is availablehere.
LeDell classified machine learning into three categories: regression, classification , and clustering .
These algorithms are well known and documented. In most cases, a data scientist uses an existing algorithm rather than developing one.
LeDell introduced two more technologies: deep and ensemble learning.
Deep learning is described as:
“A branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using model architectures, composed of multiple non-linear transformations.” (Wikipedia, 2015)
In ensemble learning, multiple learning algorithms obtain better predictive performance with the penalty of computation time. More details are here .
Finally, LeDell gave the following information for more details on the subject.
I skipped some of her discussion here, but I hope this is a good start to understanding what data science is, and that you will dig further into it.
Seasoned research and technology executive with various functional expertise, including roles in analyst, writer, CTO, VP Engineering, general management, sales, and marketing in diverse high-tech and cleantech industry segments, including software, mobile embedded systems, Web technologies, and networking. Current focus and expertise are in the area of the IT application to energy, such as smart grid, green IT, building/data center energy efficiency, and cloud computing.