Tag Archives: map

Manufacturing Data Acquisition – Project splunk-demo-opcda

Manufacturing Data Acquisition – Project splunk-demo-opcda

Introduction In my previous blog article , I describe the practicality of collecting manufacturing data for Statistical Process Control (SPC) and Supervisory Control and Data Acquisition(SCADA) applications using Splunk. Manufacturing industries typically use OPC servers as a uniform platform to control and collect data in their production. In this […]

Configuring Hadoop with Guava MapSplitters

Configuring Hadoop with Guava MapSplitters

hadoop-logo In this post, we are going to provide a new twist on passing configuration parameters to a Hadoop Mapper via the Context object. Typically, we set configuration parameters as key/value pairs on the Context object when starting a map-reduce job. Then in the Mapper, we use the key(s) […]

The Uncertainty of Predictions

The Uncertainty of Predictions

Prediction vs. Confidence Intervals There are many kinds of intervals in statistics.  To name a few of the common intervals: confidence intervals, prediction intervals, credible intervals, and tolerance intervals. Each are useful and serve their own purpose. I’ve been recently working on a couple of projects that involve making […]

Why the Big in Big Data Is a Distraction

Why the Big in Big Data Is a Distraction

Analyzing exactly what you want to analyze The benefit of big data tools such as Hadoop and MapReduce is that they can help you pick data up and analyze it faster. Instead of taking days, it can take minutes. Of course, this is useful, but you have to take […]

Python + Hadoop: Real Python in Pig trunk

Python + Hadoop: Real Python in Pig trunk

For a long time, data scientists and engineers had to choose between leveraging the power of Hadoop and using Python’s amazing data science libraries (like NLTK, NumPy, and SciPy). It’s a painful decision, and one we thought should be eliminated. So about a year ago, we solved this problem […]

Designing Machine Learning Frameworks: Flexibility and Sound Design | Javalobby

Designing Machine Learning Frameworks: Flexibility and Sound Design | Javalobby

As a response to my last post , people mentioned mlbase to me as a potential candidate for bringing scalability and machine learning closer together. I took a closer look and wasn’t really that impressed. Don’t get me wrong, this is not a bad project, but it is still […]

BI vs. Big Data vs. Data Analytics by Example

BI vs. Big Data vs. Data Analytics by Example

I know that not everyone will agree with my definition of Business Intelligence, but my objective is to simplify things; there is enough confusion out there. Besides, who is the authority on an outdated terminology that doesn’t cover the entire spectrum of value that intelligent data can bring to […]

Full Metal Hadoop - Christian Prokopp | Big Data Republic

Full Metal Hadoop – Christian Prokopp | Big Data Republic

Initially do-it-yourself distributions like Cloudera, MapR, and Hortonworks made up a great part of the market. In recent years, following the success of Amazon Elastic MapReduce (EMR), Hadoop/data services like Qubole have become popular. Qubole in particular has highlighted advantages over EMR. (See my From Zero to Big Data […]

Tomorrow’s future is here today – HDP 2.0 Beta Sandbox

Tomorrow’s future is here today – HDP 2.0 Beta Sandbox

Albert Einstein is credited with saying that he doesn’t worry about the future because it would arrive soon enough. We don’t worry the future either — we focus on building it. And today, we are delighted to release the Hortonworks Data Platform 2.0 Beta Sandbox . This is the […]

Bigfoot, Beer & Buildings: Three Wacky Uses for Big Data

Bigfoot, Beer & Buildings: Three Wacky Uses for Big Data

Tracing the Evolution of Business Intelligence Through the Rise of Embedded Analytics Drop everything else you’re doing! Finally, someone is putting Big Data to work on one of the world’s greatest mysteries, at least since 1958 . I’m talking, of course, about Bigfoot—AKA, Sasquatch, Yahoo, Skookum, or the Stink […]