Posts filed under ‘PatternBuilders Technology’

It’s About Time: Series Data, Streaming, & Architecture

 

In previous posts, we have talked a lot about the PatternBuilders Analytics platform and streaming analytics. This platform is able to scale for huge amounts of data and stream results to the user as they are processed in real time. As mentioned before, we can do this because we have focused on time series analytics, making optimizations to our architecture that beat generalized MapReduce types of solutions by orders of magnitude. I’d like to discuss this focus and how it came about.

Why time series data?

Time series data is ubiquitous. It’s actually more difficult to think of an analytics question a user would be interested in that doesn’t involve time in some capacity. Even a non-numeric query like “Order the list of products by units sold” is almost useless without specifying a time period for which to sort. (more…)

July 14, 2011 at 6:20 pm 7 comments

Speaking at MongoSF Conference: Building a Streaming Analytics System with Mongo

By Terence Craig

I am excited to announce that I will be speaking at MongoSF 2011 with my fellow data wrangler, Tim.  Our talk will cover how we used Mongo to build the PatternBuilders Analytics Framework. The official title for our talk is: Building a Streaming Analytics System with Mongo.

In a previous post, I talked about the impact our Social Media Analytics solution had on our deployment choices. Briefly, we wanted to make a beta version of our solution publicly available on the web and to do that, we needed to ensure sufficient capacity.  Since we did not want to make a massive investment in the infrastructure to support it, we investigated the state of cloud servers. Long story short, as part of our move from our colo to the cloud we made a significant change in architecture, fully embraced some of MongoDB’s more advanced capabilities, and created a radically improved product – although the previous version was pretty cool too! (more…)

May 16, 2011 at 7:14 pm 5 comments

To Cloud Or Not To Cloud

By Terence Craig

When we started PatternBuilders, we made what was then an unusual decision: to avoid multi-tenancy as I talked about here.  However, we also decided to avoid the cloud because we wanted to have predictable costs and felt that given the high level of expertise we had internally with managing data centers, we would be better off investing in top tier colocation facilities. This made a lot sense given the security sensitivities of our initial target markets: internal IT at the Fortune 500, large retail suppliers, and hospital groups.  It was also an economically viable choice because our business model provisions hardware and bandwidth for each customer after the sale to manage cash flow.  We also knew that we would be able to reduce both the cost and maintenance headaches of separate customer provisioning by aggressive use of virtualization technology, much like the cloud server vendors Rackspace, Amazon, and others do today.
(more…)

April 25, 2011 at 7:12 am 6 comments

PatternBuilders Analytic Framework (PAF) Correlation Video

Terence’s last post was about correlation – a powerful tool that requires an easy-to-use UI to be effective along with some serious number crunching backing it up. I made a quick demo of our recently upgraded “insight discovery” interface showing off how to analyze correlations with the PAF. Click below to watch. Let us know what you think of it.

New Insight Discovery Interface

March 3, 2011 at 3:02 pm 3 comments

A Deep Dive Into PatternBuilders Analytics Framework (PAF)

Today one of our Server Engineers is going to give you a deep dive on our architecture.  As always on our blog, all of the data is simulated and all trademarks are the property of their respective owners.

Hello everyone! I am going to get fairly technical in this post and go over how PatternBuilders Analytics Framework (PAF) does what it does so well. As Terence has said in the past couple of posts, we have a new architecture that’s based around scalability, streaming, and ease of use. That’s not quite the whole story though; the development of this architecture was in fact driven primarily by performance. (more…)

February 2, 2011 at 1:30 pm 6 comments

The Perfect Fit for Analytics

By Terence Craig

In my last post, I gave an overview of the difference between batch and streaming analytics approaches.  It was a very popular post and was mentioned on the excellent MyNOSQL blog whichwas really appreciated.  Their able proprietor, Alex Popescu, had the following comment:

“I cannot put my finger on it right now, but I don’t think stream processing can cover exactly the same wide range of computations available in batch processing:

While I haven’t had the chance to play with real big data, I believe it is not a matter of either or. An ideal system would need to support:

  • piping incoming data through a combination of filters, preprocessors/transformers, and calculators/extractors
  • preserve (all/relevant) data for later computation
  • allow processing of stored data in either streams or batches“

(more…)

January 31, 2011 at 3:02 pm 2 comments

Riding the Data Waterfall

Our new streaming analytics engine.

By Terence Craig

As promised, I am going to spend the next few posts discussing some of the new features in our analytics framework, otherwise known as PAF.  This is our largest and most complex release so far.  We are very proud of it—both in how far the framework has come and how closely it matches our vision of what a world class analytics system would look like when we started the company a few years ago.

One of my favorite features, and certainly the biggest change in this release, is that our analytics engine is now completely streaming based.  I think that this, along with our improved ad-hoc analysis support, is going to improve our customers’ day-to-day to experience with both calculating and using analytics in their businesses.    (more…)

January 26, 2011 at 6:01 pm 11 comments

Older Posts Newer Posts


Video: Big Data Made Easy

PatternBuilders Corporate

Special privacy section!

Previous Posts


%d bloggers like this: