Privacy and Big Data—Update on the Update

By: Mary Ludloff and Terence Craig

Privacy and Big DataWe’ve been promising an update to our book, Privacy and Big Data, since the just pre- and mostly post-Snowden era. When we proposed and wrote the book it was to fill a void. At the time, there was a lack of mainstream attention to the issues of privacy by the media and a lack of understanding of the issues and implications we all face in the digital world. As tech veterans of long standing, we have seen our world transformed for better and for worse by our industry. Much of the “worst” we chronicled in our book and at the time its release, many relegated our book and ourselves to the “foil hat” and “black helicopter” brigade.  Yes, that was a “we told you so” but we promise it’s the last one.

Then came the Snowden revelations which raised its own hailstorm of media attention, information, misinformation, and disinformation (primarily by our government officials, legislative leaders, and the President as well as the Prime Minister of the UK) on exactly how our data was being collected and what it was being used for. Cynics though we are, we wondered if digital privacy issues had finally reached a tipping point, that we would have a national conversation about civil liberties, how to fix FISA, what is the acceptable collection and use of our data by commercial and government entities, and moving forward, how our liberties and data could be protected from corporate and government spying. (more…)

December 10, 2014 at 5:02 pm Leave a comment

In a pii (Privacy, Identity, Innovation) Conference State of Mind

By Mary Ludloff

pii2014Although this year has been extremely busy for us, Terence and I always find time for this event: The Privacy Identity Innovation Conference.  Natalie Fonseca, the Co-Founder and Executive Producer of it, is the driving force behind its ongoing success. This year’s program focuses on:

“… the latest developments in areas like mobile, biometrics, the Internet of Things and big data. Learn about emerging trends and business models driving the personal information economy, and get guidance on developing strategies and best practices to build trust with your users.” (more…)

November 9, 2014 at 1:33 pm Leave a comment

Getting Value From Your Data Series: Who Is Your Target Customer?

target customer

By Mary Ludloff and Marilyn Craig

Welcome back to the second post in our series on how to get value from your data. As we stated in a previous post:

“Data, without the proper use of analytics, is meaningless. If data is the new oil, think of analytics as the oil drills—you need both to be successful.”

Of course, getting to “success” is not easy as anyone involved in an analytics project will tell you. This series walks you through our methodology on what it takes—from inception to proof of concept to implementation and deployment—to navigate project pitfalls. Now most of us have been involved with great analytics projects that answered no real need. In this post, we take a look at the customer, their pain points, and what benefits they may derive from your analytics project. In other words: Who is your target customer? (more…)

October 15, 2014 at 4:41 pm Leave a comment

Getting Value From Your Data Series: The Road May Be Rocky But It’s Well Worth the Effort!

roadwork

By Mary Ludloff and Marilyn Craig

Unless you’ve been asleep for the past couple of years, you, like us, have heard this phrase again and again:  Data is the new oil.  It certainly sounds great but what exactly does it mean? Here’s our take: Getting the most value out of your data can make you better at what you do as well as enable you to do more with what you have. In other words, there’s unrealized value in those data silos that all companies have. But make no mistake: the road to realizing data value is paved with good intentions and often times, poor execution and results.

oil drillsToday, most companies are drowning in data—there’s historical data from operations, data from public sources, data from partners and acquisitions, data you can purchase from data brokers, etc.  These companies have read all the research and want to leverage their data assets to make “better” operational decisions, to offer their existing customer base more insights, to pursue new revenue opportunities. Of course, the real value in that data is derived from the business analytics that deliver the insights that drive better decisions. As we’ve said quite often on this blog: Data, without the proper use of analytics, is meaningless. If data is the new oil, think of analytics as the oil drills—you need both to be successful. (more…)

September 30, 2014 at 4:06 pm Leave a comment

Lessons Learned from the Google Flu Tracker—Why We Need More Than Just Data

By Marilyn Craig and Mary Ludloff

God we trustWe read an interesting paper and post about Google Flu Trends (GFT) and its foibles last week. The paper points out a couple of lessons that those of us living in the big data analytics world have learned the hard way but the dangers are worth revisiting as tools like ours (AnalyticsPBI for Azure) begin to move big data analytics into the mainstream of organizational practices. After all, our tool (and others like it) makes it easy and even fun for analytics junkies to use all those available zettabytes of data and answer questions that they’ve long wondered about. But the paper also reminded us of the dangers of ignoring the natural cycles of an analytics process that we talked about in this recent post. If Google followed the PatternBuilders Analytics Methodology, they might have avoided many of the errors that GFT is now spitting out. In fact, the authors of the paper point out that:

“Although not widely reported until 2013, the new GFT has been persistently overestimating flu prevalence for a much longer time. GFT also missed by a very large margin in the 2011-2012 flu season and has missed high for 100 out of 108 weeks starting with August 2011… This pattern means that GFT overlooks considerable information that could be extracted by traditional statistical methods.”

This overestimation is attributed to two primary factors: data hubris and algorithm dynamics. (more…)

April 9, 2014 at 6:15 pm Leave a comment

Reporting, Analytics, and Big Data: A Continuous Feedback Loop to Drive Better Decision-Making

By Marilyn Craig

LoopA recent conversation with a client reminded me that no matter how crazy and exciting the Big Data world gets, it is still critical to understand what your goals are and where you are in the process of reaching those goals. Having a good foundation in “what’s important” is critical before you jump into the wild world of Big Analytics.

For example, in big data (well, actually all data but I digress) “Reporting” and “Analytics” are very different functions. But I often find our customers and prospects grappling with how to distinguish one from the other and as a result, confusing reporting with analysis and losing track of their real goals.

(more…)

March 2, 2014 at 3:07 pm 2 comments

New Year (2014) Rumination: Death of privacy as we know it? Or inflection point signaling better things to come?

By Mary Ludloff

Privacy DeadI am, and always have been, a glass half-full kind of gal. In fact, way back in September 2011 when Terence and I published our book on Privacy and Big Data, I was far more optimistic than he was on the future of privacy—of course, it’s easy to sound optimistic when your co-author states that privacy is dead. (And yes, we are still working on our book update but we do have day jobs and a significant release in the works so it is slow going but going it is.)

At that time, those in the “digital privacy know” characterized our book as a decent overview. Our intent at the time was to help those NOT in the “digital privacy know” get their arms around the privacy issues from a legislative, corporate, and government perspective. To our surprise, those not in the know included lots of folks in the high tech community! We did a number of interviews and dealt with informed and somewhat uninformed media folk—those in the mainstream focused on social media and those on the fringes (left and right) wanted to do deep dives into legal issues, government uses of data, and fourth amendment rights. Some seemed to think that we were members of the tin foil hat brigade, others that we were naïve, and still others that we were on point. (more…)

January 11, 2014 at 12:16 pm Leave a comment

Older Posts


Video: Big Data Made Easy

PatternBuilders Corporate

Follow us on Twitter

Special privacy section!

Enter your email address to subscribe.

Join 58 other followers

Recent Posts

Previous Posts


Follow

Get every new post delivered to your Inbox.

Join 58 other followers