Data, data everywhere

Data, data everywhere” is the title of a survey in the Feb 25 issue of The Economist. The survey starts with the subhead “Information has gone from scarce to superabundant. That brings huge new benefits […] but also big headaches.”

I love it; Sigma loves it. These benefits and headaches drive innovation in the startup world which play to our strengths. Several of the Sigma team, myself included, have deep technical, sales or operating backgrounds working with database and data management technologies. The trends described wonderfully in The Economist’s survey are fuelling a surge in related startups, and we are seeing many of them as they seek funding. We even invest in a few of them.

This surge in data, in data management and analysis tools is changing our lives. Mostly this is in mundane ways, but we still live at the start of the era where all this data is available to us wherever we are … anyone who has done a Google search from their phone over a dinner table conversation (and has thought wryly to themselves “my how things have changed”) is a beneficiary. The dangers and headaches are also the subject of good writing in The Economist and elsewhere, but there is no stopping this tide.

Mastery of statistics, data analysis, data visualization and knowledge distillation are skills that already underpin large parts of our economy. This will only increase. If you are not familiar with these trends, go back to the top, click on that Economist link, and enjoy the read. (Oh, I’ll make it easy … here it is again).


dave broadwin said...

Data does not seem glamorous, but big data and business intelligence start-ups have done well in the Boston community. Not long ago a networking group was formed calling itself Boston Big Data. they held their first event out here on Winter Street and it drew over 100 people. Data is everywhere and they are constantly making more of it. It wont be long (maybe it has already happened) before we see companies designing product for petabyte level storage.

Epicsystems said...

Dear Sir,

I have the pleasure to brief on our Data Visualization software
"Trend Compass".

TC is a new concept in viewing statistics and trends in an animated
way by displaying 5 axis (X, Y, Time, Bubble size & Bubble color)
instead of just the traditional X and Y axis. It could be used in
analysis, research, presentation etc. In the banking sector, we have
Deutsche Bank New York as our client.

This a link on weather data :

This is a bank link to compare Deposits, Withdrawals and numbers of
Customers for different branches over time ( all in 1 Chart) :

Misc Examples :

This is a project we did with Princeton University on US unemployment :

A 3 minutes video presentation of above by Professor Alan Krueger
Bendheim Professor of Economics and Public Affairs at Princeton
University and currently Chief Economist at the US Treasury using
Trend Compass :

Latest financial links on the Central Bank of Egypt:

I hope you could evaluate it and give me your comments. So many ideas
are there.

You can download a trial version. It has a feature to export
EXE,PPS,HTML and AVI files. The most impressive is the AVI since you
can record Audio/Video for the charts you create.

All the best.

Epic Systems

Mike said...

Your blog has been recommended to us as a interviewee's favorite blog!

We would like to do an interview with you about your blog for Blog Interviewer. We'd like to give you the opportunity to give us some insight on the "person behind the blog."

It would just take a few minutes of your time. The interview form can be submitted online here
Submit your

Best regards,

Mike Thomas