Skip to main content

Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket.  They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them.  As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing.  The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time.  This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then.  That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each.  Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it?  As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact.  I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.  

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:  
Kindle:  
Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

Popular posts from this blog

I, Mammal - Liam Drew *****

It's rare that a straightforward biology book (with a fair amount of palaeontology thrown in) really grabs my attention, but this one did. Liam Drew really piles in the surprising facts (often surprising to him too) and draws us a wonderful picture of the various aspects of mammals that make them different from other animals. 

More on this in a moment, but I ought to mention the introduction, as you have to get past it to get to the rest, and it might put you off. I'm not sure why many books have an introduction - they often just get in the way of the writing, and this one seemed to go on for ever. So bear with it before you get to the good stuff, starting with the strange puzzle of why some mammals have external testes.

It seems bizarre to have such an important thing for passing on the genes so precariously posed - and it's not that they have to be, as it's not the case with all mammals. Drew mixes his own attempts to think through this intriguing issue with the histor…

Foolproof - Brian Hayes *****

The last time I enjoyed a popular maths book as much as this one was reading Martin Gardner’s Mathematical Puzzles and Diversions as a teenager. The trouble with a lot of ‘fun’ maths books is that they cover material that mathematicians consider fascinating, such as pairs of primes that are only two apart, which fail to raise much excitement in normal human beings. 

Here, all the articles have something a little more to them. So, even though Brian Hayes may be dealing with something fairly abstruse-sounding like the ratio of the volume of an n-dimensional hypersphere to the smallest hypercube that contains it, the article always has an interesting edge - in this case that although the ‘volume’ of the hypersphere grows up to the fifth dimension it gets smaller and smaller thereafter, becoming an almost undetectable part of the hypercube.

If that doesn’t grab you, many articles in this collection aren’t as abstruse, covering everything from random walks to a strange betting game. What'…

Liam Drew - Four Way Interview

Liam Drew is a writer and former neurobiologist. he has a PhD in sensory biology from University College, London and spent 12 years researching schizophrenia, pain and the birth of new neurons in the adult mammalian brain. His writing has appeared in Nature, New Scientist, Slate and the Guardian. He lives in Kent with his wife and two daughters. His new book is I, Mammal.

Why science?

As hackneyed as it is to say, I think I owe my fascination with science to a great teacher – in my case, Ian West, my A-level biology teacher.  Before sixth form, I had a real passion for the elegance and logic of maths, from which a basic competence at science at school arose.  But I feel like I mainly enjoyed school science in the way a schoolkid enjoys being good at stuff, rather than it being a passion.

Ian was a revelation to me.  He was a stern and divisive character, but I loved the way he taught.  He began every lesson by providing us with a series of observations and fact, then, gradually, between …