The problem with AI bias

Ai has come a long way. Just after WW2, there was a preconception that developing Artificial Intelligence would lead to something like an ‘Attack of the Zombie Robots’, and that AI could only be a bad thing for humanity. Fortunately we have come a long way from the old sci-fi view of AI, and we even have robotics used in surgery, but there is still a lingering feeling that AI and robotics are threatening in some way, and one of those ways is ‘bias’.

AI is very much part of the fourth industrial revolution, which also includes cyber-physical systems powered by technologies like machine learning, blockchain, genome editing and decentralised governance. The challenges that we face in developing our use of AI, are tricky ethical ones for the most part, which need a sensitive approach.

So, what is the issue? As James Warner writes in his article on AI and bias,

“AI is aiding the decision making from all walks of life. But, the point is that the foundation of AI is laid by the way humans function.” And as we all know — humans have bias, unfortunately. Warner says, “It is the result of a mandatory limited view of the world that any single person or group can achieve. This social bias just as it reflects in humans in sensitive areas can also reflect in artificial intelligence.”

And this human bias, as it cascades down into AI can be dangerous to you and me. For example, Warner writes: “the investigative news site Pro Publica found that a criminal justice algorithm used in Florida mislabelled African American defendants as high risk. This was at twice the rate it mislabelled white defendants.” Facial recognition has already been highlighted as an area with shocking ethnic bias, as well as recognition errors.

IBM suggests that researchers are quickly learning how to handle human bias as it infiltrates AI. It has said that researchers are learning to deal with this bias and coming up with new solutions that control and finally free AI systems out of bias.

The ways in which bias can creep in are numerous, but researchers are developing algorithms that can assist with detecting and mitigating hidden biases in the data. Furthermore, scientists at IBM have devised an independent bias rating system with the ability to determine the fairness of an AI system.

One outcome of all this may be that we discover more about how human biases are formed and how we apply them throughout our lives. Some biases are obvious to us, but others tend to sneak around unnoticed, until somebody else points it out. Perhaps we will find that AI can teach us how to handle a variety of biased opinions, and be more fair ourselves.

Data for sale on eBay

When eBay launched it became the go-to place for buying electrical items at vastly reduced prices, amongst other things. Its auction bidding style provided an element of excitement where the user could become a ‘winner’ by making the best bid. Counting down the hours and minutes until the sale closed could be a nail-biting affair.

Since then eBay has vastly expanded the range of items for sale and it is a marketplace where any individual can set up their stall. Now something rather interesting about eBay has come to light, according to a Forbes article; around 42% of the hard drives sold on the site contain sensitive data.

The analysis came via Ontrack research for a Blanco Technology Group report. It revealed that hard drives bought in the USA, UK, Germany and Finland contained sensitive data as well as personal information.

Birth certificates, passports and more

The researchers spoke to sellers, all of whom claimed they had used proper “data sanitisation methods” to ensure no data remained on the drives. The report showed this was clearly untrue. It showed, “One drive belonged to a software developer “with a high level of government security clearance” that still contained scanned images of family passports and birth certificates along with financial records.” And they also found,” a drive with 5GB of archived internal office email from a major travel company, 3GB of data from a freight company including documents that detailed shipping schedules and truck registrations, university student papers and associated email addresses and school data that was comprised of photos and documents with pupil names and grades.”

Fredrik Forslund, vice-president of cloud and data erasure at Blanco remarked on the situation: “Selling old hardware via an online marketplace might feel like a good option, but in reality it creates a serious risk of exposing dangerous levels of personal data.”

This is not a case of widespread data theft, or intent to damage a specific business. For criminals to benefit from this information, they would have to buy a lot of hard drives and even then they cannot be sure what data they will get, or indeed if there is any on the hard drive.

But Tim Erlin, vice-president of product management and strategy at Tripwire, warns that although this might make it seem as if there isn’t a problem, “it might lower the concern, but it shouldn’t eliminate it.”

How to avoid selling data on eBay

Getting rid of a hard drive requires care and any business should have a process in place for removing any sensitive data. Old processes, such as using magnets are outmoded, and Solid State Drives (SSDs) require a different approach altogether. Tim Mackey, senior technical evangelist at Synopsys suggests that in order to ensure certainty data cannot be recovered, physically destroying, or shredding, the drive is the answer.

It is likely that large organisations have the systems in place to perform this kind of data sanitisation effectively, but small and mediums sized businesses may not. And it is likely that the majority of the hard drives for sale on eBay come from those businesses who see selling old hard drives on the site as a way to recoup some money.

We need to be more aware than ever of the value of data and the importance of data security. If you are getting rid of a hard drive connected to business use, ensure it is properly destroyed and that you have confirmation of its destruction. Don’t let it end up on eBay where you have no idea who might find that it still contains valuable information.