Finance
Google Gemini is ‘the tip of the iceberg’: AI bias can have ‘devastating impact’ on humanity, say experts
Substantial backlash against Google’s Gemini artificial intelligence (AI) chatbot has elevated concern about bias in large language models (LLMs), but experts warn that these issues are just the “tip of the iceberg” when it comes to the potential impact of this tech across industries.
The rapid advancement of AI has led to significant advancements in various fields. It can help analyze medical imagery like mammograms and X-rays, accelerate the development of new drug treatments, optimize energy use and assist businesses in making informed decisions based on sorting large quantities of data.
However, the adoption of AI by governments and corporations for its problem-solving capabilities has also been met with considerable caution.
Adnan Masood is recognized as Microsoft Regional Director and MVP (Most Valuable Professional) for Artificial Intelligence by Microsoft. As Chief Architect of AI and Machine Learning at UST, he collaborates with Stanford Artificial Intelligence Lab and MIT CSAIL, and leads a team of data scientists and engineers building AI solutions.
GOOGLE GEMINI: FORMER EMPLOYEE, TECH LEADERS SUGGEST WHAT WENT WRONG WITH THE AI CHATBOT
“Artificial intelligence is an amazing catalyst for digital transformation. Everywhere from wealth management to population health to touchless retail operations, technologies like machine learning and computer vision are making algorithms fast, portable and ubiquitous,” he told Fox News Digital.
But Masood also highlighted the possibility of substantial downsides as well. Asking people to identify the threat they see coming from AI will garner a range of answers, from “the robots are taking our jobs” to “Big Brother is watching us.” While Masood admits these are all reasonable concerns, he believes the most significant challenge humanity faces from AI lies at the “heart” of its algorithms.
“AI systems are not created in a vacuum. Their behaviors reflect the best — but also the very worst of human characteristics,” he told Fox News Digital. “These models are prejudiced — and it is up to us to fix them.”
According to Masood, self-perpetuating bias is the biggest threat posed by AI and can have a “devastating impact” on health, job opportunities, access to information and even democracy.
The question is: What can society do to modify data that simply reflects ingrained societal biases? Currently, there are no regulations around algorithmic accountability. Masood believes some organizations and governments are making progress.
“With AI evolving at such a dramatic speed, already-problematic societal inequalities are being reinforced even as I write. And if we don’t tread carefully, these models will cause irreparable damage,” he said.
OHIO SENATOR DEMANDS GOOGLE ‘BREAKUP’ AMID GEMINI DEBACLE: ‘ONE OF THE MOST DANGEROUS COMPANIES IN THE WORLD’
LexisNexis Risk Solutions Global Chief Information Security Officer Flavio Villanustre told Fox News Digital the potential impact of AI models can range from “slightly inappropriate” responses to outcomes that could break existing anti-discrimination laws. Depending on its application, AI could cause issues in company hiring processes and wrongly inform decisions related to state benefits eligibility, loan rates, college admissions and “countless” other possibilities.
Masood agreed that wrongfully using automation to streamline state government work and the recruitment screening process is a salient yet everyday example of how machine learning algorithms can exacerbate systematized biases.
In 2018, Amazon discovered that its AI hiring software discriminated against resumes mentioning women and candidates from all-women colleges. The algorithm was merely basing its decisions on the company’s limited history of hiring female engineers and computer scientists. The software was later scrapped.
That same year, studies found that Microsoft AI’s facial recognition software assigned Black males more negative emotions than their White counterparts.
“These examples are just the tip of the iceberg when it comes to the way technology can amplify oppression and undermine equality,” he said. “With AI becoming more ubiquitous, cases become larger by orders of magnitude, paving the way to a dystopian future of machine-rule.”
Masood noted there are also troubling instances of AI racism embedded in justice systems, as was the case when it was discovered the COMPAS algorithm had discriminated against people of color.
RACIAL BIAS IN ARTIFICIAL INTELLIGENCE: TESTING GOOGLE, META, CHATGPT AND MICROSOFT CHATBOTS
“If these issues are not concerning enough, we are starting to see a more pervasive use of these models in medical applications for diagnostic and therapeutic purposes. If, due to bias, a model incorrectly assesses the condition of a patient or the appropriate treatment, it could lead to life-altering consequences,” Villanustre added.
Kirk Sigmon, a Washington, D.C.-based attorney specializing in artificial intelligence/machine learning (ML) intellectual property, suggested that “virtually all” AI models are biased.
He noted that artificial neural networks are trained on voluminous amounts of data based on what is available. This includes texts from books, images from the internet and more. As a result, whatever limitations are present in that data become “weaknesses” of the trained model.
“Google’s approach to hiding the bias in its models is via secret prompt engineering — that is, changing the nature of what you ask the model to do by adding additional words/content (like multicultural). This also seems to be the approach taken by OpenAI in their ChatGPT product. The problem is, they’ve not actually fixed the underlying bias at all: they’re just secretly changing what users ask for to avoid public relations issues, promote a particular agenda, or the like,” Sigmon told Fox News Digital.
Sigmon said this often results in significantly less helpful, “if not outright comical” outputs, discouraging users from using the tool. Gemini was the latest AI to face heat for its responses after it produced historically inaccurate images that downplayed or outright removed White people. This led to public apologies by Google and a pause on the image generation feature.
“If society plans to increasingly rely on tools like ChatGPT and Gemini, the implications of secretive prompt engineering can be frightening. We might not have much of an issue with an AI model trying to avoid outright or inadvertent racism, but the very same secret prompt modification strategies might be used to change the public’s perception of historical events, bury company scandals, or the like,” Sigmon said.
ARTIFICIAL INTELLIGENCE IS BIG, BUT ARE COMPANIES HIRING FOR AI ROLES TOO FAST?
“In other words, the very same strategies used by Google to ensure output is multicultural and inoffensive could be used to manipulate the public in extremely damaging ways,” he added.
Ruby Media Group CEO Kris Ruby, who recently uncovered a trove of data on Gemini, told Fox News Digital that biased AI can recreate societal norms, cultures and values that can strip historical context. If facts are removed or altered, a corporation can cultivate its own set of “facts” that align with its personal worldview.
Ruby, who wrote “The Ruby Files — The Real Story of AI Censorship,” stressed those in charge of shaping the current information environment must be held accountable, as the architecture of AI products can alter the future digital landscape society depends on for education and commerce.
Furthermore, if the data scientists responsible for making critical decisions lack political diversity, users will be left with a “lopsided product” that “skews to the collective bias of a product team.”
“AI is transforming our society,” she added. “As we become more dependent on a modern digital infrastructure embedded with machine learning, we must understand the foundation of the models and how those models are built. Historical accuracy of individual datasets used to build a product is just as important as modern-day historical output. We cannot understand where we are going if we do not understand where we came from.”
Former Fortune 100 emerging technology executive Sonita Lontoh told Fox News that digital boards and business leaders need to understand that AI bias exists and has exacerbated class-based and race-based inequities in healthcare and creditworthiness assessments via mortgage approval algorithms in the past.
A class-action lawsuit filed in December claims that the health insurance company Human used the AI model nHPredict to deny medically necessary health care for disabled and elderly patients covered under Medicare Advantage.
HOW AI IS REVOLUTIONIZING THE WORLD OF MEDICINE
A month earlier, another lawsuit alleged that United Healthcare also used the nHPredict model to reject specific claims despite knowing that the tool was faulty and had contradicted physicians’ conclusions.
“Biases infiltrate AI because algorithm is like an opinion. Biases can enter throughout the AI lifecycle — from the framing of the problem the AI is trying to solve, to product design and data collection, to development and testing. As such, risks and controls should occur at each stage of the AI lifecycle,” she told Fox News Digital.
Lontoh, a board member of several NYSE and Nasdaq-listed companies, said board members need a game plan to monitor and institute AI governance that includes collaboration with internal and external experts.
A publication from the National Institute for Standards in Technology (NIST) examines bias in AI. In the U.S., the Accountability Act requires bias to be addressed in corporate algorithms. Under the General Data Protection Regulation (GDPR), the European Union introduced the right to be informed of an algorithm’s output. The Singapore Model AI Governance Framework has a strong focus on internal governance, decision-making, models, operations management and customer relationship management.
“There are many more disparate examples. But algorithms operate across borders; we need global leadership on this. By providing stakeholders and policymakers with a broader perspective and necessary tools, we can stop the bigot in the machine from perpetuating its prejudice,” Masood said.
However, he remains optimistic that humanity can make AI work to its benefit.
READ MORE FROM FOX BUSINESS
Read the full article here