Comprehensive rules for trustworthy AI: EU navigates the Artificial Intelligence Act

Digital Reinvention
11/12/2023 News

In a groundbreaking move, Members of the European Parliament (MEPs) have reached a historic political deal with the Council, solidifying a comprehensive set of regulations aimed at ensuring the safe and ethical use of artificial intelligence (AI) in Europe. The provisional agreement on the Artificial Intelligence Act reflects a commitment to balancing innovation with the protection of fundamental rights, democracy, and environmental sustainability.

Safeguards and restrictions

The agreed-upon regulations encompass a range of safeguards and prohibitions:

• Biometric categorization systems: The use of biometric categorization systems based on sensitive characteristics such as political beliefs, religion, philosophy, sexual orientation, and race is strictly prohibited.

• Facial recognition: The untargeted scraping of facial images from the internet or CCTV footage for the creation of facial recognition databases is banned.

• Emotion recognition: Employing AI for emotion recognition in workplaces and educational institutions is off-limits.

• Social Scoring: AI-driven social scoring based on personal behavior or characteristics is prohibited.

• Manipulative AI: Systems designed to manipulate human behavior and exploit vulnerabilities are not allowed, particularly concerning age, disability, social or economic situations.

Law enforcement exceptions

While recognizing the importance of law enforcement applications, negotiators have established safeguards and narrow exceptions for the use of biometric identification systems (RBI) in publicly accessible spaces. This is subject to prior judicial authorization and limited to specific lists of crimes. Both "post-remote" and "real-time" RBI come with strict conditions to ensure targeted searches and prevent abuse.

High-risk system obligations
For AI systems classified as high-risk due to potential harm to health, safety, fundamental rights, environment, democracy, and the rule of law, explicit obligations have been outlined. This includes mandatory fundamental rights impact assessments, extending to the insurance and banking sectors. High-risk AI systems influencing elections and voter behavior fall under this category, giving citizens the right to launch complaints and receive explanations for decisions affecting their rights.

General artificial intelligence systems

Recognizing the diverse capabilities of general-purpose AI (GPAI) systems, transparency requirements have been established. Technical documentation, compliance with EU copyright law, and dissemination of detailed training content summaries are mandated. High-impact GPAI models with systemic risk face more stringent obligations, including model evaluations, risk assessments, adversarial testing, and reporting on incidents and energy efficiency.

Supporting innovation and SMEs

To foster innovation, especially among small and medium-sized enterprises (SMEs), the agreement promotes regulatory sandboxes and real-world testing. National authorities will establish these frameworks to allow businesses to develop and train innovative AI solutions before market placement.

Sanctions and entry into force

Strict penalties are in place for non-compliance, with fines ranging from 35 million euros or 7% of global turnover to 7.5 million or 1.5% of turnover, depending on the nature of the infringement and the size of the company.

Voices of approval

Co-rapporteurs Brando Benifei and Dragos Tudorache expressed satisfaction with the deal, emphasizing the significance of this legislation in placing rights and freedoms at the forefront of AI development. They highlighted the importance of correct implementation, continued parliamentary oversight, and the impact the AI Act will have on Europe's digital future.

Next steps

The agreed-upon text will now undergo formal adoption by both the Parliament and Council to become EU law. Committees within Parliament, such as Internal Market and Civil Liberties, are scheduled to vote on the agreement in the near future, marking a critical step toward the realization of this comprehensive regulatory framework for trustworthy AI.

Related news & insights

Digital Reinvention
15/07/2024 Article

Financial Innovation Spotlight – July 2024 edition

This global innovation journey begins in Singapore, where OCBC Securities offers AI-driven personalized stock recommendations. Then we head to the...

Digital Reinvention
14/07/2024 News

Driving innovation in insurance: Insights from Santalucía's IMPULSA program

In a recent interview with El Referente, Ángel Uzquiza, Director of Innovation at Santalucía Seguros and Santalucía IMPULSA, shared insights...

Digital Reinvention
12/07/2024 Interview

NewTech Friday: Trustly – Offering fast, simple and secure online banking payments

Swedish scaleup Trustly is an open banking pioneer and a global payment method. Qorus’ Boris Plantier talked to Oscar Berglund,...

Digital Reinvention
11/07/2024 News

BNP Paribas and Mistral AI forge multi-year partnership to enhance banking services

BNP Paribas and Mistral AI have entered into a multi-year partnership agreement, enabling BNP Paribas to access and utilize Mistral...

11/07/2024 News

CaixaBank: Key to offering financial services without exclusion in rural areas

Branch networks, mobile branches and rural ATMs are essential for democratising banking services in the most depopulated areas. These municipalities...

09/07/2024 News

Measuring CO2 emissions in auto claims management

Crédit Agricole Assurances, Europ Assistance, and BCA Expertise, in collaboration with the Institut Louis Bachelier, have launched an innovative project...

08/07/2024 Interview

Unveiling INside: Grupo Ageas Portugal’s path to innovation excellence

Grupo Ageas Portugal won bronze in the Workforce Transformation category at the Qorus Innovation in Insurance Awards 2024. Having already...

06/07/2024 Article

AutoMobility Insights - July 2024 edition

The latest news from the automotive industry curated and commented by the experts at Corporate Value Associates (CVA).