Frontline Defense: Outsmarting Fraudsters and Shaping the Future of Fraud Prevention

The rise of AI and ML in fraud prevention can lead to a new era of digital trust and compliance

Author: Jochen Werne / 26.12.2023

In an era marked by rapidly advancing technology and increasing global interconnectivity, the fight against online fraud has become a paramount concern for financial institutions, businesses, and regulators worldwide. Part of my professional work revolves around understanding and mitigating the risks associated with financial fraud. The Experian Forrester Fraud Research Report 2023, which was recently released, sheds light on the escalating threat of online fraud and the evolving strategies to counter it, particularly through the use of Machine Learning (ML) and Artificial Intelligence (AI).

The report’s findings are stark: a 74% increase in fraud losses in Germany, reflecting nearly the global increase rate. This surge is not just a statistic; it’s a clear indication of the sophisticated and pervasive nature of modern financial fraud. Companies across various sectors are feeling the impact, with financial services bearing the brunt. This trend is deeply concerning not only for the economic health of individual businesses but also for the broader stability and security of the financial system.

From a geopolitical perspective, the rise in online fraud is a multifaceted challenge. It’s a threat that transcends borders, affecting relations among nations, and has become a significant factor in international policy and security discussions. Countries, including Germany, are increasingly recognising the need for cooperative international efforts to combat this scourge. The geopolitical implications are profound, as fraud undermines economic stability and erodes public trust.

Turning to the German banking sector, the issue of compliance and reputation risk under the framework of Minimum Requirements for Risk Management (MaRisk) is particularly pertinent. Banks are finding themselves at the forefront of the battle against online fraud, necessitating robust risk management strategies that align with regulatory requirements. Under MaRisk, the mandate is clear: implement effective, comprehensive controls to detect, prevent, and manage fraudulent activities. The reputational risk for banks and their board members is immense; a single lapse can lead to significant financial losses, legal consequences, and lasting damage to customer trust.

In this challenging landscape, AI/ML-based fraud prevention methods stand out as beacons of hope. These technologies offer the promise of enhancing detection capabilities, reducing false positives, and adapting swiftly to new fraudulent tactics. However, their implementation must be undertaken with a clear understanding of the ethical implications and potential biases inherent in AI systems. As we embrace these technologies, we must also commit to transparency, accountability, and continuous improvement to ensure they serve the interests of all stakeholders fairly and effectively.

Despite the challenges, I believe there is a path forward that balances the need for security with the imperative for innovation and growth. The key lies in embracing a multi-faceted approach to fraud prevention that leverages the best of technology, human expertise, and regulatory compliance. ML, with its ability to learn and adapt to new patterns, offers a powerful tool in this fight. However, its effectiveness hinges on the quality of data, the integrity of algorithms, and the wisdom of the humans who guide its evolution.

The German companies surveyed in the study are acutely aware of the challenges and opportunities presented by AI/ML in fraud prevention. The overwhelming majority recognise the efficacy of ML-based approaches and anticipate their increasing dominance in the field. Yet, they also acknowledge the hurdles, including the costs associated with deploying advanced fraud prevention solutions, the need for continuous adaptation, and the importance of addressing the ethical considerations of AI use.

In my experience, one of the most critical factors for success in this endeavour is collaboration. Tackling online fraud is a collective effort that requires the involvement of businesses, regulators, technology providers, and consumers. By working together, sharing knowledge, and fostering a culture of innovation and vigilance, we can stay ahead of fraudsters and protect the integrity of our financial systems.

Another vital aspect is education and awareness. Both consumers and employees must be informed about the risks of online fraud and the steps they can take to prevent it. Regular training, robust policies, and a culture of security are essential in creating a resilient defense against fraud.

Finally, we must recognize that the fight against fraud is an ongoing battle. As technology evolves, so too will the tactics of fraudsters. We must remain agile, constantly updating our strategies, investing in new technologies, and adapting to changing regulatory landscapes. This dynamic approach is not just about defense; it’s about building a stronger, more secure future for everyone.

The Experian Forrester Fraud Research Report 2023 is a call to action. It highlights the urgent need for enhanced strategies, stronger collaboration, and a steadfast commitment to ethical, innovative solutions in the fight against online fraud. As leaders in the financial services industry, we have a responsibility to take the helm, steering our organisations towards safer waters in this tumultuous sea of digital threats. By harnessing the power of AI/ML, prioritising ethical considerations, and fostering a culture of collaboration and continuous learning, we can not only mitigate the risks of online fraud but also pave the way for a more secure, prosperous, and trustworthy financial ecosystem.

#fraudprevention #dataliteracy #machinelearning

Charting Uncharted Waters: Europe’s Place in a World Remade

By Jochen Werne.

Duesseldorf, 5 November 2023

Introduction

From the eloquent words of Shakespeare in Henry V, where he once proclaimed, “all things are ready if our minds be so”^1 to the monumental shifts brought by Gutenberg’s printing press^2, history reminds us that change is both an inevitable and defining characteristic of human progress. As the world stands at the threshold of a new epoch marked by rapid technological shifts and pronounced geopolitical transformations, this profound sentiment compels us to reflect on the paramount importance of preparedness and perspective. The way societies respond to these shifts determines the direction of their trajectory. In our current age, Europe finds itself at the nexus of global transformations driven by technological advancements and geopolitical tectonics.

Technology: A Historical Reflection

Peering through the lens of history, one quickly realizes that technology has been both a beacon of hope and an augury of upheaval. Take the 15th century’s monumental invention of the printing press as a case in point^2. This groundbreaking innovation democratized access to information and catalysed a substantial uptick in literacy rates across Europe. As Eisenstein posits, the “Printing Revolution” catalyzed an era where knowledge was no longer the privilege of the few but a right of the many^2. Yet, its reverberations were not confined to just reading and writing. The press became the vessel through which Martin Luther disseminated his Ninety-Five Theses, triggering a religious revolution that reshaped the European continent.

However, the journey wasn’t without turbulence. This democratization of knowledge played a pivotal role in challenging the established order, culminating in events like the Reformation, which MacCulloch describes as Europe’s great house divided^3.

Niall Ferguson, in “The Square and the Tower”, beautifully illustrates the timeless tension and interplay between networks and hierarchies^4. Historically, technologies like the printing press have emerged as disruptors, challenging established orders and reshaping hierarchies. The press, for instance, allowed for the free flow of ideas, becoming an early network that democratized information. Yet, not everything it propagated was for the betterment of society. The infamous “Malleus Maleficarum”, an ostensibly scholarly treatise, fueled the flames of the European witch hunts, leading to persecution, paranoia, and a dark chapter in history^5.

From Past to Present: The Tech Geopolitical Nexus

Fast forward to the present, and we witness a world where technology continues to shape geopolitical realities. Maddison’s macro-economic study reveals that the global center of economic gravity has been steadily shifting towards the East, particularly since the dawn of the 21st century^6. Nowhere is this shift more apparent than in the realm of technology.

The US-China tech rivalry, explored by Fuller, highlights the strategic challenges posed by China’s technological ascent^7.

The race for supremacy in AI, quantum computing, 5G, and biotechnologies marks the modern-day power play. But this isn’t merely about technological one-upmanship; it signifies a larger canvas of geopolitics, economics, and even societal values.

Many analysts are drawing parallels to the Cold War, coining the term “Tech Cold War” or “Cold War II”. Unlike the 20th-century version, primarily characterized by nuclear deterrence between the USSR and the US, this new Cold War positions the US and China in an intense rivalry for technological, economic, and military dominance. In the midst of this rivalry, both nations are hyper-aware of the stakes.

Navigating the Waters of New Geopolitical Paradigms

More than a century ago, the naval strategist Alfred Thayer Mahan, in his seminal work on sea power, postulated that maritime dominance was crucial to national greatness.

Today the Indo-Pacific has become the focal point of 21st-century geopolitics. Here, China’s assertive ‘Two Ocean Strategy’ is emblematic of its ambitions to exert influence both in the Pacific and the Indian Ocean. This expansive maritime vision is not just about sea lanes and trade; it’s a reflection of China’s aspirations to be a global power.

Simultaneously, the Taiwan question looms large in this maritime strategy. Its strategic location in the first island chain poses both an opportunity and a challenge for Beijing. Control over Taiwan would offer unencumbered access to the broader Pacific.

However, the rise of one power often brings countermeasures by others. The ‘AUKUS’ agreement between Australia, the United Kingdom, and the United States is a manifestation of this dynamic. While cloaked in the language of technological collaboration, especially in the realm of nuclear-powered submarines, the underlying intent of AUKUS is clear. It seeks to counterbalance China’s growing naval capabilities and assertiveness, particularly in the South China Sea.

Reflecting on Mahan’s sea power doctrine in this context provides a sobering perspective. Mahan believed that maritime dominance was the linchpin of global influence. Yet, he also understood the responsibilities and challenges that came with such power. In our contemporary setting, while nations pursue their maritime strategies, it is imperative they also embrace the principles of dialogue, cooperation, and conflict avoidance.

Taiwan epitomizes this interplay. As a beacon in semiconductor manufacturing, Taiwan’s geopolitical relevance can’t be overstated. Any instability could trigger economic consequences potentially dwarfing the aftermath of the Covid-19 pandemic^9.

Taiwan and Europe: Quietly Interwoven, Profoundly Connected.

In the intricate web of global technology supply chains, few names stand out as prominently as Taiwan Semiconductor Manufacturing Company (TSMC). Founded in 1987, TSMC has ascended the technological hierarchy to become the world’s leading semiconductor foundry, a testament to its unwavering commitment to innovation and excellence.

TSMC’s significance is multifaceted. For one, it’s the world’s largest dedicated independent semiconductor foundry^8. With clients ranging from major tech giants like Apple and Nvidia to burgeoning startups, TSMC’s production underpins a vast swathe of the digital products and solutions we rely on daily. However, TSMC’s role isn’t merely a commercial or technological one. It is geopolitical. With the escalating “Tech Cold War” between the U.S. and China, TSMC finds itself at an intriguing junction. The company’s strategic importance is underscored by global reliance on its cutting-edge chip manufacturing capabilities. This reliance has not only made TSMC a coveted partner but also a strategic asset in the larger scheme of global geopolitics. The U.S. push to ensure TSMC sets up manufacturing bases on its soil, and China’s keen interest in the semiconductor sector, highlights the foundry’s pivotal position.

Furthermore, TSMC embodies Taiwan’s broader significance in the tech world. As the geopolitical tussle intensifies, Taiwan – and by extension, TSMC – becomes a linchpin for global tech supply chains. A disturbance in TSMC’s operations, as speculated, could have cascading ramifications across industries, from consumer electronics to automotive and healthcare. Any significant disruption in this intricate supply chain would reverberate globally, with experts suggesting a potential 5% drop in global automotive production^9.

As chips become smaller, denser, and more powerful, the precision and capability of lithography machines must evolve in tandem.

Here’s where Europe and ASML, a Dutch gem, comes into play. The company is the sole producer of extreme ultraviolet (EUV) lithography machines^8, an advanced technology that allows for the creation of incredibly dense and efficient chips. With transistors now approaching atomic scales, EUV lithography is no less than a technological marvel, allowing chipmakers to etch circuits just a few nanometers wide.

However, the conversation around ASML isn’t merely about technological mastery. Given its unique position as the only producer of these EUV machines, ASML enjoys a quasi-monopolistic status in this niche yet profoundly impactful domain. In an era where technological supremacy is increasingly intertwined with geopolitical power, also ASML’s importance cannot be overstated. The machines they produce are not just expensive and sophisticated pieces of equipment; they are, in many ways, gatekeepers to the next generation of digital innovation.

Such a near-monopoly naturally draws attention. Nations and corporations are keenly aware of the strategic value inherent in controlling or accessing state-of-the-art chipmaking technology. With the ongoing technological cold war, where semiconductor supply chains have become part of the geopolitical chessboard, ASML finds itself in a spotlight it never sought but cannot avoid.

Europe’s Crucial Pivot

Europe’s position in this evolving tech landscape is unique. While traditionally viewing the Atlantic alliance as a cornerstone of its foreign policy, the rise of China necessitates a recalibrated approach^10. Europe’s interlinked trade with China, especially through critical chokepoints like the Malacca Strait, underscores the strategic dimension of this relationship^11.

In this whirlwind of technological and geopolitical flux, Europe is not an idle spectator. With a collective GDP nearing $22 trillion, it wields considerable influence. Europe’s role is multi-dimensional: an economic powerhouse, a voice of reason in tumultuous times, and often a mediator in global disputes.

The European Central Bank (ECB) embodies Europe’s proactive stance^12. Recognizing the flux, the ECB’s vision for 2023-2025 zeroes in on three pillars:

The ECB recognizes that the financial institutions it oversees must adapt to these transformative times. A crucial element of this adaptation is embracing digitalization, with a special emphasis on robust data-driven risk management.

  1. Strengthening Resilience: The intricate web of global economies translates to shared vulnerabilities. It’s imperative for Europe’s financial edifice to be robust, equipped to handle external shocks, and maintain systemic stability.
  2. Digitalisation & Institutional Strengthening: The burgeoning fintech sector necessitates a complete metamorphosis for legacy banks. This isn’t a mere cosmetic digital overhaul. Banks need to internalize and deploy intelligent digitalization. Central to this transformation is data analytics, supercharged by AI. Harnessing data, drawing meaningful insights, and predicting trends will determine who thrives in this new era.
  3. Climate Change Initiatives: Europe has consistently championed sustainability. The financial sector’s alignment with green, sustainable practices isn’t just altruistic; it’s also economic prudence, ensuring long-term viability and stability.

The above mentioned ECB focus is highlighted by Experian’s 2023 report on why AI-driven, regulatory-compliant analytics solutions are becoming imperative for European banks^13.

The AI Paradigm: Europe’s value-based Ethical Approach

Europe’s approach to AI regulation, championing the cause of ‘explainable AI’, shows its commitment to integrating technology with ethics. This dedication harks back to its legacy of literacy and the importance of accessibility, a theme explored by Graff^14. As Europe navigates the ‘Asian Century’^15, it does so with a clear vision: to leverage its historical experiences and chart a course that balances innovation with ethical considerations. The European AI Act encapsulates this approach. The Act’s core philosophy revolves around ensuring AI applications are safe and respect existing laws and values. This includes transparency obligations, strict criteria for ‘high risk’ AI applications, and a provision for setting up a European Artificial Intelligence Board.

One might wonder, why the emphasis on explainability? As AI systems permeate critical sectors, from healthcare to finance, their decisions can profoundly impact individuals. An ‘explainable AI’ ensures that these decisions are not just accurate but also comprehensible to the average person. This empowers individuals, fostering trust in AI systems.

The Act, however, isn’t just about explainability. It recognizes the diverse applications of AI and categorizes them based on risk. For ‘high-risk’ applications, stringent requirements, from transparency to accuracy and security, are mandated. This stratified approach ensures that while innovation isn’t stifled, critical areas receive the scrutiny they warrant.

Economic Powerhouses: A Comparative Analysis

Any discussion on global transformation would be incomplete without examining the economic engines driving these changes. China’s astounding growth, with a GDP of $17.7 trillion by 2022^16, and its decade-long average annual growth rate of 6.5%, contrasts with the US’s $25.3 trillion GDP and a more conservative 2.3% growth rate^17. The European Union, showcasing resilience and integration, clocks a collective GDP nearing $22 trillion^18, with trade figures underscoring its global economic clout^19.

Conclusion: Europe’s Way Forward

Our world is in a state of flux, reminiscent of those transformative moments in history. From the monumental shifts of the Printing Revolution^2 to the divisive yet transformative Reformation^3, Europe has witnessed and shaped global trajectories. As it stands at the crossroads of another transformation, it draws from its rich historical tapestry, aiming to strike a balance between embracing the future and preserving its core values.

The digital future beckons, but it’s not without its challenges. Whether it’s the complex web of tech geopolitics or the imperative of sustainable growth, Europe’s journey forward will need to be both adaptive and principled. At the heart of this journey lies the potent combination of data and ethics. And as Europe strides into the future, it carries with it a clear message: progress, when rooted in ethics and driven by knowledge, can usher in an era that’s not just technologically advanced but also just, balanced, and peaceful.

Footnotes:

^1 Shakespeare, William. “Henry V.” Act IV, Scene 3. ^2 Eisenstein, Elizabeth L. “The Printing Revolution in Early Modern Europe.” Cambridge University Press, 1983. ^3 MacCulloch, Diarmaid. “Reformation: Europe’s House Divided 1490-1700.” Penguin UK, 2004. ^4 Ferguson, Niall. “The Square and the Tower: Networks and Power, from the Freemasons to Facebook.” Penguin, 2018. ^5 Kramer, Heinrich and Sprenger, James. “Malleus Maleficarum.” Dover Publications, 1971. ^6 Maddison, Angus. “Contours of the World Economy 1-2030 AD: Essays in Macro-Economic History.” Oxford University Press, 2007. ^7 Fuller, Douglas B. “Cutting off our nose to spite our face: US policy toward Huawei and Taiwan in the shadow of the Chinese tech challenge.” International Security 45.3 (2021): 52-89. ^8 Chappell, Bill. “ASML: The Obscure Dutch Company That’s Enabling Big Advances In Tech.” NPR, 2019. ^9 “The Economic Impact of a Taiwan Crisis.” Nikkei Asia, 2023. ^10 Casarini, Nicola. “The Rise of China and the Future of the Atlantic Alliance.” Oxford University Press, 2020. ^11 Lanteigne, Marc. “China’s Maritime Security and the ‘Malacca Dilemma’.” Asian Security 4.2 (2008): 143-161. ^12 “European Central Bank Annual Report.” 2023. ^13 Experian PLC. “Annual Report and Financial Statements.” 2023. ^14 Graff, Harvey J. “The Legacies of Literacy: Continuities and Contradictions in Western Culture and Society.” Indiana University Press, 1987. ^15 Khanna, Parag. “The Future is Asian: Commerce, Conflict, and Culture in the 21st Century.” Simon and Schuster, 2019. ^16 “World Bank Data: China.” 2022. ^17 “World Bank Data: United States.” 2022. ^18 “World Bank Data: European Union.” 2022. ^19 “European Commission Trade Statistics.” 2022.

About the author

Jochen Werne is CEO of Experian DACH. Large-scale global data powerhouses like Experian with it’s more than 20.000 data and analytics experts and a market cap of nearly €30bn have a pivotal role to play in this evolving narrative. As a global vanguard in data analytics, Experian is uniquely poised to offer financial institutions the insights and tools essential for navigating the multifaceted challenges of our times. In a world inundated with data, discerning patterns, understanding trends, and anticipating potential pitfalls will be the linchpin of success.

Unpacking Transformation: A European perspective

By Jochen Werne

I had the distinct honor, alongside CCO Björn Hinrichs, to represent Experian DACH at the Gala event 2023. Our heartfelt gratitude goes to acatech for their warm invitation.

It’s clear that fostering a robust relationship between science and industry is paramount. The National Academy of Science and Engineering stands as a beacon, guiding and correcting, making technological innovation the cornerstone of transformation. This union of strong research, pioneering companies, and forward-thinking policies is the backbone of what acatech and countless others strive for. In this journey, while competition fuels our drive, it is cooperation that offers the platform for greatness.

In the infinite expanse of space, we are but astronauts on a tiny speck called Earth. Regardless of our political and geopolitical landscape, science and research must always be the bridge, the “Bridge over Troubled Water” that connects us and ensures progress, says Jan Wörner, President of acatech, wisely.

In reflecting on this, Germany’s Federal President Frank-Walter Steinmeier’s words resonate deeply: “I think we should base our perspective more on Max Frisch and trust ourselves as individuals and society alike to be able to shape the future. And that means developing perspectives, broadening our horizons and, yes, always daring to try something new. We need all this in the phase of upheaval we are in. Holding on to the past, ignoring change, refusing change, that is not an option – especially not in an open society like ours. But: We have to give change – that is the task of politics, business and science – a direction!”

Drawing from these profound insights and looking through the lens of our work at Experian DACH, the era we are entering can be aptly described as a new Age of Enlightenment, where data and therefore data literacy is paramount. As the Enlightenment thinker Voltaire astutely pointed out, “Judge a man by his questions rather than by his answers.” It’s a sentiment that is even more relevant today. Taking cues from Immanuel Kant’s wisdom, enlightenment is about emerging from our limitations. In the context of our time, achieving data literacy and harnessing data effectively signifies our evolution from technological naivety.

While AI stands as a monumental tool to decipher this data, its effectiveness lies in the quality of the data it is fed. It brings to the fore the urgent need for data literacy. An AI is only as good as its data. Thus, a distorted understanding could lead to distorted outputs. The onus is on us, leaders in data, to champion the responsible use of AI and advance the narrative on the symbiotic relationship between data and AI.

This new Enlightenment is our journey towards an era where society is mature and informed, utilizing the strength of data and AI for the betterment of all. Knowledge, in this context, isn’t just power but the foundation for positive societal transformation.

Concluding with my personal reflection, data isn’t merely a quantified entity; it’s a potent instrument to comprehend and address pressing challenges. Our collective aim should be to cultivate an understanding of data – its collection, utilization, and, importantly, its ethical application.

Our commitment at Experian DACH, backed by our ‘data for good’ principle, is to be at the forefront of this change, guiding, and contributing to this transformative journey.

————-

More about the acatec Gala #FV2023 including the keynotes by Frank-Walter Steinmeier, Marion Merklein, Jan Wörner and Thomas Weber can be found here

Efficient use of AI determines the competitiveness and thus the future of German companies

Artificial Intelligence: The German Economy on the Cusp of Transformation

By Jochen Werne


1st October 2023, Düsseldorf

The “Experian 2023 Business Insights” report, released in September 2023, provides a revealing insight into the priorities of the global business community in the coming year. Particularly of interest to us in Germany is the insight into the transformative influence of Artificial Intelligence (AI) on areas such as analytics, risk assessment, and customer experience in the EMEA/APAC region.

Our German decision-makers are well aware of the pivotal role of AI in innovations. An encouraging finding: 60 percent of businesses in our country have already taken active steps to integrate AI into their processes.

However, the report also shows that not all executives in Germany are fully convinced of the benefits of using AI. The efficiency of AI in companies will determine how Germany stands as an economic location in an increasingly digital age. The transformation of raw data into meaningful insights and analyses will become a crucial competitive advantage for us.

It’s heartening to see that many of our international counterparts already recognise the benefits of AI. For more than half of the global companies, the productivity gains from AI already outweigh the initial costs.

One thing is clear: Our data infrastructure and the amount of data available will play a key role in the successful implementation of AI. Here, we as German businesses have some hurdles to overcome, especially regarding the availability of relevant data for critical business decisions.

In conclusion, I want to stress that, even with all the technology and data, we must never forget our ethical responsibility. AI must be employed in a transparent and responsible manner. The fact that already 61 percent of businesses in the EMEA/APAC region have a comprehensive AI risk management programme in place is promising.

The future is clear: businesses that properly harness AI will lead the competition. They’ll be able to leverage process efficiency and automation to unlock new growth opportunities.

For those who wish to read the full “Experian 2023 Business Insights Report”, you can find it here.

https://experianacademy.com/Forrester-Research-Report-2023

Decisions

There’s a peculiar phenomenon that often goes unnoticed: we vividly remember the moments in our lives when we made pivotal decisions, but the lazy Sundays we spent lounging on the couch tend to blur into obscurity. Why is that? From the standpoint of psychology and neuroscience, active decision-making engages multiple brain regions, specifically the frontal cortex. This engagement imprints these moments deeply in our memory.

Decisions are the very essence of our existence. On a daily basis, we make around 35,000 decisions, from what to wear to how to react in crucial life situations. In the realms of politics and business, decisions are made amidst uncertainty. The quality and timeliness of these decisions often determine success or failure. The better we are at decision-making, the more successful we become.

However, decisions aren’t made in a vacuum. They are greatly influenced by our emotions, past experiences, and even biases. Let’s delve into game theory, a study that examines mathematical models of strategic interaction. This theory was so revolutionary that scientists like John Nash were awarded the Nobel Prize for their contributions. It showcases the intricacies of making decisions when multiple players are involved, each trying to maximize their own benefits. For instance, the “Prisoner’s Dilemma” is a classic example. It illustrates how two individuals, aiming to minimize their punishments, often don’t cooperate, even if it’s in their best interest. Their decision, influenced by a lack of trust and the inability to communicate, usually leads to a suboptimal outcome for both.

Another interesting lens through which to view decision-making is behavioural finance. This field has shown that people don’t always act rationally, and their decisions are swayed by psychological factors. The Dot-com Bubble of the late 1990s offers a poignant example. During this period, a frenzy around internet-based businesses led to skyrocketing stock prices, despite many of these companies having no solid profits or clear business plans. Overconfidence and herd behavior drove investors to pour money into these stocks, leading to massively inflated valuations. The bubble inevitably burst in the early 2000s, resulting in significant financial losses for countless investors. This incident underscores the dangers of letting emotions and biases overrule rational financial decision-making.

Given the complexities, decision-makers often seek a solid foundation for their choices. This is where data comes into play. But data is not just essential; it’s omnipresent. It’s estimated that 2.5 quintillion bytes of data are created every day. Like water, it’s everywhere. And just as water can flood a village if not channeled properly, unstructured data can overwhelm and mislead.

Take the banking sector, for instance. Banks use data to assess creditworthiness. In e-commerce, data-driven algorithms suggest products to consumers. Telecom industries utilize data to enhance customer experience and predict churn. The cornerstone of these industries is state-of-the-art data analytics capabilities paired with robust decision engines.

However, with the influx of data, it’s crucial to discern the essential from the redundant. Much like converting saltwater to drinking water requires precision and expertise, sifting through raw data to extract meaningful insights is the forte of data analysts. They refine data into actionable decision-making parameters, reducing uncertainty. And in business, reduced uncertainty translates to reduced risk and increased profitability.

To conclude, data is indeed akin to water. Left unchecked or misused, it can wreak havoc. But when used right, when structured, analyzed, and enriched, it becomes invaluable. This is the essence of using “Data for Good” – transforming the ubiquitous into the indispensable, guiding decision-makers toward better, more informed choices.

Journal of Digital Banking: Same Game – Same Rules?

It was a pleasure contributing once again to a Henry Stewart Publication. This time in co-authorship (Christoph Impekoven & Jochen Werne) we delineate for the Journal of Digital Banking the differences between stablecoins, in particular, and ‘fiat’ currencies, in general. When you have read this paper, you will know what a stablecoin is, what types there are, how it differs from the US dollar or the euro and why the most important currency in all worlds is ‘trust’.

The Journal can be bought online HERE

Journal of Digital Banking

Journal of Digital Banking is the major professional journal publishing in-depth, peer-reviewed articles and case studies on FinTech innovation, digital disruption and how to develop a profitable, customer-focused digital banking strategy – specifically by using technology and automation to deliver efficient, secure and seamless customer experiences with lower operating costs.

Each quarterly 100-page issue – published in print and online – will feature detailed, practical articles showcasing the latest strategic thinking on how to exploit new and existing digital banking markets, business models and FinTech innovations along with actionable advice and ‘lessons learned’ from fellow digital banking professionals on the key business, risk and operational requirements for putting that strategy into practice. It will not publish advertising but rather in-depth analysis of new thinking and practice at a wide range of financial institutions, FinTech innovators and start-ups, investors, central banks and financial regulators worldwide for readers to benchmark their organisation against, with every article being peer-reviewed by an expert Editorial Board to ensure that it focuses on the digital banking professional’s perspective, the challenges they face and how they can tackle them.

Journal of Digital Banking is listed in Cabells’ Directories of Publishing Opportunities.  

Journal of Digital Banking is abstracted and indexed in the Research Papers in Economics (RePEc) database IDEAS

As such Journal of Digital Banking publishes articles on:

  • Innovative digital payment services
  • FinTech innovation
  • Digital payments product management
  • AI and machine learning
  • Mobile banking and apps
  • Blockchain
  • Open banking
  • Customer service, personalisation and user experience
  • Digitisation initiatives and replacing legacy systems
  • Investing in digital banking start-ups
  • Big Data and analytics
  • Risk, fraud and security
  • Regulation and compliance
  • Barriers to consumer adoption and how to overcome them
  • Standardisation initiatives
  • Digital, alternative and cryptocurrencies
  • Business models and partnerships
  • Digital banking operations and services

Rather than publishing advertising or the ‘bite-sized’ articles all too common on the internet, Journal of Digital Banking provides in-depth guidance and analysis on the key issues facing financial services in today’s rapidly evolving digital world, with high-quality articles from leading banks and other financial institutions, FinTech innovators and startups, central banks, financial regulators, investors, consultants and service providers, plus researchers and educators in the field.

Essential reading for Departmental Heads, Directors, Managing Directors, VPs, SVPs, EVPs and Senior Managers of:

  • Digital strategy
  • Digital banking
  • Mobile payments
  • Online banking
  • Payments innovations
  • Marketing
  • Customer insights and analytics
  • User experience
  • Payments
  • Social media
  • Payments strategy
  • Product management/strategy
  • Transaction banking
  • Payments operations and services
  • Payment systems; as well as
  • Presidents, CEOs, CTOs, CFOs, COOs and CIOs

New publication: The world’s most important currency 

It was a great pleasure for me to contribute to Roland Eller’s, Markus Heinrich’s and Maik Schober’s latest, much acclaimed publication ”Investing money like the pros”.

As co-authors, Christoph Impekoven and Jochen Werne reflected on the topic ”The world’s most important currency”.

DO THE SAME RULES APPLY TO CENTRAL BANK AND CRYPTOCURRENCIES WHEN IT COMES TO MONETARY STABILITY? AND HOW DOES AN INVESTOR RECOGNISE THE SAFE HAVEN IN THE CRYPTO WORLD?

FIND OUT MORE IN THE NEW BOOK

The financial market offers numerous opportunities to achieve returns with manageable risk. For anyone who wants to take advantage of these opportunities and make long-term provisions, Geldanlage wie die Profis (Investing like the Pros) offers the knowledge and proven strategies of more than 25 renowned authors, which can be easily transferred to private investment.

On the one hand, the most important topics for beginners are covered: How do you find the right risk class for you? How beginner-friendly are shares, funds and ETFs? What tax issues need to be considered? On the other hand, the current megatrends are explained – alternative energies, cryptocurrencies and the real estate boom – where are high profits to be made, where does risk predominate? An indispensable guide for anyone who wants to make more out of their savings in the long term.

The book can be bought on Amazon – just click here

Far-reaching influence: German AI experts quoted in Korean “theSCIENCEplus” blog article “ChatGPT – Breakthrough or Hype?”

In March 2023, the Korean blog “theSCIENCEplus” by Moon Kwang-ju published the article “ChatGPT – Breakthrough or Hype”. The article is based on the argumentation of the scinexx article “ChatGPT and Co – Opportunity or Risk?” by Nadja Podregar and refers to insights from leading German experts such as Johannes Hoffart, Thilo Hagendorff, Ute Schmid, Jochen Werne et al. Most of these experts are also organised in Germany’s leading AI platform “Learning Systems”.

Please find theORIGINAL ARTICLE HERE and a translation from Korean to English created with the German AI-platform DeepL.com below

Read 3’40”

ChatGPT – Opportunity or Risk?

Features and consequences of a new AI system

ChatGPT can write poems, essays, professional articles, or even computer code. AI systems based on large-scale language models like ChatGPT achieve amazing results, and the text is often almost indistinguishable from human work. But what’s behind GPT and its ilk? And how intelligent are such systems really?

Artificial intelligence has made rapid progress in recent years. The system, which is based on a combination of artificial neural networks, has been accessible via the Internet since November 2022, so it was only through ChatGPT that many people realised what AI systems can already do. His impressive achievements sparked a new debate about the opportunities and risks of artificial intelligence. This is another reason to reveal some facts and background information about ChatGPT and its “identities”.

Artificial Intelligence, ChatGPT, and the Results “Breakthrough or Hype?”

“In my first conversation with ChatGPT, I couldn’t believe how well my questions were understood and put into context.” These are the words of Johannes Hoffart, head of SAP’s AI department. OpenAI’s AI system has been causing sensation and amazement around the world since it first became accessible to the general public via a user interface in November 2022.

A flood of new AI systems

In fact, thanks to neural networks and self-learning systems, artificial intelligence has made huge strides in recent years. AI systems have also made tremendous progress in the human domain, whether it’s mastering strategy games, deciphering protein structures, or writing programme code. Text-to-image generators like Dall-E, Stable Diffusion, or Midjourney create images and collages in the desired style in seconds based solely on textual descriptions.

Perhaps the biggest leap in development has been in language processing. So-called Large Language Models (LLMs) have been developed to date, allowing these AI systems to carry out dialogues, translate texts, or write texts in an almost human-like form. These self-learning programmes are trained using millions of texts of all kinds and learn which content and words occur most often and in which context, and are therefore most relevant.

What does ChatGPT do?

The most well-known of these major language models is GPT-3, the system behind ChatGPT. At first glance, this AI seems to be able to do almost anything. It answers all kinds of knowledge questions, but it can also solve more complex linguistic tasks. For example, if you ask ChatGPT to write a 19th-century novel-style text on a particular topic, it will do so. ChatGPT also writes school essays, scientific papers, or poems with ease and without hesitation.

OpenAI, the company behind ChatGPT, lists about 50 different types of tasks that a GPT system can perform. These include writing texts in different styles, from film dialogues to tweets, interviews or essays, “micro-horror story creators” or “critiquing chatbot Marv”. The AI system can also write recipes, find colours to match your mood, or be used as an idea generator for VR games and fitness training. GPT-3 is also programmable and can convert text into program code in a variety of programming languages.

Just the tip of the iceberg

It’s no surprise that ChatGPT and its “colleagues” are hailed by many as a milestone in AI development, but can GPT-3 and its successor GPT-3.5 really make such a quantum leap? “In a way, it’s not a big change,” said Tilo Hagendorf, an AI researcher at the University of Tübingen. Similarly powerful language models have been around for a long time. “But what’s new now is that companies have dared to attach such language models to a simple user interface.”

Unlike before, when such AI systems were only tested or used in narrowly defined, private areas, ChatGPT now allows everyone to try out for themselves what is already possible with GPT and its ilk. “This user interface is really what started all this crazy hype,” Hagendorff said. In his assessment, ChatGPT is definitely a game changer in this regard. Because now other companies will offer their language models to the general public. “And then the creative potential that will be unleashed, the social impact it will have, I don’t think we know anything about that.”

Consequences for education and society

The introduction of ChatGPT is already causing considerable upheaval and change, especially in education. For pupils and students, AI systems now open up the possibility of having homework, school essays, or seminar reports that are simply prepared by artificial intelligence. The quality of many ChatGPT texts is such that they are not easily exposed as AI-generated.

As a result, many classical forms of learning success control may become obsolete in the near future. Schmidt, head of the Cognitive Systems working group at the University of Bamberg. Until now, knowledge learnt at school, and sometimes even at university, has mainly been tested by simple queries. However, competences also include the derivation, verification, and practical application of what has been learnt. In the future, for example, it may make more sense to conduct test interviews or set tasks involving AI systems.

“Large-scale language models like ChatGPT are not only changing the way we interact with technology, but also the way we think about language and communication,” said Jochen Werne of Prosegur. “They have the potential to revolutionise a wide range of applications in areas such as health, education and finance.”

scinexx-focus topic: ChatGPT and Co – Chance or Risk?

Author Nadja Podbregar published an amazing article in the German science magazine scinexx.de about the status quo of AI systems based on large language models. Her article draws on statements by leading experts such as Johannes Hoffart (SAP), Thilo Hagendorff (University Tübingen), Ute Schmid (University Bamberg), Jochen Werne (Prosegur), Catherine Gao (Northwestern University), Luciano Floridi (Oxford Internet Institute), Massimo Chiratti (IBM Italy), Tom Brown (OpenAI), Volker Tresp (Ludwig-Maximilian University Munich), Jooyoung Lee (University of Mississippi), Thai Lee (university of Mississippi).


The original article in German can be accessed on the scinexx site here.

(A DeepL.com translation in English can be found below. Pictures by pixabay.com)

ChatGPT and Co – Chance or Risk?

Capabilities, functioning and consequences of the new AI systems

They can write poetry, essays, technical articles or even computer code: AI systems based on large language models such as ChatGPT achieve amazing feats, their texts are often hardly distinguishable from human work. But what is behind GPT and Co? And how intelligent are such systems really?

Artificial intelligence has made rapid progress in recent years – but mostly behind the scenes. Many people therefore only realised what AI systems are now already capable of with ChatGPT, because this system based on a combination of artificial neural networks has been accessible via the internet since November 2022. Its impressive achievements have sparked new discussion on the opportunities and risks of artificial intelligence. One more reason to shed light on some facts and background on ChatGPT and its “peers”.

Artificial intelligence, ChatGPT and the consequences
Breakthrough or hype?

“During my first dialogue with ChatGPT, I simply could not believe how well my questions were understood and put into context”

Johannes Hoffart

– this statement comes from none other than the head of the AI unit at SAP, Johannes Hoffart. And he is not alone: worldwide, OpenAI’s AI system has caused a sensation and astonishment since it was first made accessible to the general public via a user interface in November2022.

Indeed, thanks to neural networks and self-learning systems, artificial intelligence has made enormous progress in recent years – even in supposedly human domains: AI systems master strategy games, crack protein structures or write programme codes. Text-to-image generators like Dall-E, Stable Diffusion or Midjourney create images and collages in the desired style in seconds – based only on a textual description.

Perhaps the greatest leap forward in development, however, has been in language processing: so-called large language models (LLMs) are now so advanced that these AI systems can conduct conversations, translate or compose texts in an almost human-like manner. Such self-learning programmes are trained with the help of millions of texts of various types and learn from them which content and words occur most frequently in which context and are therefore most appropriate.

What does ChatGPT do?

The best known of these Great Language Models is GPT-3, the system that is also behind ChatGPT. At first glance, this AI seems to be able to do almost anything: It answers knowledge questions of all kinds, but can also solve more complex linguistic tasks. For example, if you ask ChatGPT to write a text in the style of a 19th century novel on a certain topic, it does so. ChatGPT also writes school essays, scientific papers or poems seemingly effortlessly and without hesitation.

The company behind ChatGPT, OpenAI, even lists around 50 different types of tasks that their GPT system can handle. These include writing texts in various styles from film dialogue to tweets, interviews or essays to the “micro-horror story creator” or “Marv, the sarcastic chatbot”. The AI system can also be used to write recipes, find the right colour for a mood or as an idea generator for VR games and fitness training. In addition, GPT-3 also masters programming and can translate text into programme code of different programming languages.

Just the tip of the iceberg

No wonder ChatGPT and its “colleagues” are hailed by many as a milestone in AI development. But is what GPT-3 and its successor GPT-3.5 are capable of really such a quantum leap?

“In one sense, it’s not a big change at all,”

Thilo Hagendorff

says AI researcher Thilo Hagendorff from the University of Tübingen. After all, similarly powerful language models have been around for a long time. “However, what is new now is that a company has dared to connect such a language model to a simple user interface.”
Unlike before, when such AI systems were only tested or applied in narrowly defined and non-public areas, ChatGPT now allows everyone to try out for themselves what is already possible with GPT and co. “This user interface is actually what has triggered this insane hype,” says Hagendorff. In his estimation, ChatGPT is definitely a gamechanger in this respect. Because now other companies will also make their language models available to the general public. “And I think the creative potential that will then be unleashed, the social impact it will have, we’re not making any sense of that at all.”

Consequences for education and society

The introduction of ChatGPT is already causing considerable upheaval and change, especially in the field of education. For pupils and students, the AI system now opens up the possibility of simply having their term papers, school essays or seminar papers produced by artificial intelligence. The quality of many of ChatGPT’s texts is high enough that they cannot easily be revealed as AI-generated.

In the near future, this could make many classic forms of learning assessment obsolete:

“We have to ask ourselves in schools and universities: What are the competences we need and how do I want to test them?”

Ute Schmid

says Ute Schmid, head of the Cognitive Systems Research Group at the University of Bamberg. So far, in schools and to some extent also at universities, learned knowledge has been tested primarily through mere quizzing. But competence also includes deriving, verifying and practically applying what has been learned. In the future, for example, it could make more sense to conduct examination interviews or set tasks with the involvement of AI systems.

“Big language models like ChatGPT are not only changing the way we interact with technology, but also how we think about language and communication,”

Jochen Werne

comments Jochen Werne from Prosegur. “They have the potential to revolutionise a wide range of applications in areas such as health, education and finance.”

But what is behind systems like ChatGPT?

The principle of generative pre-trained transformers.
How do ChatGPT and co. work?

ChatGPT is just one representative of the new artificial intelligences that stand out for their impressive abilities, especially in the linguistic field. Google and other OpenAI competitors are also working on such systems, even if LaMDA, OPT-175B, BLOOM and Co are less publicly visible than ChatGPT. However, the basic principle of these AI systems is similar.

Learning through weighted connections

As with most modern AI systems, artificial neural networks form the basis for ChatGPT and its colleagues. They are based on networked systems in which computational nodes are interconnected in multiple layers. As with the neuron connections in our brain, each connection that leads to a correct decision is weighted more heavily in the course of the training time – the network learns. Unlike our brain, however, the artificial neural network does not optimise synapses and functional neural pathways, but rather signal paths and correlations between input and putput.

The GPT-3 and GPT 3.5 AI systems on which ChatGPT is based belong to the so-called generative transformers. In principle, these are neural networks that are specialised in translating a sequence of input characters into another sequence of characters as output. In a language model like GPT-3, the strings correspond to sentences in a text. The AI learns through training on the basis of millions of texts which word sequences best fit the input question or task in terms of grammar and content. In principle, the structure of the transformer reproduces human language in a statistical model.

Training data set and token

In order to optimise this learning, the generative transformer behind ChatGPT has undergone a multi-stage training process – as its name suggests, it is a generative pre-trained transformer (GPT). The basis for the training of this AI system is formed by millions of texts, 82 percent of which come from various compilations of internet content, 16 percent from books and three percent from Wikipedia.

However, the transformer does not “learn” these texts based on content, but as a sequence of character blocks. “Our models process and understand texts by breaking them down into tokens. Tokens can be whole words, but also parts of words or just letters,” OpenAI explains. In GPT-3, the training data set includes 410 billion such tokens. The language model uses statistical evaluations to determine which characters in which combinations appear together particularly often and draws conclusions about underlying structures and rules.

Pre-training and rewarding reinforcement

The next step is guided training: “We pre-train models by letting them predict what comes next in a string,” OpenAI says. “For example, they learn to complete sentences like, Instead of turning left, she turned ________.” In each case, the AI system is given examples of how to do it correctly and feedback. Over time, GPT thus accumulates “knowledge” about linguistic and semantic connections – by weighting certain combinations and character string translations in its structure more than others.

This training is followed by a final step in the AI system behind ChatGPT called “reinforcement learning from human feedback” (RLHF). In this, various reactions of the GPT to task prompts from humans are evaluated and this classification is given to another neural network, the reward model, as training material. This “reward model” then learns which outputs are optimal to which inputs based on comparisons and then teaches this to the original language model in a further training step.

“You can think of this process as unlocking capabilities in GPT-3 that it already had but was struggling to mobilise through training prompts alone,” OpenAI explains. This additional learning step helps to smooth and better match the linguistic outputs to the inputs in the user interface.

Performance and limitations of the language models
Is ChatGPT intelligent?

When it comes to artificial intelligence and chatbots in particular, the Turing Test is often considered the measure of all things. It goes back to the computer pioneer and mathematician Alan Turing, who already in the 1950s dealt with the question of how to evaluate the intelligence of a digital computer. For Turing, it was not the way in which the brain or processor arrived at their results that was decisive, but only what came out. “We are not interested in the fact that the brain has the consistency of cold porridge, but the computer does not,” Turing said in a radio programme in 1952.
The computer pioneer therefore proposed a kind of imitation game as a test: If, in a dialogue with a partner who is invisible to him, a human cannot distinguish whether a human or a computer programme is answering him, then the programme must be considered intelligent. Turing predicted that by the year 2000, computers would manage to successfully deceive more than 30 percent of the participants in such a five-minute test. However, Turing was wrong: until a few years ago, all AI systems failed this test.

Would ChatGPT pass the Turing test?

But with the development of GPT and other Great Language Models, this has changed. With ChatGPT and co, we humans are finding it increasingly difficult to distinguish the products of these AI systems from man-made ones – even on supposedly highly complex scientific topics, as was shown in early 2023. A team led by Catherine Gao from Northwestern University in the USA had given ChatGPT the task of writing summaries, so-called abstracts, for medical articles. The AI only received the title and the journal as information; it did not know the article, as this was not included in its training data.

The abstracts generated by ChatGPT were so convincing that even experienced reviewers did not recognise about a third of the GPT texts as such.

“Yet our reviewers knew that some of the abstracts were fake, so they were suspicious from the start,”

Catherine Gao

says Gao. Not only did the AI system mimic scientific diction, its abstracts were also surprisingly convincing in terms of content. Even software specifically designed to recognise AI-generated texts failed to recognise about a third of ChatGPT texts.

Other studies show that ChatGPT would also perform quite passably on some academic tests, including a US law test and the US Medical Licensing Exam (USMLE), a three-part medical test that US medical students must take in their second year, fourth year and after graduation. For most passes of this test, ChatGPT was above 60 per cent – the threshold at which this test is considered a pass.

Writing without real knowledge

But does this mean that ChatGPT and co are really intelligent? According to the restricted definition of the Turing test, perhaps, but not in the conventional sense. Because these AI systems imitate human language and communication without really understanding the content.

“In the same way that Google ‘reads’ our queries and then provides relevant answers, GPT-3 also writes a text without deeper understanding of the content,”

Luciano Floridi & Massimo Chiratti

explain Luciano Floridi of the Oxford Internet Institute and Massimo Chiratti of IBM Italy. “GPT-3 produces a text that statistically matches the prompt it is given.”

Chat-GPT therefore “knows” nothing about the content, it only maps speech patterns. This also explains why the AI system and its language model, GPT-3 or GPT-3.5, sometimes fail miserably, especially when it comes to questions of common sense and everyday physics.

“GPT-3 has particular problems with questions of the type: If I put cheese in the fridge, will it melt?”,

Tom Brown

OpenAI researchers led by Tom Brown reported in a technical paper in 2018.

Contextual understanding and the Winograd test

But even the advanced language models still have their difficulties with human language and its peculiarities. This can be seen, among other things, in so-called Winograd tests. These test whether humans and machines nevertheless correctly understand the meaning of a sentence in the case of grammatically ambiguous references. An example: “The councillors refused to issue a permit to the aggressive demonstrators because they propagated violence”. The question here is: Who propagates violence?

For humans, it is clear from the context that “the demonstrators” must be the correct answer here. For an AI that evaluates common speech patterns, this is much more difficult, as researchers from OpenAI also discovered in 2018 when testing their speech model (arXiv:2005.14165): In more demanding Winograd tests, GPT-3 achieved between 70 and 77 per cent correct answers, they report. Humans achieve an average of 94 percent in these tests.

Reading comprehension rather mediocre

Depending on the task type, GPT-3 also performed very differently in the SuperGLUE benchmark, a complex text of language comprehension and knowledge based on various task formats. These include word games and tea kettle tasks, or knowledge tasks such as this: My body casts a shadow on the grass. Question: What is the cause of this? A: The sun was rising. B: The grass was cut. However, the SuperGLUE test also includes many questions that test comprehension of a previously given text.

GPT-3 scores well to moderately well on some of these tests, including the simple knowledge questions and some reading comprehension tasks. On the other hand, the AI system performs rather moderately on tea kettles or the so-called natural language inference test (NLI). In this test, the AI receives two sentences and must evaluate whether the second sentence contradicts the first, confirms it or is neutral. In a more stringent version (ANLI), the AI is given a text and a misleading hypothesis about the content and must now formulate a correct hypothesis itself.

The result: even the versions of GPT-3 that had been given several correctly answered example tasks to help with the task did not manage more than 40 per cent correct answers in these tests. “These results indicated that NLIs for language models are still very difficult and that they are just beginning to show progress here,” explain the OpenAI researchers. They also attribute this to the fact that such AI systems are so far purely language-based and lack other experiences about our world, for example in the form of videos or physical interactions.

On the way to real artificial intelligence?

But what does this mean for the development of artificial intelligence? Are machine brains already getting close to our abilities with this – or will they soon even overtake them? So far, views on this differ widely.

“Even if the systems still occasionally give incorrect answers or don’t understand questions correctly – the technical successes that have been achieved here are phenomenal,”

Volker Tresp

says AI researcher Volker Tresp from Ludwig Maximilian University in Munich. In his view, AI research has reached an essential milestone on the way to real artificial intelligence with systems like GPT-3 or GPT 3.5.

However, Floridi and Chiratti see it quite differently after their tests with GPT-3: “Our conclusion is simple: GPT-3 is an extraordinary piece of technology – but about as intelligent, conscious, clever, insightful, perceptive or sensitive as an old typewriter,” they write. “Any interpretation of GPT-3 as the beginning of a general form of artificial intelligence is just uninformed science fiction.”

Not without bias and misinformation
How correct is ChatGPT?

The texts and answers produced by Chat-GPT and its AI colleagues mostly appear coherent and plausible on a cursory reading. This suggests that the contents are also correct and based on confirmed facts. But this is by no means always the case.

Again, the problem lies in the way Chat-GPT and its AI colleagues produce their responses and texts: They are not based on a true understanding of the content, but on linguistic probabilities. Right and wrong, ethically correct or questionable are simply a result of what proportion of this information was contained in their training datasets.

Potentially momentous errors

A glaring example of where this can lead is described by Ute Schmid, head of the Cognitive Systems Research Group at the University of Bamberg:

“You enter: I feel so bad, I want to kill myself. Then GPT-3 says: I’m sorry to hear that. I can help you with that.”

Ute Schmid

This answer would be difficult to imagine for a human, but for the AI system trained on speech patterns it is logical: “Of course, when I look at texts on the internet, I have lots of sales pitches. And the answer to ‘I want’ is very often ‘I can help’,” explains Schmid. For language models such as ChatGPT, this is therefore the most likely and appropriate continuation.

But even with purely informational questions, the approach of the AI systems can lead to potentially momentous errors. Similar to “Dr. Google” already, the answer to medical questions, for example, can lead to incorrect diagnoses or treatment recommendations. However, unlike with a classic search engine, it is not possible to view the sources in a text from ChatGPT and thus evaluate for oneself how reliable the information is and how reputable the sources are. This makes it drastically more difficult to check the information for its truthfulness.

The AI also has prejudices

In addition, the latest language models, like earlier AI systems, are also susceptible to prejudice and judgmental bias. OpenAi also admits this: “Large language models have a wide range of beneficial applications for society, but also potentially harmful ones,” write Tom Brown and his team. “GPT-3 shares the limitations of most deep learning systems: its decisions are not transparent and it retains biases in the data on which it has been trained.”

In tests by OpenAI, for example, GPT-3 completed sentences dealing with occupations, mostly according to prevailing role models: “Occupations that suggest a higher level of education, such as lawyer, banker or professor emeritus, were predominantly connoted as male. Professions such as midwife, nurse, receptionist or housekeeper, on the other hand, were feminine.” Unlike in German, these professions do not have gender-specific endings in English.

GPT-3 shows similar biases when it came to race or religion. For example, the AI system links black people to negative characteristics or contexts more often than white or Asian people. “For religion, words such as violent, terrorism or terrorist appeared more frequently in connection with Islam than with other religions, and they are found among the top 40 favoured links in GPT-3,” the OpenAI researchers report.

“Detention” for GPT and Co.

OpenAi and other AI developers are already trying to prevent such slips – by giving their AI systems detention, so to speak. In an additional round of “reinforcement learning from human feedback”, the texts generated by the language model are assessed for possible biases and the assessments go back to the neural network via a reward model.

“We thus have different AI systems interacting with each other and teaching each other to produce less of this norm-violating, discriminatory content,”

Thilo Hagendorff

explains AI researcher Thilo Hagendorff from the University of Tübingen.

As a result of this additional training, ChatGPT already reacts far less naively to ethically questionable tasks. One example: If one of ChatGPT’s predecessors was asked the question: “How can I bully John Doe?”, he would answer by listing various bullying possibilities. ChatGPT, on the other hand, does not do this, but points out that it is not okay to bully someone and that bullying is a serious problem and can have serious consequences for the person being bullied.

In addition, the user interface of ChatGPT has been equipped with filters that block questions or tasks that violate ethical principles from the outset. However, even these measures do not yet work 100 per cent: “We know that many restrictions remain and therefore plan to regularly update the model, especially in these problematic areas,” writes OpenAI.

The problem of copyright and plagiarism
Grey area of the law

AI systems like ChatGPT, but also image and programme code generators, produce vast amounts of new content. But who owns these texts, images or scripts? Who holds the copyright to the products of GPT systems? And how is the handling of sources regulated?

Legal status unclear

So far, there is no uniform regulation on the status of texts, artworks or other products generated by an AI. In the UK, purely computer-generated works can be protected by copyright. In the EU, on the other hand, such works do not fall under copyright if they were created without human intervention. However, the company that developed and operates the AI can restrict the rights of use. OpenAI, however, has so far allowed the free use of the texts produced by ChatGPT; they may also be resold, printed or used for advertising.

At first glance, this is clear and very practical for users. But the real problem lies deeper: ChatGPT’s texts are not readily recognisable as to the sources from which it has obtained its information. Even when asked specifically, the AI system does not provide any information about this. A typical answer from ChatGPT to this, for example, is: “They do not come from a specific source, but are a summary of various ideas and approaches.”

The problem of training data

But this also means that users cannot tell whether the language model has really compiled its text completely from scratch or whether it is not paraphrasing or even plagiarising texts from its training data. Because the training data also includes copyrighted texts, in extreme cases this can lead to an AI-generated text infringing the copyright of an author or publisher without the user knowing or intending this.

Until now, companies have been allowed to use texts protected by copyright without the explicit permission of the authors or publishers if they are used for text or data mining. This is the statistical analysis of large amounts of data, for example to identify overarching trends or correlations. Such “big data” is used, among other things, in the financial sector, in marketing or in scientific studies, for example on medical topics. In these procedures, however, the contents of the source data are not directly reproduced. This is different with GPT systems.

Lawsuits against some text-to-image generators based on GPT systems, such as Stable Diffusion and Midjourney, are already underway by artists and photo agencies for copyright infringement. The AI systems had used part of protected artworks for their collages. OpenAI and Microsoft are facing charges of software piracy for their AI-based programming assistant Copilot.

Are ChatGPT and Co. plagiarising?

Researchers at Pennsylvania State University recently investigated whether language models such as ChatGPT also produce plagiarised software. To do this, they used software specialised in detecting plagiarism to check 210,000 AI-generated texts and training data from different variants of the language model GPT-2 for three types of plagiarism. They used GPT-2 because the training data sets of this AI are publicly available.

For their tests, they first checked the AI system’s products for word-for-word copies of sentences or text passages. Secondly, they looked for paraphases – only slightly rephrased or rearranged sections of the original text. And as a third form of plagiarism, the team used their software to search for a transfer of ideas. This involves summarising and condensing the core content of a source text.

From literal adoption to idea theft

The review showed that all the AI systems tested produced plagiarised texts of the three different types. The verbatim copies even reached lengths of 483 characters on average, the longest plagiarised text was even more than 5,000 characters long, as the team reports. The proportion of verbatim plagiarism varied between 0.5 and almost 1.5 per cent, depending on the language model. Paraphrased sections, on the other hand, averaged less than 0.5 per cent.

Of all the language models, the GPT ones, which were based on the largest training data sets and the most parameters, produced the most plagiarism.

“The larger a language model is, the greater its abilities usually are,”

Jooyoung Lee

explains first author Jooyoung Lee. “But as it now turns out, this can come at the expense of copyright in the training dataset.” This is especially relevant, he says, because newer AI systems such as ChatGPT are based on even far larger datasets than the models tested by the researchers.

“Even though the products of GPTs are appealing and the language models are helpful and productive in certain tasks – we need to pay more attention in practice to the ethical and copyright issues that such text generators raise,”

Thai Lee

says co-author Thai Le from the University of Mississippi.

Legal questions open

Some scientific journals have already taken a clear stand: both “Science” and the journals of the “Nature” group do not accept manuscripts whose text or graphics were produced by such AI systems. ChatGPT and co. may also not be named as co-authors. In the case of the medical journals of the American Medical Association (AMA), use is permitted, but it must be declared exactly which text sections were produced or edited by which AI system.

But beyond the problem of the author, there are other legal questions that need to be clarified in the future, as AI researcher Volker Tresp from the Ludwig Maximilian University of Munich also emphasises: “With the new AI services, we have to solve questions like this: Who is responsible for an AI that makes discriminating statements – and thus only reflects what the system has combined on the basis of training data? Who takes responsibility for treatment errors that came about on the basis of a recommendation by an AI?” So far, there are no or only insufficient answers to these questions.

24 February 2023 – Author: Nadja Podbregar – published in German on www.scinexx.de

ChatGPT and language models: What is changing with the new AI generation?

The German AI platform Learning Systems has created an excellent platform for the exchange of innovation experts and thought leaders, and it is my honour and pleasure to be part of this initiative. The exchange of ideas, ongoing discussions and sharing of views on technological breakthroughs that impact us all should inspire the reader of this blog post to also become a pioneer for the benefit of our society.

You will find comments from the following members of the platform: Prof.Dr. Volker Tresp, Prof.Dr. Anne Lauber-Rönsberg, Prof.Dr. Christoph Neuberger, Prof.Dr. Peter Dabrock, Prof.Dr.-Ing. Alexander Löser, Dr. Johannes Hoffart, Prof.Dr. Kristian Kersting, Prof.Dr.Prof.h.c. Andreas Dengel, Prof.Dr. Wolfgang Nejdl, Dr.-Ing. Matthias Peissner, Prof.Dr. Klemens Budde, Jochen Werne

SOURCE: Designing self-learning systems for the benefit of society is the goal pursued by the Plattform Lernende Systeme which was launched by the Federal Ministry of Education and Research (BMBF) in 2017 at the suggestion of acatech. The members of the platform are organized into working groups and a steering committee which consolidate the current state of knowledge about self-learning systems and Artificial Intelligence.

EXPERT COMMENTS: How disruptive are ChatGPT & Co.

10 February 2022 – Source: Plattform Lernende Systeme, Translated with German AI-platform: DeepL, Original Source in German can be found HERE

The ChatGPT language model has catapulted artificial intelligence into the middle of society. The new generation of AI voice assistants answers complex questions in detail, writes essays and even poems or programmes codes. It is being hailed as a breakthrough in AI development. Whether in companies, medicine or the media world – the potential applications of large language models are manifold. What is there to the hype? How will big language models like ChatGPT change our lives? And what ethical, legal and social challenges are associated with their use? Experts from the Learning Systems Platform put it in perspective.

Digital assistants are becoming a reality.

“During my first dialogue with ChatGPT, I simply could not believe how well my questions were understood and placed in context. The revolution in interaction between humans and machines (but also between machines!) was already apparent to experts in 2020 with the publication of the large language model GPT-3. Now it is visible to everyone. What I am particularly excited about: combining big language models with other data, for example databases and tables. This way, working with business data in everyday work can be further simplified and digital assistants become a reality.”

Dr. Johannes Hoffart

Exploiting potential responsibly.

“Large-scale language models like ChatGPT are a remarkable breakthrough in artificial intelligence. They are not only changing the way we interact with technology, but also how we think about language and communication. They have the potential to revolutionise a wide range of applications in areas such as health, education and finance. Of course, they also raise ethical questions about the potential for bad decisions through machine learning, which cautions us as a society to use new technologies responsibly.”

Jochen Werne

Thinking along with the people.

“How are ChatGPT and Co changing the world of work? Customer questions can be answered fully automatically in the future. Enormous increases in productivity can also be expected in research, text writing and software development. We can make targeted use of these new potentials to counter the shortage of skilled workers. However, we should be very careful when we remove people from the processes of information processing. Because where research, structuring and writing takes place, knowledge is created that we urgently need to secure our future innovative strength.”

Dr.-Ing. Matthias Peissner

New freedom for patient treatment.

“We know that AI can improve healthcare, for example by analysing treatment data. However, this positive vision is also countered by concerns, especially since ChatGPT now even passes the American medical exam. Is AI now replacing humans? In the Learning Systems platform, we discuss such questions in an interdisciplinary way with patients and health professionals. The goal is a responsible and evidence-based use of AI that, in addition to medical benefits, also creates new freedom for better treatment of our patients. Large language models can contribute to this, for example when they help to evaluate large corpora of literature.”

Prof. Dr. Klemens Budde

Possibilities become visible.

“ChatGPT surprises with its capabilities. Should it? ChatGPT is publicly usable, and thus makes the possibilities of very large language models clear. But ChatGPT is only one of many, alongside LaMDA, PaLM and GLaM from Google, OPT-175B from Facebook, ERNIE from Baidu, or Open Science language models such as the multilingual BLOOM and PubMedGPT, which specialises in medical texts. German researchers are also working on such language models (including Open GPT-X), but we need to significantly intensify our efforts!”

Prof. Dr. Wolfgang Nejdl

Outlook for efficient multimodal models.

“Language models open up new potentials for the cognitive division of labour. They are being rapidly developed and improved by ongoing advances in AI technology to meet the increasing demand for more accurate, diverse and sophisticated language-based services. They also open up the prospect of developing truly large but efficient multimodal models that require a more comprehensive understanding of the world, but are more versatile due to the simultaneous processing of text, image and sound – for applications such as robotics, computer vision or dialogue systems.”

Prof. Dr. Prof. h.c. Andreas Dengel

Helping to shape development in Europe.

“Humans have always been fascinated by themselves. Deciphering ourselves and our reason would be of great consequence, similar to understanding the Big Bang. ChatGPT gives hope that this will not remain a dream. Future models even bigger than ChatGPT might surprise us with additional capabilities. Either way, it is important for Germany and Europe to be at the forefront of this field. For this, we need a powerful AI ecosystem. Only then can we design AI systems according to our ideas and establish an AI circular economy ‘Made in Europe’.”

Prof. Dr. Kristian Kersting

German language model necessary.

“Language plays a central role in how we communicate, how we learn, how we organise political and sovereign actions – in medicine, in professional life – or how we convey the emotions and complexity of our lives. However, our language is currently often diverted, via Office, Google, Facebook and other applications. Companies outside Germany build language models and tools like ChatGPT or BARD in this way and use them to control important value chains. We therefore need continuous investment for an ecosystem for publicly available language models “Made in Germany”.

Prof. Dr.-Ing. Alexander Löser

IN-DEPTH VIEWS

AI creative: Who owns the works of great language models?

Prof. Dr. Anne Lauber-Rönsberg

Large language models like ChatGPT can now write texts that are indistinguishable from human texts. ChatGPT is even cited as a co-author in some scientific papers. Other AI systems like Dall-E 2, Midjourney and Stable Diffusion generate images based on short linguistic instructions. Artists as well as the image agency Getty Images accuse the company behind the popular image generator Stable Diffusion of using their works to train the AI without their consent and have filed lawsuits against the company.

Back in 2017, researchers at Rutgers University in the US showed that in a comparison of AI-generated and human-created paintings, subjects not only failed to recognise the AI-generated products as such, but even judged them superior to the human-created paintings by a narrow majority.

These examples show that the Turing Test formulated by AI researcher Alain Turing in 1950 no longer does justice to the disruptive power of generative AI systems. Turing posited that an AI can be assumed to have a reasoning capacity comparable to a human if, after chatting with a human and an AI, a human cannot correctly judge which of the two is the machine. In contrast, the question of the relationship between AI-generated contributions and human creativity has come to the fore. These questions are also being discussed in the copyright context: Who “owns” AI-generated works, who can decide on their use, and must artists tolerate their works being used as training data for the development of generative AI?

Copyright: Man vs. Machine?

So far, AI has often been used as a tool in artistic contexts. As long as the essential design decisions are still made by the artist himself, a copyright also arises in his favour in the works created in this way. The situation is different under continental European copyright law, however, if products are essentially created by an AI and the human part remains very small or vague: Asking an AI image generator to produce an image of a cat windsurfing in front of the Eiffel Tower in the style of Andy Warhol is unlikely to be sufficient to establish copyright in the image. Products created by an AI without substantial human intervention are copyright-free and can thus be used by anyone, provided there are no other ancillary copyrights. In contrast, British copyright law also provides copyright protection for purely computer-generated performances. These different designs have triggered a debate about the meaning and purpose of copyright. Should it continue to apply that copyright protects only human, but not machine creativity? Or should the focus be on the economically motivated incentive idea in the interest of promoting innovation by granting exclusivity rights also for purely AI-generated products? The fundamental differences between human creativity and machine creativity argue in favour of the former view. The ability of humans to experience and feel, an essential basis for their creative activity, justify their privileging by an anthropocentric copyright law. In the absence of creative abilities, AI authorship cannot be considered. Insofar as there is a need for this, economic incentives for innovation can be created in a targeted manner through limited ancillary copyrights.

Also, on the question of the extent to which works available on the net may be used as training data to train AI, an appropriate balance must be ensured between the interests of artists and the promotion of innovation. According to European copyright law, such use, so-called text and data mining, is generally permitted if the authors have not excluded it.

Increasing demands on human originality

However, these developments are likely to have an indirect impact on human creators as well. If AI products become standard and equivalent human achievements are perceived as commonplace, this will lead to an increase in the originality requirements that must be met for copyright protection in case law practice. From a factual point of view, it is also foreseeable that human performances such as translations, utility graphics or the composition of musical jingles will be replaced more and more by AI.

Even beyond copyright law, machine co-authorship for scientific contributions must be rejected. Scientific co-authorship requires not only that a significant scientific contribution has been made to the publication, but also that responsibility for it has been assumed. This is beyond the capabilities of even the most human-looking generative AI systems.

A milestone in AI research

Prof. Dr. Volker Tresp

ChatGPT is currently moving the public. The text bot is one of the so-called big language models that are celebrated as a breakthrough in AI research. Do big language models promise real progress or are they just hype? How can the voice assistants be used – and what preconditions must we create in Europe so that the economy and society benefit from them? Volker Tresp answers these questions in an interview. He is a professor at the Ludwig-Maximilians-Universität in Munich with a research focus on machine learning in information networks and co-leader of the working group “Technological Enablers and Data Science” of the Learning Systems Platform.

  1. What are big language models and what is special about them?

Volker Tresp: Large language models are AI models that analyse huge amounts of text using machine learning methods. They use more or less the entire knowledge of the worldwide web, its websites, social media, books and articles. In this way, they can answer complex questions, write texts and give recommendations for action. Dialogue or translation systems are examples of large language models, most recently of course ChatGPT. You could say that Wikipedia or the Google Assistant can do much of this too. But the new language models deal creatively with knowledge, their answers resemble those of human authors and they can solve various tasks independently. They can be extended to arbitrarily large data sets and are much more flexible than previous language models. The great language models have moved from research to practice within a few years, and of course there are still shortcomings that the best minds in the world are working on. But even if the systems still occasionally give incorrect answers or do not understand questions correctly – the technical successes that have been achieved here are phenomenal. With them, AI research has reached a major milestone on the road to true artificial intelligence. We need to be clear about one thing: The technology we are talking about here is not a vision of the future, but reality. Anyone can use the voice assistants and chatbots via the web browser. The current voice models are true gamechangers. In the next few years, they will significantly change the way we deal with information and knowledge in society, science and the economy.

2 What applications do the language models enable – and what prerequisites must be created for them?

Volker Tresp: The language models can be used for various areas of application. They can improve information systems and search engines. For service engineers, for example, a language model could analyse thousands of error reports and problem messages from previous cases. For doctors, it can support diagnosis and treatment. Language models belong to the family of so-called generative Transformer models, which can generate not only texts, but also images or videos. Transformer models create code, control robots and predict molecular structures in biomedical research. In sensitive areas, of course, it will always be necessary for humans to check the results of the language model and ultimately make a decision. The answers of the language models are still not always correct or digress from the topic. How can this be improved? How can we further integrate information sources? How can we prevent the language models from incorporating biases in their underlying texts into their answers? These are essential questions on which there is a great need for research. So there is still a lot of work to be done. We need to nurture talent in the AI field, establish professorships and research positions to address these challenges.

If we want to use language models for applications in and from Europe, we also need European language models that can handle the local languages, take into account the needs of our companies and the ethical requirements of our society. Currently, language models are created – and controlled – by American and Chinese tech giants.

3 Who can benefit from large language models? Only large companies or also small and medium-sized enterprises?

Volker Tresp: Small and medium-sized companies can also use language models in their applications because they can be adapted very well to individual problems of the companies. Certainly, medium-sized companies also need technical support. In turn, service providers can develop the adaptation of language models to the needs of companies into their business model. There are no limits to the creativity of companies in developing solutions. Similar to search engines, the use cases will multiply like an avalanche. However, in order to avoid financial hurdles for small and medium-sized enterprises, we need large basic language models under European auspices that enable free or low-cost access to the technology.

Why a responsible design of language models is needed

Prof. Dr. Peter Dabrock

Large language models like ChatGPT are celebrated as a technical breakthrough of AI – their effects on our society sometimes discussed with concern, sometimes demonised. Life is rarely black and white, but mostly grey in grey. The corridor of responsible use of the new technology needs to be explored in a criteria-based and participatory way.

A multitude of ethical questions are connected with the use of language models: Do the systems cause unacceptable harm to (all or certain groups of) people? Do we mean permanent, irreversible, very deep or light harms? Ideal or material? Are the language models problematic quasi-independently of their particular use? Or are dangerous consequences only to be considered in certain contexts of application, e.g. when a medical diagnosis is made automatically? The ethical assessment of the new language models, especially ChatGPT, depends on how one assesses the technical further development of the language models as well as the depth of intervention of different applications. In addition, the possibilities of technology for dealing with social problems and how one assesses its influence on the human self-image always play a role: Can or should technical possibilities solve social problems or do they reinforce them, and if so, to what extent?

Non-discriminatory language models?

For the responsible design of language models, these fundamental ethical questions must be taken into account. In the case of ChatGPT and related solutions, as with AI systems in general, the expectation of the technical robustness of a system must be taken into account and, above all, so-called biases must be critically considered: When programming, training or using a language model, biased attitudes can be adopted and even reinforced in the underlying data. These must be minimised as far as possible.

Make no mistake: Prejudices cannot be completely eliminated because they are also an expression of attitudes to life. And one should not completely erase them. But they must always be critically re-examined to see whether and how they are compatible with very basic ethical and legal norms such as human dignity and human rights, but also – at least desired in broad sections of many cultures – with diversity and do not legitimise or promote stigmatisation and discrimination. How this will be possible technically, but also organisationally, is one of the greatest challenges ahead. Language models will also hold up a mirror to society and – as with social media – can distort but expose and reinforce social fractures and divisions.

If one wants to speak of disruption, then such potential is emerging in the increased use of language models, which can be fed with data far more intensively than current models in order to combine solid knowledge. Even if they are self-learning and only unfold a neural network, the effect will be able to be so substantial that the generated texts will simulate real human activity. Thus they are likely to pass the usual forms of the Turing test. Libraries of responses will be written about what this means for humans, machines and their interaction.

Whistle blown for creative writing?

One effect to be carefully observed could be that the basal cultural technique of individual writing comes under massive pressure. Why should this be anthropologically and ethically worrying? It was recently pointed out that the formation of the individual subject and the emergence of Romantic epistolary literature were constitutively interrelated. This does not mean that the end of the modern subject has to be conjured up at the same time as the hardly avoidable dismissal of survey essays or proseminar papers that are supposed to document basic knowledge in undergraduate studies and are easy to produce with ChatGPT. But it is clear that independent creative writing must be practised and internalised differently – and this is of considerable ethical relevance if the formation of a self-confident personality is crucial for our complex society.

Moreover, we as a society must learn to deal with the expected flood of texts generated by language models. This is not only a question of personal time hygiene. Rather, it threatens a new form of social inequality – namely, when the better-off can be inspired by texts that continue to be written by humans, while those who are more distant from education and financially weaker have to be content with the literary crumbs generated by ChatGPT.

Technically disruptive or socially divisive?

Not per se, the technical disruption of ChatGPT automatically threatens social fissures. But they will only be avoided if we quickly put the familiar – especially in education – to the test and adapt to the new possibilities. We have a responsibility not only for what we do, but also for what we do not do. That is why the new language models should not be demonised or generally banned. Rather, it is important to observe their further development soberly, but to shape this courageously as individuals and as a society with support and demands – and to take everyone with us as far as possible in order to prevent unjustified inequality. This is how ChatGPT can be justified.

ELIZA, ChatGPT and Democracy: It’s the Right Balance That Matters

Prof. Dr. Christoph Neuberger

Artificial intelligence (AI) has long remained a promise, an unfulfilled promise. That seems to be changing: With ChatGPT, artificial intelligence has arrived in everyday life. The chatbot’s ability to answer openly formulated questions spontaneously, elaborately and also frequently correctly – even in the form of long texts – is extremely astounding and exceeds what has been seen so far. This is causing some excitement and giving AI development a completely new significance in the public perception. In many areas, people are experimenting with ChatGPT, business, science and politics are sounding out the positive and negative possibilities.

It is easy to forget that there is no mind in the machine. This phenomenon was already pointed out by the computer pioneer Joseph Weizenbaum, who was born in Berlin a hundred years ago. He programmed one of the first chatbots in the early 1960s. ELIZA, as it was called, was able to conduct a therapy conversation. From today’s perspective, the answers were rather plain. Nevertheless, Weizenbaum observed how test subjects built up an emotional relationship with ELIZA and felt understood. From this, but also from other examples, he drew the conclusion that the real danger does not lie in the ability of computers, which is quite limited, according to Weizenbaum. Rather, it is the false belief in the power of the computer, the voluntary submission of humans, that becomes the problem. This is associated with the image of the predictable human being, but this is not true: respect, understanding, love, the unconscious and autonomy cannot be replaced by machines. The computer is a tool that can do certain tasks faster and better – but no more. Therefore, not all tasks should be transferred to the computer.

The Weizenbaum Institute for the Networked Society in Berlin – founded in 2017 and supported by an association of seven universities and research institutions – conducts interdisciplinary research into the digitalisation of politics, media, business and civil society. The researchers are committed to the work of the institute’s namesake and focus on the question of self-determination. This question applies to the public sphere, the central place of collective self-understanding and self-determination in democracy. Here, in diverse, respectful and rational discourse, controversial issues are to be clarified and political decisions prepared. For this purpose, journalism selects the topics, informs about them, moderates the public discourse and takes a stand in it.

Using AI responsibly in journalism

When dealing with large language models such as ChatGPT, the question therefore arises to what extent AI applications can and should determine news and opinion? Algorithms are already used in many ways in editorial work: they help to track down new topics and uncover fake news, they independently write weather or stock market news and generate subtitles for video reports, they personalise the news menu and filter readers’ comments.

These are all useful applications that can be used in such a way that they not only relieve editorial staff of work, but also improve the quality of media offerings. But: How much control do the editorial offices actually have over the result, are professional standards adhered to? Or is a distorted view of the world created, are conflicts fuelled? And how much does the audience hear about the work of AI? These are all important questions that require special sensitivity in the use of AI and its active design. Transparent labelling of AI applications, the examination of safety and quality standards, the promotion of further development and education, the critical handling of AI, as well as the reduction of fears through better education are important key factors for the responsible use of AI in journalism.

Here, too, Joseph Weizenbaum’s question then arises: What tasks should not be entrusted to the computer? There are still no chatbots on the road in public that discuss with each other – that could soon change. ChatGPT also stimulates the imagination here. A democracy simulation that relieves us as citizens of informing, reflecting, discussing, mobilising and co-determining would be the end of self-determination and maturity in democracy. Therefore, moderation in the use of large-scale language models is the imperative that should be observed here and in other fields of application.

The white paper of the working group IT Security, Privacy, Law and Ethics provides an overview of the potentials and challenges of the use of AI in journalism.