Large language models: What they mean for translations

Translating, interpreting, and creating texts – artificial intelligence can already do it all. However, large language models (LLM) can go a significant step further: They use deep learning to deliver results that are supposedly indistinguishable from texts generated by humans. Although language models have come a very long way, they are reaching their limits—the limits of human culture. How language service providers are responding to automated language models.

Austria, for example, has a form of the superlative that is completely unknown in Germany. A neighbor who is making noise is described as being “laut” or loud. If they make a lot of noise, they are “zu laut” (too loud). But if they are literally making the ground shake, this now becomes “ein bisserl sehr laut” (a little bit very loud). This uniquely Austrian habit of relativizing the most severe level of criticism is not something that can be conveyed in grammatical terms—one has to understand and, above all, feel the meaning. The famous bon mot that Austrians and Germans are separated by a common language was not written by Karl Kraus, as is often claimed. However, the master satirist would probably have liked it.

What do large language models feel like?

Wer regelmäßig mit Programmen wie ChatGPT arbeitet oder zumindest damit gespielt hat, kennt den Effekt: Die Ergebnisse sind beeindruckend, echte Fehler werden immer seltener. Doch immer wieder generiert die Künstliche Intelligenz Phrasen, die sich eigenartig anfühlen, die einfach nicht zu stimmen scheinen, ohne dass man den Finger auf die konkrete Textwunde legen könnte. Kein Zufall daher, dass man von Lehrenden an Schulen oder Universitäten immer häufiger die gleiche Aussage hört: Sie würden KI-generierte Texte bereits beim ersten Anlesen erkennen. Hier liegt auch die Gefahr für Übersetzungen: wenn die Quelle schon sprachlich holpert, wird das durch die abermalige Übersetzung durch die Künstliche Intelligenz eher schlimmer als besser.

Following the footsteps of humans?

ChatGPT is one of these large language models that are specifically designed to eliminate this effect. This goal is founded on the use of deep learning technologies and artificial neural networks. Ultimately, LLMs should enable artificial intelligence to communicate in such a way that humans can no longer recognize the difference—for example, in conjunction with chatbots. This also includes the vision that AI will one day be able to detect the mood of its human counterpart and respond appropriately. However, the language models have yet to progress to this stage.

Humans are the best language models

LLMs are based on the calculation of predictions: what is the most likely way that a text will continue? For this purpose, LLMs are “fed” vast amounts of text and then trained. This training usually follows the same sequence: During unsupervised learning, the model is trained using unstructured data—which means that it automatically trawls through texts from sources such as Wikipedia, the media, or publicly accessible books. In the second step, referred to as self-supervised learning, the unstructured data is eliminated and structured data is imported. The last step involves fine-tuning, for example, in the form of positive or negative feedback. In other words, the final stage is when humans intervene in the algorithm and its results.

The insurmountable hurdle: Nuances and emotion

This is the step that will keep humans part of the equation for a long time to come. As impressive as the results of machine translation and text generation technologies are, they are unable to mimic actual speech comprehension, the nuances and emotions that are woven into texts. The other thing to consider is that language is continually evolving. As speakers and writers, we are redefining it every day. This ongoing metamorphosis cannot simply be calculated–it must be felt. One example of this relates to gendering, something that has long been established as the norm in German texts. However, most translation tools only deliver masculine forms. The massive impact of LLMs on the ability of pupils and students to work independently, about which fears have repeatedly been voiced, seems to be countered by the feel for language among educators (see above). The same applies in business settings, where humans still need to play a part in creating text.

Human and machine translations

Die Entwicklung der Sprachmodelle vom Typ LLM hat selbstverständlich auch Auswirkungen auf Sprachdienstleister. Dass die Technologie immer häufiger bessere Ergebnisse liefert als die Machine Translation (etwa durch DeepL), ist mittlerweile unumstritten. Was jedoch im Falle interner Kommunikation oder Produkt-Informationen ausreicht, kann im Zusammenhang mit Marketing, mit Verträgen oder gar medizinischen Produktinformationen schnell sehr kritisch werden. LLM sind dabei keineswegs die „Gegner“ der Sprachdienstleister – im Gegenteil: Sie erweitern deren Palette um Angebote wie Post Editing, die im ersten Schritt eine automatisierte Übersetzung bieten, die dann im zweiten Schritt von Profis überarbeitet, auf Kontext und kulturelle Unterschiede überprüft und entsprechend angepasst und optimiert wird. Die Kund:innen erhalten somit das Beste aus beiden Welten. Ein weiteres Zitat, das Karl Kraus zugeschrieben wird, lautet: „Am unverständlichsten reden die Leute daher, denen die Sprache zu nichts anderem dient, als sich verständlich zu machen.“ Falls er es wirklich so gesagt hat, hat er es gut gesagt.

Related Posts
Special Posts
Subscribe to our newsletter and find out how language solutions can make your projects more efficient globally.
Download our latest whitepaper