|
![](/i/favi32.png) April 22nd-28th 2023 Ukraine’s game planThe EconomistDreams never end
The degree to which the modern world is unimagin
able without printing makes any guidance its history
might provide for speculation about
LLM
s at best par
tial, at worst misleading. Johannes Gutenberg’s devel
opment of movable type has been awarded responsi
bility, at some time or other, for almost every facet of
life that grew up in the centuries which followed. It
changed relations between God and man, man and
woman, past and present. It allowed the mass distri
bution of opinions, the systematisation of bureaucra
cy, the accumulation of knowledge. It brought into be
ing the notion of intellectual property and the pos
sibility of its piracy. But that very breadth makes com
parison almost unavoidable. As Bradford DeLong, an
economic historian at the University of California,
Berkeley puts it, “It’s the one real thing we have in
which the price of creating information falls by an or
der of magnitude.”
Printed books made it possible for scholars to roam
larger fields of knowledge than had ever before been
possible. In that there is an obvious analogy for
LLM
s,
which trained on a given corpus of knowledge can de
rive all manner of things from it. But there was more to
the acquisition of books than mere knowledge.
Just over a century after Gutenberg’s press began its
clattering Michel de Montaigne, a French aristocrat,
had been able to amass a personal library of some 1,500
books—something unimaginable for an individual of
any earlier European generation. The library gave him
more than knowledge. It gave him friends. “When I am
attacked by gloomy thoughts,” he wrote, “nothing
helps me so much as running to my books. They quick
ly absorb me and banish the clouds from my mind.”
And the idea of the book gave him a way of being
himself no one had previously explored: to put him
self between covers. “Reader,” he warned in the preface
to his
Essays
, “I myself am the matter of my book.” The
mass production of books allowed them to become pe
culiarly personal; it was possible to write a book about
nothing more, or less, than yourself, and the person
that your reading of other books had made you. Books
produced authors.
As a way of presenting knowledge,
LLM
s promise to
take both the practical and personal side of books fur
ther, in some cases abolishing them altogether. An ob
vious application of the technology is to turn bodies of
knowledge into subject matter for chatbots. Rather
than reading a corpus of text, you will question an en
tity trained on it and get responses based on what the
text says. Why turn pages when you can interrogate a
work as a whole?
Everyone and everything now seems to be pursuing
such finetuned models as ways of providing access to
knowledge. Bloomberg, a media company, is working
on Bloomberg
GPT
, a model for financial information.
There are early versions of a Quran
GPT
and a Bible
GPT
;
can a pufferjacketed Pontiff
GPT
be far behind? Mean
while several startups are offering services that turn all
the documents on a user’s hard disk, or in their bit of
the cloud, into a resource for conversational consulta
tion. Many early adopters are already using chatbots as
sounding boards. “It’s like a knowledgeable colleague
you can always talk to,” explains Jack Clark of Anthrop
ic, an
LLM-
making startup.
It is easy to imagine such intermediaries having
what would seem like personalities—not just generic
ones, such as “avuncular tutor”, but specific ones
which grow with time. They might come to be like
their users: an externalised version of their inner
voice. Or they might be like any other person whose
online output is sufficient for a model to train on (in
tellectualproperty concerns permitting). Researchers
at the Australian Institute for Machine Learning have
built an early version of such an assistant for Laurie
Anderson, a composer and musician. It is trained in
Dostları ilə paylaş: |
|
|