You may have recently seen threads on indexing discussion lists about AI. It’s a topic many of us are aware of and concerned about. At this time, however, it looks like AI chatbots based on large language models (LLMs) do not make adequate indexes. Consequently, our primary risk is not from AI per se but from authors, editors, publishers, and software developers who may lack the indexing skills to adequately/properly evaluate AI-generated indexes and recognize their shortcomings.
In response to these concerns, ASI is developing two initiatives.
First, ASI is forming an AI Committee to investigate, document, and respond to potential impacts of AI on indexing, chaired by Elizabeth Bartmess with support from Michele Combs and Jola Komornicka. Our first task is to produce two documents:
- A white paper describing LLM-generated indexes’ serious shortcomings, based on data and analysis from Elizabeth Bartmess’s ISC/SCI conference presentation last week (see link above for slides).
- An official Statement on AI that provides takeaways for authors and publishers regarding the use of LLMs for indexing. We will make this text available for other indexing societies to use or adapt if they would like to use it in crafting their own statements.
Second, ASI’s Digital Publications Indexing SIG is developing a template AI policy statement for individual indexers. This will be available for indexers who would like to put such a statement up on their website or in their client materials.
We are hard at work on all of the above and will share them as soon as they are available. Our goal is to move swiftly but thoughtfully so as to enable all of us, both as a profession and as individuals, to respond clearly and appropriately to this rapidly-changing landscape. These documents are only the first step, and we are in the process of developing a wider dissemination plan—for example, we intend to make presentations to other organizations and industry groups. We also hope that the above items will encourage and enable indexers to open up conversations with clients and associates—whether editors, publishers, or authors—about this topic.
If you know of other relevant efforts on AI and indexing, please feel free to let Elizabeth know via email.
Comments are closed.