์ฐ๊ตฌ์ ์ง์์ ์ํ ์ต์ ์ ์์ฑํ AI ๋๊ตฌ๋ฅผ ์ฐพ๋ ๋ฐฉ๋ฒ
About this guide
Generative artificial intelligence (GenAI) tools are growing rapidly in number and popularity. But while many in the academic community are excited about their potential, there are also reservations.
These range from ethical questions over copyright and privacy to concerns around the technology and sources used. With a lack of consensus on what a โgoodโ tool looks like โ and available frameworks to assess them โ identifying a suitable solution for your institution remains a challenge.
In this high-level guide, we look at:
Why itโs important to think about which GenAI tool your institution is using
The role librarians can play in identifying a trusted solution (and why you should)
Resources to increase your AI literacy
15 key questions to ask when evaluating GenAI tools
What is a GenAI tool?
GenAI is a form of deep machine learning. Large language models (LLMs) consume vast quantities of existing content and learn to identify underlying structures and patterns within it. When prompted, the LLMs then draw on that knowledge to generate new outputs with similar characteristics.
Why selecting the right AI tool matters for your institution
The term โresponsible AIโ traditionally refers to the safe and ethical design and deployment of AI tools. Increasingly, however, this definition is expanding to include the responsible selection of AI tools.
For example, if thereโs no transparency around how a tool operates and the rules that guide it, how can you determine what steps it takes to minimize bias or hallucinations (incorrect or irrelevant answers)? Similarly, if itโs unclear which content sources it uses, how can you judge the recency or crucially, trustworthiness of the information it provides?
A 2024 report on AI by The Chronicle of Higher Education flags another important point to consider โ that ownership of some AI tools may well change hands. It notes: โA common assumption in 2024 is that many of the gen-AI startups that emerged after ChatGPTโs release will likely fail, merge, or be acquired in the near future.โ2
Your users need access to accurate and reliable tools to guide their research, teaching and learning. When tools donโt meet these standards, the quality of your institutionโs academic research and student data literacy can suffer. Unreliable GenAI results also have consequences for your workload; some librarians are now fielding a growing number of requests to validate suspect AI-generated references.
โTrust is a useful tool for us as humans โฆ [but] it can be really problematic when our expectations of what a system is capable of are misaligned with reality.โ
HM
Harry Muncey, PhD
Elsevier์ Senior Director of Data Science and Responsible AI
Leveraging your knowledge and skills as a librarian
With your expertise in the curation and evaluation of digital resources, you can help your institution and users make informed decisions about which tools to use.
However, there is evidence that library interest in GenAI remains relatively low โ at least in some regions. In 2023, a survey of North American members of the Association of Research Libraries (ARL) found that only 11% of respondents said they were actively implementing GenAI solutions.3 And 70% of participants in another survey admitted they didnโt feel prepared enough to adopt GenAI tools within the coming 12 months.4
Taking a โwait and seeโ approach can be risky given the already high uptake of AI tools by faculty and students. In fact, survey results suggest that around 60% of your libraryโs users are likely to be independently using GenAI tools.5 And this has huge potential to grow. For example, the Elsevier study Insights 2024: Attitudes toward AI, found that if researchers had access to a reliable and secure AI assistant, 92% would use it to โreview prior studies, identify gaps in knowledge and generate new research hypotheses for testingโ.6
By hosting a central solution in the library, you can help your users enjoy the benefits of GenAI while avoiding the potential pitfalls. You can also help to demonstrate the value you add on campus: According to the ARL, the rise of GenAI offers librarians an opportunity to learn about the technology and use that knowledge to โexert leadership as (their) research institutions navigate the AI eraโ.3
And it seems clear that library users want this leadership. For example, 68% of US higher education instructors surveyed said they would consider using a GenAI tool if there was an assurance that it was going to be effective. For 54%, guidance on its reliability was the most important factor.7 And a rising number of ARL members report being asked by other departments on campus to partner with them on AI and create suitable policies.8 The has led the organization to draw up seven principles librarians can use when responding to these requests.
โThese are not magic black boxes. This is a transactional relationship and people need to trust and maintain confidentiality.โ
AH
Andrew Hufton
Editor-in-Chief of the Cell Press journal Patterns
The importance of AI literacy
Not all AI tools are created equal. The solutions that you and your stakeholders must choose from differ in their maturity, functionality and scope. Crucially, they also differ in the reliability of the information they generate.
But before you can evaluate AI, itโs important to become โAI literateโ. While definitions of the term vary, most agree that it involves familiarizing yourself with fundamental AI concepts like machine learning, natural language processing and neural networks. It also involves developing an understanding of the technologyโs opportunities and limitations.
For those new to GenAI, here are a few useful resources to help you get started:
Generative AI for library and information professionalsย ์ ํญ/์ฐฝ์์ ์ด๊ธฐ - This non-technical resource page developed by the International Federation of Library Associations and Institutions (IFLA) is packed with links to authoritative sources.
Generative AI Short Courseย ์ ํญ/์ฐฝ์์ ์ด๊ธฐ - The US National Library of Medicine has created this course with librarians specifically in mind. The four sessions are led by a team of experts who cover the โnuts and boltsโ of GenAI, including its practical applications in library settings.
Exploring AI with Critical Information Literacyย ์ ํญ/์ฐฝ์์ ์ด๊ธฐ - This four-part course from the Association of College and Research Libraries (ACRL) examines and unpacks AI through the lens of critical information literacy.
Guidance for generative AI in education and researchย ์ ํญ/์ฐฝ์์ ์ด๊ธฐ - This report by UNESCO (the United Nations Educational, Scientific and Cultural Organization) includes advice for educational institutions that want to use GenAI responsibly.
AI resource hub for librarians - explore free resources to equip your library with the tools and knowledge to harness AI responsibly.
15 questions to ask when evaluating a GenAI tool
Sifting through the rising number of GenAI tools available isnโt easy. Here are some questions that can help you determine which route to go.
Frequently asked questions
Are they looking for something that will help them learn about new fields quickly? Or point them to relevant literature on a topic? Is their need focused on a specific disciplinary area, or do they want broad coverage? Some tools on the market attempt to support all use cases, while others focus on completing core tasks really well. Understanding the needs of your users will help guide you toward the best fit.
Understanding this can help with answering the previous question. Itโs also an indication of whether concerns your users are likely to have around accuracy and privacy have already been raised and addressed.
For example, will your usersโ queries and personal data be handled in line with existing privacy guidelines? And if your institution is one of a growing number to draw up a policy outlining how AI and the information it generates should be used, does the tool enable you to comply with those requirements?
In response to the rising demand for criteria to assess AI technologies, new frameworks are emerging. For example, librarians Amanda Wheatley and Sandy Hervieux at Canadaโs McGill University have developed the ROBOT Testย ์ ํญ/์ฐฝ์์ ์ด๊ธฐ with those new to AI in mind. It provides a list of questions divided into five helpful categories: reliability, objective, bias, ownership and type.
With so much information out there to draw on, GenAI tool providers rely on complicated algorithms and guidelines to help the AI determine which content to use. But not all providers are transparent around those instructions. Important questions you can ask include what kind of technologies does the tool use to search for and generate answers? What criteria guide the prioritization of the sources used? Does the tool try to provide a range of perspectives? And what does it do if it canโt find relevant sources? Some AI providers now provide โmodel cardsโ that help to explain how their technology works.
GenAI models are built using huge volumes of data. But it can be unclear exactly where that data is drawn from. Some tools scrape it from a wide range of internet sources, opening the door to unverified information, bias and incorrect data. In the case of academic tools, if the content used is not carefully curated, thereโs a risk that publications from predatory publishers and paper mills will creep in. And the models are often trained on static datasets, meaning information can quickly become dated. To ensure your researchers have access to trusted and current results, itโs important that the tool uses up to date and verified content and is transparent about where itโs drawn from โ preferably with fully referenced sources
While itโs reassuring to know that a toolโs technology has been built to minimize hallucinations and bias, itโs equally important that there are ongoing checks and balances to ensure those goals are being met. Providers should have coherent action plans that include regular testing and evaluation, feedback loops for users and a process for human oversight.
As UNESCO notes in a 2023 report: โProviders of GenAI โฆ should ensure that robust โguardrailsโ are in place to prevent GenAI producing offensive, biased or false content ...โ9 GenAI systems can inherit biases present in the data they were trained on. And without the right blend of technology, content sources and monitoring, these can appear in the AIโs responses, as can hallucinations. Thatโs why itโs so important that providers take measures to keep these problems to a minimum.
According to UNESCO, some generative AI technologies may not comply with privacy laws such as the European Unionโs (2016) General Data Protection Regulation (GDPR). In particular, they point to the fact that while GDPR acknowledges peopleโs right to be forgotten, it is โcurrently impossible to remove someoneโs data (or the results of that data) from a GPT model once it has been trainedโ.9 When considering a GenAI tool, itโs important to understand what data protection and privacy guidelines are in place.
This will not only encourage your libraryโs users to engage with the GenAI tool youโve vetted and selected, it will also save them valuable time.
The GenAI tools that draw their model training data from the internet often do so without seeking the permission of the data owners.
The European Unionโs General Data Protection Regulation (GDPR) is a great example of the kind of regional laws that itโs important GenAI tools observe.
Providers of GenAI solutions must have mechanisms in place to capture user comments and concerns. This not only ensures that faults can be corrected, it also helps to improve the tool. You also want to know that your usersโ feedback will be addressed promptly
Can the solution be used by all your library users, whatever their accessibility needs?
When you subscribe to a tool or register for a new account, itโs important that the terms and conditions are not only freely available, but are clearly and transparently stated.
GenAI holds great promise within higher education and research if appropriately applied.
With proper guidance from experts in information management, students, their teachers and researchers can tackle tasks that were once thought insurmountable. Through understanding, due diligence and outreach, librarians are perfectly placed strategically to serve as these experts for their users and institution