Category «Legal Research Training»

Evaluating Generative AI for Legal Research: A Benchmarking Project

It is difficult to test Large-Language Models (LLMs) without back-end access to run evaluations. So to test the abilities of these products, librarians can use prompt engineering to figure out how to get desired results (controlling statutes, key cases, drafts of a memo, etc.). Some models are more successful than others at achieving specific results. However, as these models update and change, evaluations of their efficacy can change as well. Law Librarians and tech experts par excellence, Rebecca Fordon, Sean Harrington and Christine Park plan to propose a typology of legal research tasks based on existing computer and information science scholarship and draft corresponding questions using the typology, with rubrics others can use to score the tools they use.

Read more

Subjects: AI, KM, Legal Research, Legal Research Training, Legal Technology, Search Engines, Search Strategies

The Truth About Hallucinations in Legal Research AI: How to Avoid Them and Trust Your Sources

Hallucinations in generative AI are not a new topic. If you watch the news at all (or read the front page of the New York Times), you’ve heard of the two New York attorneys who used ChatGPT to create fake cases entire cases and then submitted them to the court. After that case, which resulted in a media frenzy and (somewhat mild) court sanctions, many attorneys are wary of using generative AI for legal research. But vendors are working to limit hallucinations and increase trust. And some legal tasks are less affected by hallucinations. Law Librarian and attorney Rebecca Fordon guides us to an understanding of how and why hallucinations occur and how we can effectively evaluate new products and identify lower-risk uses.

Read more

Subjects: AI, Education, KM, Legal Education, Legal Research, Legal Research Training, Search Engines, Technology Trends

The Case For Large Language Model Optimism in Legal Research From A Law & Technology Librarian

The emergence of Large Language Models (LLMs) in legal research signifies a transformative shift. This article by Sean Harrington critically evaluates the advent and fine-tuning of Law-Specific LLMs, such as those offered by Casetext, Westlaw, and Lexis. Unlike generalized models, these specialized LLMs draw from databases enriched with authoritative legal resources, ensuring accuracy and relevance. Harrington highlights the importance of advanced prompting techniques and the innovative utilization of embeddings and vector databases, which enable semantic searching, a critical aspect in retrieving nuanced legal information. Furthermore, the article addresses the ‘Black Box Problem’ and explores remedies for transparency. It also discusses the potential of crowdsourcing secondary materials as a means to democratize legal knowledge. In conclusion, this article emphasizes that Law-Specific LLMs, with proper development and ethical considerations, can revolutionize legal research and practice, while calling for active engagement from the legal community in shaping this emerging technology.

Read more

Subjects: AI, KM, Law Librarians, Legal Research, Legal Research Training, LEXIS, Search Engines, Search Strategies, Westlaw

How Can We Help To Free Legal Research From Algorithmic Bias?

Stephanie Farne, Legal Information Librarian and Lecturer in Law at Boston College Law School, raises increasingly important issues respective to the bias inherent in artificial intelligence powered search algorithms, both on the Internet and in commercial databases.

Read more

Subjects: AI, Law Librarians, Legal Education, Legal Research, Legal Research Training, Online Legal Research Services, Technology Trends

Librarian, Market Thyself

Caren Luckie, Research Attorney at Jackson Walker LLP, acknowledges what so many of us know, that during COVID work from home we have all been very busy, and in many cases, even more than in past years. With no direct, in person contact with customers and clients, Luckie offers proactive ways to build and maintain visibility and value.

Read more

Subjects: Communication Skills, KM, Law Librarians, Legal Research Training, Library Marketing, Presentation Skills, Training

Looking on the Bright Side: Four Ways Zoom Makes Legal Research Instruction Better

As many of you have surely experienced this semester, teaching legal research virtually poses a number of challenges, but Matthew Flyntz found that it also provides a few benefits over traditional in-person instruction. In a world of negativity, Flyntz looks on the bright side and focus on those positives in this article.

Read more

Subjects: Communication Skills, Continuing Legal Education, KM, Legal Research, Legal Research Training, Libraries & Librarians, Reference Services, Technology Trends, Telecommuting
➤