For more than a year, Alaska’s court system has been designing a pioneering generative AI chatbot termed the Alaska Virtual Assistant (AVA) to help residents navigate the tangled web of forms and procedures involved in probate, the judicial process of transferring property away from a deceased person.
“We had trouble with hallucinations, regardless of the model, where the chatbot was not supposed to actually use anything outside of its knowledge base,” Souza told NBC News. “For example, when we asked it, ‘Where do I get legal help?’ it would tell you, ‘There’s a law school in Alaska, and so look at the alumni network.’ But there is no law school in Alaska.”
Zealousideal-Sea4830 on
Yeah hallucinations kind of make it hard to trust A.I. for legal advice, making health insurance decisions, manufacturing medical devices, managing investment portfolios, etc. Slowly getting better though.
Wapow217 on
Some hiw not shocked the top researchers at Alaska weren’t able to get it done.
3 Comments
For more than a year, Alaska’s court system has been designing a pioneering generative AI chatbot termed the Alaska Virtual Assistant (AVA) to help residents navigate the tangled web of forms and procedures involved in probate, the judicial process of transferring property away from a deceased person.
“We had trouble with hallucinations, regardless of the model, where the chatbot was not supposed to actually use anything outside of its knowledge base,” Souza told NBC News. “For example, when we asked it, ‘Where do I get legal help?’ it would tell you, ‘There’s a law school in Alaska, and so look at the alumni network.’ But there is no law school in Alaska.”
Yeah hallucinations kind of make it hard to trust A.I. for legal advice, making health insurance decisions, manufacturing medical devices, managing investment portfolios, etc. Slowly getting better though.
Some hiw not shocked the top researchers at Alaska weren’t able to get it done.