Requires notices on generative artificial intelligence systems

• Democratic5

◆ The sponsor's argument

Why Kristen Gonzalez says this is needed

It was recently discovered that a generative artificial intelligence chatbot was fabricating claims of sexual harassment about New York lawmakers. Generative artificial intelligence opens the door for numerous benefi- cial use cases. However, as it is still in its infancy, generative AI has the potential to hallucinate that is, confidently provide false or misleading information. The user interfaces of the platforms are easy- to-use by design, so they are accessible to users who do not fully understand AI and how/ why it hallucinates false information. Therefore, it is important that users be apprise of the fact that these systems can be inaccurate, particularly when such information can be falser regarding another, or even dangerous to the user (for example, if the generative AI system provided improper medical information). An internal study has revealed that, of a sample of the 8 widely used chatbots, only 4 make their warnings consistently visible to the user on their web interface and only 3 make their warnings consistently visible to the user on their mobile interface. Of the 8 chatbots, a warning is visible at least for a short period of time on 6 chatbots on their web interface and 5 chatbots on their mobile interface (though, this means that the warning will disappear or effectively disappear after the first message or few messages are sent). After further testing of the 8 chatbots studied, at least one other chatbot repeated the false claims of sexual harassment, with the chatbot going so far as even providing the name of a fake accuser and a fabri- cated background. A third chatbot provided other, less serious, false accusations. One chatbot refused to answer any questions related to public or private persons, one chatbot refused to engage in any conver- sation related to sensitive topics, and three chatbots properly failed to provide any false information. The chatbot that originally was fabri- cating the claims of sexual harassment has since ceased doing so.

This is the sponsor's own case for the bill, quoted from their memorandum. It is not Agora's description of what the bill does.