How can I tell if a Generative AI system (chatbot) got its information from a specific website or other source?

 

 

Many AIs will now cite their sources, either automatically or upon request.

 

Sometimes, a chatbot will say it compiled info from multiple sources and so no citation is needed., This can be inaccurate. 

If the information comes from a single source, it's best to be able to view and cite that source, not the chatbot.

Ways to guess or investigate whether information may have come  from a particular single source:

  • Two or more chatbots produce nearly identical paragraphs
  • A more efficient way of discovering if this has happened (and of consulting the original source!) is to paste language from the answer into a search engine like Google. For instance, you may find the web page where the information was taken from. 

Each AI chatbot has different levels of reliability, and different prompts will get different results.  (Harvard faculty, staff and students may request a consultation with a librarian to review the chatbot you’re interested in.)


It is important to verify these sources. In addition to sometimes being set to speculate, AIs are only as correct as their training data, and any part of that data can be contradictory, incorrect, or out of date. While AIs are amazing, and can revolutionize our work, it's important to be aware of both their features and limitations.

Service Alert:
  • Ask a Librarian services, including chat and email, will be suspended from December 21, 2024 through January 1, 2025. Queries received during this time will be answered as soon as possible following our return on January 2.
  • If you're experiencing an ongoing technical issue when you attempt to access library materials with your HarvardKey during these times, please report it to Library Technology Services.

Chat

 

Monday-Thursday 9am-9pm

Friday-Saturday 9am-5pm

Sunday 12noon-7pm

Chat is intended for brief inquiries from the Harvard community.

Meet

Talk to a librarian for advice on defining your topic, developing your research strategy, and locating and using sources. Make an appointment now.

These services are intended primarily for Harvard University faculty, staff and students. If you are not affiliated with Harvard, please use these services only to request information about the Library and its collections.