You'll see these stories popping up all over, and if the story isn't about your district, chances are it will be stoking some administrators Fear Of Missing Out. But the FOMO seems sadly misplaced.
Greenwich Time ran its story by Jessica Simms about the Greenwich School District's new chatbot under the headline, "Meet Greenwich Public Schools new chatbot who won't say why the district got rid of tacos at lunch," and that's the closest it comes to taking a critical look at this Connecticut school district's addition of a cutesy chatbot.
Does a story about a chatty LLM website mascot have to take a critical look? Yes, it does, because every story about "AI" should be reckoning with the question. "Is this worth the power, ecological and financial cost?" (Also, will it fail disastrously and compromise student data in the process?) "Does it have a cute avatar attached" probably shouldn't be near the top of the list.
The GPS website has a cute chat invite in the bottom corner, not unlike the standard help-chat box on many sites (all of which trigger, for persons of a Certain Age, Clippy-related trauma). It greets you-
My name is G.P. Sleuthhound and I am relentless and stubborn on a scent. I serve as the Greenwich Public Schools chatbot.
As my name tells you, I can do one thing better than any creature on earth: track down the answer to your question on our website.
How can I help?
The district's director of communications says the department is loaded with dog lovers, and bloodhound is on point, so there we are. G.P. even has a little deerstalker hat. According to the district, the chatbot is "a more advanced search bar," except that LLMs don't make particularly good search engines. Also, this product is confined to the school's website, which means the job doesn't require a particularly clever search engine any way.
The district is using AlwaysOn, a company that promises turnkey chatbots for districts. The company was founded in 2021 and "sponsors" many states' Public Relations Associations (like California's version). Located in Newport Beach, CA, its name guarantees that it is hard to track on line. Its LinkedIn profile says it has 2-10 employees.
AlwaysOn was founded by Teddy Daiber. Daiber graduated from Brown University with a degree in economics (and some history on the Lacrosse Field, including big time private high school play). Daiber was an analyst at Barclays, worked the commodities desk at Citi, the started founding things. In 2014 it was Poolit, an online content save-and-share outfit, then in 2016, Head of Customer Success for Informed K12, a workflow automation operation for schools.
In 2021, he was launching his new business. The Oct/Nov 2021 issue of the Palm Springs Unified School District news letter announced a new chatbot for helping navigate the website, including some quotes from Daiber, listed there as the CEO of Otto Technologies. At that point, the product was Otto Chatbot, launched in the spring, with PSUSD as one of its first customers. Daiber and district admins are excited about how the product helps people find information on the website (which begs the question, "How much of this would be unnecessary is more school websites sucked less?")
An awful lot of the pitch does seem to be about being able to search the website for information. Here's what the AlwaysOn website says about the chatbot-search engine distinction:
Website search is just a keyword search with no intelligence and limited data. Search doesn’t improve over time and is completely dependent on what words you use in your search. Search lacks conversational or discovery features that create a great customer experience, and all the work is on the stakeholder to sort through the results to find the best information.
Chatbots use Artificial Intelligence and Natural Language Processing to interpret and understand what exactly a stakeholder wants when they ask a question. Chatbots organize and return the best answers and information. Chatbots also automatically improve from each interaction, work in multiple languages, and provide insightful analytics on the most popular questions and topics.
A chatbot can "interpret and understand exactly what a stakeholder wants when they ask a question"??! That is some powerful magic indeed.
The company is clear on where the chatbot can search (just your school site) but not so clear on how and on what content the bot has been trained. It is clear that it does not save personal user info, but collects general info with an aim to analyze what people are trying to find out.
Attaching the AI label to this dedicated search program invites users to imagine capabilities that it doesn't have. Simms looked through questions that have been asked and found items like "why did they get rid of tacos" and "who does the most work at GPS." The chatbot couldn't answer those.
I tried the chatbot out myself. "When were Greenwich schools founded?" I asked. "Various times," G.P. replied, then went on to provide the info about just one school, plus info about the founding of the town. I asked who the youngest staff member is. The chatbot replied with a bunch of excerpts from the website that included the word "youngest." I asked it "who teaches the highest level of English" and it replied "The highest level of English is taught by Certified English Language Learner (ELL) teachers in Greenwich Public Schools." All of its answers come with a link to the location on the website where it found its answer.
I asked it if Monday's lunch will be delicious. It told me that this month the cafeteria is featuring "delicious zucchini." I asked it to write me a limerick about kindergarten. It gave me a list of excerpts from the website that list the word "kindergarten."
Yeah, this "chatbot" turns out to be not very good at interpreting and understanding what the user really wants, and mostly functions like a mediocre search engine. But it does let the school district declare that it is right out there on the cutting edge with some of that AI stuff that is supposed to be so cool, even if the cutting edge looks a lot like search engines from five years ago.
AlwaysOn and Greenwich schools just happen to be the ones that crossed my screen-- there are loads more of these things out there. School districts with a bad case of FOMO teaming up with vendors who have figured out that AI is a great marketing tool. You remember when Common Core was The Big Thing and every publisher slapped "Common Core" on their same old stuff because it helped with marketing? The AI revolution in education feels a lot like that.
It would all be kind of cute and amusing if AI weren't using up money and electricity and water and computing capacity that could be put to better use than creating an image of a bloodhound with Sherlock Holmes fashion style. Keep an eye open in your neighborhood.
Special note to journalists. It took no special ton of time or effort for me to find the background for AlwaysOn or try out its capabilities, and only slightly more regular effort to be slightly informed about AI stuff. Please make those efforts, and the next time someone shows up with a Gee Whiz press release or pitch about some AI-in-education awesome sauce, please exercise a little critical examination and research. Because if all you're going to do is take in what they say and just push it back out again, I know a digital bloodhound that can do your job.