Intelligence: Artificial and Natural

Much to-do over Chatgpt and all those other natural language neural nets (also known as 'AI' by those who don't really understand things) these days.

Former student PS was the first to alert me to this and as soon as he told me it was pretty good at writing/explaining history and english papers/concepts, I tried it out on some physics topics I would expect my students to struggle with.  "How does anything accelerate if Newton's Third Law says for every force there is an equal and opposite force?" "If electrons are giving up energy as they pass through a resistor, how come the current doesn't decrease?"

The 'AI' did pretty poorly on these questions.  Although the sentences were coherent and smart sounding, the responses failed to actually answer the questions correctly or to address the central misconceptions.  

Here's the thing, after many years of teaching, I have learned that although almost everyone can string together sentences and use vocabulary in a sophisticated way - it is much more difficult to think logically and procedurally.  Teaching physics shows this to me every day.  All students can recite Newton's Laws back to me after I give them a short lecture on it.  But, several problem sets later with my elucidating the steps and emphasizing the underlying procedures that unlock all force problems, only about 10 percent can reliably apply this knowledge consistently in a novel situation.  

I have long been perplexed by this disconnect in students' fluency & confidence in discussing general physics concepts with me and their frustrated attempts at independent problem solving.  I really do find this as evidence that we humans are hardwired for language (which comes so naturally) and not hardwired for logic (which we have to train at length to get good at - we even invented another language (mathematics) to handle those issues separate from our usual mode of communication).

So, suffice it to say (with an admitted dose of STEM hubris) that it does not surprise me so much that neural nets trained to be excellent language processors will do a decent job at history and english assignments and yet fail at basic physics.

****

So, my day job may be secure!  In fact, an additional job that I do outside the school day has now lightened.  Future students of Rideout, rejoice - for you may read your college letter of recommendation ahead of time.  Here it is:

Truth be told, this might be better than some letters I've written in the past!

;)