12 Comments
User's avatar
Thomas Baudel's avatar

This is the distinction Aristotle makes between deduction and induction. Both are valid methods to acquire knowledge, even though they both have limits.

Yet, Aristotle also exposes other means of reaching conclusions, such as abduction (A => B, A likely, I see B, I deduct A, such as: "if I wake up in the morning and see the grass in my garden is wet, I deduct it has rained during the night").

Expand full comment
Alexander Naumenko's avatar

I agree that statistical methods are not the way to go. I think the same about logical methods. I have gone to develop a theory of intelligence to be used as the foundation for a novel AI paradigm that potentially can address the issues of current systems.

Consider reading this - https://alexandernaumenko.substack.com/p/intelligence-and-language

Expand full comment
Andreas Wandelt's avatar

Saw your post via linkedIn; I am very much with you on this as far as current practices, overblown expectations GenAI etc. are concerned. Just thinking:

When it comes to your distinction between errors due to limited human experience vs. stochastic mechanisms in machines: We are not Vulcans; not logical machines. Looking at Asch's conformity experiments, Kahnemann's and Twersky's work etc., I would argue that human decision making quality is influenced quite strongly by all kinds of quasi-stochastic influences, from social conformity, via all our other biases (recency bias etc.) to fatigue and stress at home.

Are you not making an assumption like the classical economists did with their "homo oeconomicus"? I can follow your conclusions if I make that assumption. If I look at real-life situations, I would argue that the effect matters more: Looking at the sum of all influences, does the decision making of "AI" in whatever evolved form produce better results than human decision making.

Looking at the recent publication about the neuronal pattern firing in an LLM when it sees the a misspelt word "rihgt" being very different whether that is a coding context or an essay: Is that not the very rudimentary start of abstraction/contextual understanding?

I am fully with you that current systems are not there yet. Just not sure about your "never" claim. I see artificial systems evolving to other ways of learning (e.g. robotic bodies giving experience with space and time), and with refined architectures. Yet, they will still be neural nets, and I see no *principal* difference.

Can "knowledge", can epistemiologigal categories not emerge from pattern matching? Are you sure this is not what happened in humans?

Expand full comment
David Hsing's avatar

"Can "knowledge", can epistemiologigal categories not emerge from pattern matching? Are you sure this is not what happened in humans?"

This thought experiment of mine gives you the answer- The same answer that Searle gave decades ago:

You memorize a whole bunch of shapes. Then, you memorize the order the shapes are supposed to go in so that if you see a bunch of shapes in a certain order, you would “answer” by picking a bunch of shapes in another prescribed order. Now, did you just learn any meaning behind any language?

Expand full comment
Andreas Wandelt's avatar

The Chinese room experiment does IMHO not apply to what I proposed. I totally agree that current systems, based on language alone, do not cut it, and I think I wrote as much. I proposed systems which we would evolve, for example by adding learning/experience dimensions beyond language (robot body). That breaks the logic of that experiment, any sensimotorical input wax deliberately excluded in that. The trained entity would still be a neural net, though, and if I understood you correctly, you said neural nets can in principle not cross that threshhold. If you meant that in a narrow way, like "neural nets trained on language alone cannot..." then we are in agreement, but this was not my point.

Expand full comment
David Hsing's avatar

"adding learning/experience dimensions beyond language (robot body). " Do you realize that's hand waving? What does that "body" take as input and what does it process? Does it handle physical/electrical loads like every single machine there is and ever will be? You haven't thought this through one bit. It must handle loads, and that locks it in. Machines work by moving loads.

Expand full comment
Andreas Wandelt's avatar

Disengaging from this thread as well. I leave it up to you to decide for yourself whether that is because I have realized that *I* don't think things through well enough, or because I have realized that *you* don't. I think every reader of this will be able to make up their own mind on the answer.

Peace

Expand full comment
David Hsing's avatar

"human decision making quality is influenced quite strongly by all kinds of quasi-stochastic influences" Influences of X doesn't determine X in any way. The mind is the mind and the influences aren't the mind. Logic 101.

"I would argue that the effect matters more" ...That's behaviorism. Explain why I should give that line of thinking any credit whatsoever.

Expand full comment
Andreas Wandelt's avatar

Your statement on influences not determining the influenced in any way is for me nonsensical, and your statement of the mind being the mind, and the influences not being the mind is for me trivial and beside the point. Sorry that I was unsuccessful in finding any deeper meaning in them. Likely not worth the effort to go down the rabbit hole and define the terms, so let us not do that.

Your claim on behaviorism is factually wrong. Skinner argued that *only* the observable effect matters. I deliberately did not say that.

I will disengage from following up on this particular thread. My naturally evolved pattern matching algorithm detects the epistemiological category of "dogma" :-)

Peace!

Expand full comment
David Hsing's avatar

Influences are not determinants. A speed limit sign may influence me to do something, but that's not the determinant. Do I need to dumb it down more? Look up the dictionary definitions of the words "influence" and "determinant". You're acting like those school kids that call me "dogmatic" whenever I point out simple facts.

Expand full comment
David Fleming's avatar

I can give you the diagrams to the COVID 19 CRISPR recipe sent from one single UNC brilliant, wise, well meaning scientist six months prior to its receipt by an equally brilliant, well intended Wuhan virologist. No, we don't make a mistake on flawed zero tolerance ethics. 5MM dead, 15MM permanently impaired globally. You didn't read these two culprits got executed for their crime, right? Because their motives were good. They still work today. Understand? It is no longer evil intent by a bad actor or rogue nation. It is the nice folks that must be contained. Feel free to disagree.

Expand full comment