Sorry but I think you’re requirement that something only be “the art” if any arbitrary person can critique it is off.
The frontier labs are working on the state of the art but it’s just art that you aren’t allowed to see.
Unfortunately.
It is work using the principles of the art, obviously.
But "state of the art" implies the highest state of general availability, not just in terms of access to some product, but of use of the ideas, concepts, methodologies etc.
Anthropic and OpenAI have "cutting edge" models; the state of the art is behind the cutting edge.
The state of the art is the best open source, open weights model available. More or less by definition.
That's an interesting and possibly useful distinction , but it seems unique to you. Spreading it as "We should categorize the AIs this way" would be a good argument.
But the way SOTA is generally understood by other users of the language, it refers to exactly the team, technology, & techniques defining the cutting edge in any field, regardless of the whether the technology & techniques are available outside of that team...
The Stack Exchange poster seems to be confusing "State Of The Art" with "Best Practices".
Meanwhile, Wikipedia specifically calls out "Cutting Edge" as specifically synonymous with "SOTA" [0], Cambridge defines it as "the best and most modern of its type" with zero reference to general vs limited availability in the definition or any of it's numerous examples [1], and the same from Merriam-Webster [2].
Having studied and worked in multiple technology fields ranging from software to mechanical & aero engineering for four+ decades, your post is literally the first time I've ever seen anyone even try to make such a distinction between SOTA vs CE. I think it could be a very useful distinction if it were to get into common usage, but IME it is far closer to unique than common. The sibling comments to your assertions show pretty much the same thing - it would be useful, but it isn't common.
Promote it as common and you'll find pushback. Promote it as novel and useful, and it'll likely spread.
I appreciate this distinction. The are multiple senses of SOTA and one that has been taking on greater mindshare is as a synonym of “the best available”. By rebasing on SOTA as generally available and understood versus cutting edge, which has limited distribution and leads the way, we expand the vocabulary we have available to describe what’s going on. Thanks.
