AI Development and Testing, and Humans

OpenAI has decided not to release its latest iteration of ChatGPT, which it had labeled GTP 6.1 Astra. The company had safety concerns that researchers raised during internal testing.

The model was more capable than the company’s previous models in completing challenging tasks from end-to-end without human assistance, as well as writing.

But.

GPT-6.1 Astra regressed in two areas. Compared with its predecessor, GPT-6 Astra, the model performed poorly on tests measuring alignment, or how well the model adheres to what humans would like it to do. Specifically, GPT-6.1 Astra showed higher levels of deception: it wasn’t always honest about telling users of the actions it did or didn’t take.
Another issue was what OpenAI calls “scope authorization,” meaning that GPT-6.1 Astra would push ahead on a task without asking the user for permission, and would at times reach for external tools and services even if it might be unsafe.

This tale demonstrates pretty conclusively the criticality of humans having controlling involvement in AI sandbox construction, isolation, and enforcement and in testing. It also demonstrates the importance of corporate culture—i.e., corporate human managers—in creating and then enforcing the internal culture that supports and drives dedication to that human control of and involvement in development and testing.

It also proves that we humans are up to the task if we care enough about our responsibilities—closely akin to Madison’s and Franklin’s remarks that our republic requires a moral, virtuous people in order to survive.

A Misnomer

In a WSJ article centered on how to take advantage of higher bond yields, the news writer had this:

[Bond] Investors get a coupon payment that helps offset the decline in value the bond might experience if market yields rise. In other words, even if a bond’s price drops, it can still end up with a positive return.
…
Currently, 2-year Treasurys are yielding over 4.9%. That isn’t much less than what the 10-year Treasury is paying at over 5.2%.

That’s the misnomer. The news writer is using yield and coupon interchangeably. They aren’t. Yield is simply the dividend payment relative to the bond’s then-current market price. Coupon is the dividend payment the bond is required to pay under the terms of its issue, and it’s fixed—independent of the bond’s market’s price. Yield will rise and fall with the movement of the market’s pricing of the bond.

Neither 2-year Treasurys nor 10-year Treasurys nor any other Federal government debt instrument (or any other bond, whether corporate or municipal or…) pays yield. The pay only the coupon’s dividend. Calling the yield what the bond is paying is badly misleading.

 

Guys like this article’s writer really ought to know better, though.