Not quite. There is a Clara Smith record on the linked list, and there were several Columbia adverts for Bessie Smith records in TMW in 1923, see e.g. A3936 where you can also find a small article with the headline, "Bessie Smith's Records Popular".
By the way, Columbia left this out of its listings in The Talking Machine World.
I find it interesting that they released this music in their regular popular series, but then did not bother to list it in the main stream trade publication. Apparently, blues sung by an African American performer was only interesting to a niche audience of other African Americans back in 1923.
The Talking Machine World, October 15, 1923, page 197: Advance Record Bulletins for November, 1923 (actually released in late October 1923).
Ethel Ridley (vocal) cut the outstanding "Alabama Bound Blues" in New York on 23 June 1923, accompanied by Leroy Tibbs on the piano.
Tibbs' provides slow piano accompaniment to Ethel's very fine vocal as she expresses her disdain for her cheating man as she has already found a replacement lover waiting for her in Alabama:-
Get away from my window, don't knock at my door [twice]
Got another daddy, don't want you no more
I can't use you, 'cause you ain't no good [twice]
Got another daddy waiting to tap my wood
I don't want you, here's my right hand [twice]
You go to your woman, I'll go back to my man
Number 7 in the station, number 11 in the yard [twice]
Gonna leave this town if I have to ride the rod
I'm leavin' town to wear you off my mind
I've been mistreated and I don't mind dyin'
I'll buy me a ticket long as my right arm
Right to where you think I'm dead and gone
I'm Alabama bound
"I Don't Let One Man Worry Me", which was cut on the same day and in the same location, also has slow piano accompaniment and a wordless vocal section for most of the first minute, as Ethel declares she always keeps two or three men on her mind so she doesn't have to worry about any one man giving her grief.
A good performance but nowhere near as good as the A-side.