The only way I found to be able to create labels was to use lightning "input" (and related) web components with the "label" attribute.
Code excerpts as examples:
<lightning-textarea name="caseNotes" label="Quick Notes" value={quickNotes}
onkeyup={handleQuickNotesKeyUp} class="large-textarea"
field-level-help="Use this field to record temporary notes about the Case.">
</lightning-textarea>
<lightning-input label="Phone" title="Phone" name="Phone"
disabled={isNewContactProposed} value={newContact.Phone} variant=""
type="phone" onkeyup={handleContactKeyUp} onblur={handleContactBlur}
onfocus={handleContactFocus} class="newContactPhone">
</lightning-input>
<lightning-combobox name="caseRecordType" label="Record Type" onchange={handleChangeRecType}
options={optCaseTypes} value={selRecordType} class="slds-m-bottom_x-small">
</lightning-combobox>
Note, I used custom "class" values along with jQuery and/or CSS to format the labels into the structure I wanted. There was no other way to grab the "id" of the input fields as LWC appears to create the ids upon generation of the page.