An alternative to

<tr>
<td>{!caseInfoRows.CaseNumber}</td>
<td>{!caseInfoRows.taskData.Subject}</td>
</tr>

is

<apex:outputText value="{!caseInfoRows.CaseNumber} /> -- <nbsp/>
<apex:outputText value="{!caseInfoRows.taskData.Subject} /><br/>

An alternative to

<tr>
<td>{!caseInfoRows.CaseNumber}</td>
<td>{!caseInfoRows.taskData.Subject}</td>
</tr>

that uses standard Visualforce components is

<apex:outputText value="{!caseInfoRows.CaseNumber} /> -- <nbsp/>
<apex:outputText value="{!caseInfoRows.taskData.Subject} /><br/>