SilicaListView - background for item

Have you tried Image with visible:false, if any of the items in the column has something to show?
[Edit:] And the image and the column would be on top of each other. The height of the delegate item would be
height: image.visible? image.height : column.height. Or perhaps the row height. Do you need the outermost row?