To toggle visibility of file and folder names in cover view, just use the buttons indicated in the screenshot below.

iPhone showing cover view with toggle button for file names highlighted
iPad showing cover view with toggle button for file names highlighted