I suspect it may have something to do with specific 4G bands, especially those high frequency ones like 2.1 GHz, 2.6 GHz or 3.8 GHz. Not only the cells of those bands are smaller (and in case of 3.8 GHz really small) than in case of typical 2G and 3G frequencies like 900 MHz or 1800/1900 MHz, but additionally the signal is more prone to obstacles, which further reduces its range. The result is that in certain situations there is A LOT of switching between neighbouring cells and between bands. Using e.g. CellMon you can observe how your phone sometimes switches between several neighbouring base stations, or between different bands of the same cell (e.g. 2100 MHz and 2600 MHz) like crazy, e.g. every 10-20 seconds or so. And when those switches take place, I often see corresponding momentary power consumption spikes. I also suspect that this is something that prevents the device from sleeping as it needs to constantly interact with the mobile network.
I did not have those problems when I lived in a location away from city center where 800 and 900 MHz 4G bands were mostly used. Last year I moved to the city center and now with 2.1 and 2.6 GHz bands being used I have this problem nearly all the time.