Currently all relays are connected all the time. Sometimes a user may have 50+ relays and follow thousands of users. We need to smart connect to relays in batches and fetch only related information when needed. This will require some smart logic and major reconstruction.
I personally don't run into this because I use less than 10 relays and only follow < 40 people. But big accounts this will matter.