how is everyone overcoming the number of vlans supported by physical switch

We are using a switch that support 4000 vlans but we are trying to push all those vlans to 20+ servers. The switch will support 4000 vlans but it sees each vlan to each server as a logical interface. It seems to be limited in the number of logical interfaces that it can trace. I believe it is loosely tied to spanning-tree. If you have 20 servers with 4000 vlans trunked to them that is 80000 logical interfaces the switch has to track. It supports a maximum of 32000. Has anyone one else seen this issue and if so how did you deal with it? I thought maybe break the cluster into small number of servers then only push 1000 per cluster to each server but the development team says that they loose flexibility and it would require duplicating the network nodes.