What you are talking about is unusual. I use vectors of very large sizes on a daily basis with great efficiency.
Please include a small example code and tell us the basic characteristics of your computer and operating system.
This will make it easier for us to find the cause of the problem.