I'm on the same dose at the moment - 50mg i take it at the same time and feel like i start crashing by about 2-3pm. My psychiatrist mentioned it but then was reluctant to give me an extra top up of adderall last time I spoke to him but I'm going to push for it next time I see him. I'd be a mess if i had to do anything in the evening after taking the vyvanse in the morning. But the effects are good generally and very few side effects for me.
Are you sure you aren't just worn out by the evening?