Unfortunately frameworks are not created to optimize performance. In contrast using them could drastically decrease performance. The other disadvantage of a framework is that performance issues are hard to find. If you still think you need a framework try to keep the following in mind:
Use tiny (functional) libraries that fill your needs such as requirejs for module loading or at least use a lightweight framework such as backbone.js where you can add different modules. This way you only have the functionality you really need. Frameworks like polymer (http://www.polymer-project.org) look promising but are relatively large and shouldn't be used for production code.
Frameworks that allow you to animate are quite common. Choose a framework that uses CSS animations (i.e. element.style.prop) such as move.js or newer versions of jquery and make sure you apply the CloudTV animation performance guidelines. For example if you have move.js, use element.x instead of element.add to use CSS transforms. In jquery it is a little bit harder but you could use the query.animate-enhance plugin to force translate animations.