High pressure gas time projection chambers (HPGTPCs) are made with a variety of materials, many of which still await proper characterization in high pressure noble gas environments. As HPGTPCs increase in size toward ton-scale detectors, assemblies become larger and more complex, creating a need for detailed understanding of how structural supports and high voltage insulators behave. This includes identification of materials with predictable mechanical properties and without surface charge accumulation that may lead to field deformation or sparking. This paper explores the mechanical and electrical effects of high pressure gas environments on insulating polymers PTFE, HDPE, PEEK, POM and UHMW in argon and xenon, including studying gas absorption, swelling and high voltage insulation strength.