We exploit the interlayer coupling of a cross-layer design concept for streaming video delivery in a multiuser wireless environment. We propose a cross-layer optimization between application layer, data link layer, and physical layer. Our aim is to optimize the end-to-end quality of the wireless streaming video application as well as efficiently utilizing the wireless resources. A possible architecture for achieving this goal is proposed and formulated. This architecture consists of the process of parameter abstraction, a cross-layer optimizer, and the process of decision distribution. In addition, numerical results obtained with different operating modes are provided. The results demonstrate the potential of this proposed joint optimization.