The easiest way to grow rosemary outdoors is to grow the plant in containers. If your rosemary is in containers, start acclimating the plant to the diminished light it will receive when brought indoors. Rosemary requires full sun and even the brightest window is not the same as a sunny garden.
Note: Images are illustration purpose only. Actual item maybe different due to image quality enhancements.