Mine haven't stretched much at all, but I didn't size down when I bought them. The 21 oz denim seems to accommodate as much or as little stress you put them under.
It doesn't really matter when you wash them either. Wash more = fade faster. If you want to keep them darker, don't wash as often. They tighten up just a bit when you wash but ease out again within a day or 2