We judge ourselves of what we think we can do, while others judge us by what we've done. For that, if you think you can, do it immediately
Not that slow growth should you fear. However, you should be more afraid to not grow at all. Then grow yourself with it at any speed.