It's worth it to watch Torchwood solely for Children of Earth. That was one of the best pieces of television I've seen in years. Surpassed many of the great Doctor Who eps, even.
It gets better anyways. The first series was pretty meh, but it picks up, and it does have great moments even outside CoE.
Also, after Children of Earth, I have high hopes for series 4.