So I went and tried it.
This is as far back as it could go for me:
July 2008 is the closest any service has gotten. I did begin there July 29, 2008. But it seems there are still some earlier tweets from that day it couldn’t get.
All of you who tweeted far less are bound to have better luck with TweetScan Backup.