Too soon to go back to work?

I was originally going to go back to work a day after the surgery, I had it done yesterday 5/19 and planned to go back on the 21st. but then i called the doc and he said healing takes about 2 weeks. Well I can't afford to take that much time off work, especially since i took 6 weeks off right before this surgery for another surgery. So my new plan is to go back to work next tuesday, which is a week and a day to go back. Am I jumping ahead of myself? After reading all of this, it seems that it took a lot longer to heal. My job included talking, which right now is a real SOB, so I can only imagine what it will be like then. I'm on day two and the pain pills aren't helping much and when I breathe in really deep it hurts, I think maybe due to the anesthesia? Has anyone else experienced this? I know for my other surgery afterwards when I stayed in the hospital they made me use this breathing thing to build up my lungs. I of course didn't have this since it was an outpatient procedure.