As a part time traveler i always juggle between taking leaves for travel and working 9 - 5. To balance it i realize that i have to utilize weekend to feel my wander soul. Yes it is possible if you plan in well advance. I always check my calendar three months in advance and plan my weekend trips. If any long weekend is coming i would definitely take one or two days extra leave and plan for long trips. some trips were prompt where we will plan just one/two days before the weekend. But my point here is its possible to do both work and travel, it totally depends on how you manage it.
Here is how i traveled four states of India in One month.