Hi, I went Kaza Last year and Stayed at Zostel. I must say It was one of the best decisions of mine on that trip.
Not only it is cheaper but also the ambience is quite good. Although other options are also available there like local Homestays or hotels but still If you want ambience that too in budget then maybe you should go with Zostel.
Hey, you can try zostel there. But I would personally recommend you to look for a home stay. Because it is comparatively cheaper than any hostel or hotel. And also you can get an idea of the lifestyle of the people living there.