After a slow start that saw them fall behind just nine minutes into the game courtesy of Emmaculate Mawuna, the Green Machine hit back with two second-half goals.
Emmanuel Mandiranga equalized in the 85th minute after connecting a cross from substitute Rodwell Chinyengetere.
The winning goal, a daring shot from 45 yards came from defender Ben Musaka exactly a minute from full time.
Musaka’s exquisite shot sparked wild party scenes in the stands, with the entire technical bench on their feet at once to batter in the air.
It created happy scenes with the same fans who turned on the Chitembwe the previous week when Makepekepe lost to Yadah Stars chanting “Tinoteerera Chitembwe” in praise of the gaffer.
The win means CAPS United now have 34 points with five matches before the end of the season.