The first Test in Port of Spain was drawn after rain curtailed play on three of the five days.
"The batters need to be a lot more ruthless. The guys who get the opportunity to settle in, must really go on and get a base score for the team that will give us a lot more time from a bowling point of view," Bavuma said ahead of the match, which starts on Thursday.
"There was obviously a little bit of frustration at the fact that with a little bit more time, a result could have been possible."
It is expected to be a docile pitch in Guyana, as it was in Trinidad and Tobago where South Africa attempted to bowl out the West Indians in the last two sessions of the final day but fell five wickets short.
"I think the bowlers did as best as they could, considering what was in front of them. There was a miraculous effort from Keshav (Maharaj), basically bowling of half the overs of the innings."
Bavuma was among three South Africans, along with Tony de Zorzi and Tristan Stubbs, who scored half-centuries in the first Test.
"The confidence is growing within the team, it's a young, inexperienced side. I think it's just a case of us working on that, putting it all together, which I believe will really make us a formidable team," Bavuma added.
