he visitors took the lead almost immediately after kick-off.
A long ball over the top found Jordan Young who controlled well, and after working his way into the area, placed a shot into the bottom right-hand corner.
Guiseley started to get back into the game with Lewis Hey seeing his header blocked, although it looked to be going narrowly wide.
Leeds United news: Whites-linked international agrees to join Premier League rivals as Marsch hails Bamford decision
Leeds United ‘would have taken’ four points from two games according to Alan Shearer
Leeds United ‘have not’ approached pair but in transfer ‘talks’
Leeds United transfer news: former Leeds target ‘agrees’ £38m Wolves move, Man Utd ‘weighing up’ move fore Leicester City forward
Leeds United's new predicted Premier League finish after double boost with new lows for rivals
George Cantrill then fired a low-range drive just past the post for the home side, yet neither team could truly take control of the game as the visitors still led 1-0 at the break.
Gloucester controlled possession during the opening stages of the second half, but did not add to their advantage and that would soon be vital as Guiseley continued to create chances.
A break by the hosts saw the ball go to Kaine Felix who was tackled, but it fell to Lebrun Mbeka who hit a powerful shot that flew into the net.
Guiseley would then take the lead minutes later. Good work by Regan Hutchinson saw him place a pass across goal and all Tom Harrison could do was stick a leg out and it went in.
The game started to turn a bit scrapy in the final stages, but chances were few and far between with the hosts holding on to claim a deserved victory.
Speaking after the match, Lions joint-manager Russ O’Neill was delighted with his side’s display.
He said: “It was a good performance by us. This is an important victory. We obviously didn’t make the best of starts but we kept going and we regrouped. That kind of performance is something we can certainly build on.
“I felt we fully deserved the result, in chances for and shots on target we did well.”
Tomorrow, Guiseley travel to play ninth-placed Gateshead (3pm).
Elsewhere, Luke Parkin’s 87th-minute equaliser maintained sixth-placed Farsley Celtic’s unbeaten start to the season at Kettering.
Isaac Stones had opened the scoring for the hosts on 54 minutes but with the clock ticking down, Tom Donaghy’s long ball forward was flicked on to Jimmy Spencer and the frontman played an excellent ball with the outside of his foot through to Parkin who kept his cool to fire home.
Celtic host fifth-placed Blyth Spartans tomorrow (3pm).
Bradford Park Avenue’s match at Chorley was abandoned after away midfielder Jake Hibbs sustained a serious injury following an incident that saw home defender Harvey Smith red carded.
York City have made their worst start to a league season in 34 years following a 2-1 home loss to Brackley. Akil Wright’s first-half strike was cancelled out by two goals in the last six minutes from Matt Lowe and Lee Ndlovu, leaving the Minstermen without a point from their opening three fixtures.