Users of the bank in Queen Street have been receiving letters this month informing them of the decision.
The branch will close on Wednesday, August 25 at noon, Barclays has confirmed.
Gareth Beevers who is a customer at the branch, said: "It's disappointing for Morley because you've got older and vulnerable people who don't have access to bank accounts.
Harrogate anger over plans to build multi-use conference centre in Leeds
Yorkshire Water issues warning on deep mud dangers as reservoir levels drop due to dry spell
Discount store offering 4,000 products for £1 and under to open in Leeds city centre
Every new shop and restaurant at White Rose Shopping Centre plus two more arrivals on the way
Leeds restaurant owner "frustrated" by up to ten no shows a night causing huge issues
"I use telephone or online banking but some of the elderly or disabled might not have carers or family."
The nearest Barclays branches are at Market Place in Dewsbury, which is four-and-a-half miles away, or on the Headrow in Leeds, which is five miles away.
A 'reasons for closure' document has been posted on Barclays website for the Morley branch.
It states: "The number of counter transactions has gone down in the previous 24 months, and additionally 88 per cent of our branch customers also use other ways to do their banking such as online and by telephone
"Customers using other ways to do their banking has increased by 10 per cent since 2015.
"In the past 12 months, 18 per cent of this branch's customers have been using nearby branches.
"We’ve identified that only 163 customers use this branch exclusively for their banking."
Support the YEP and become a subscriber today. Enjoy unlimited access to local news and the latest on Leeds United. With a digital subscription, you see fewer ads, enjoy faster load times, and get access to exclusive newsletters and content. Click here to subscribe.