Hundreds of demonstrators surrounded a downtown Toronto bank on Thursday afternoon, chanting and banging on windows.

Protesters who identified with the Canadian Union of Postal Workers and the Occupy Toronto movement gathered outside the TD Canada Trust building near King and Bay Streets at about 2 p.m.

The postal worker's union said earlier that day that more than 600 of its members planned to march to the bustling intersection at 1 p.m.

Crowd members chanted "solidarity" as some pounded on the bank's glass windows. Five protesters appeared to be staging a sit-in inside the building.

"Our brothers are locked in there, so we're sitting out here," a demonstrator sitting in front of the bank told CP24.

According to CUPW's national president Denis Lemelin members of his union wanted to show their contempt for wealthy elite they believe undermines workers' rights.

It is unclear how many of the demonstrators crowding the TD Canada Trust building were with CUPW, which has taken up with the Occupy Toronto movement.

Police eventually moved the crowd away from the building and the five protesters exited the bank.

With files from The Canadian Press