Yes, collections should always be available to the public.
The challenge to strike a balance between making the material available to a wide audience while simultaneously respecting the wishes of the affected community is not easily decided. One option to consider is the common archival practice wherein materials are kept in closed stacks for a set amount of time before becoming available to the public at a later date.