Both Goldman and Fitch did not specify which small lenders were most vulnerable.
The total exposure of the U.S. banking system to CRE loans was $2.5 trillion at the end of December, Fitch said.
HEADWINDSThe CRE market faces headwinds that could hobble small banks.
Rising interest rates have also depressed demand for CRE loans, while weighing on real estate investment trusts (REITs).
Goldman's Viswanathan cited several indicators that reflected a weakening market for office real estate: declining occupancy rates, falling appraisal values and rising defaults.