On Tuesday, the dollar plunged as much as 4% against the yen, its largest daily percentage fall since 1998.
The U.S. currency, however, rebounded on Wednesday, and was last up 0.4% at 132.28 yen.
Goldman assumed that, for now, the BOJ move was a technical adjustment and a "sign that policy rates could be adjusted further in coming month", although the basic BOJ framework remained unchanged.
This should drive dollar/yen higher over the coming months, Goldman noted.
For now, however, Goldman is closing its long dollar/yen position as the market is likely to price in a more meaningful BOJ policy change, which the U.S. investment bank said is a real possibility.