One inch difference in diameter is not going to make much difference in how well the brakes ultimately work. If anything, you may have to press a little harder on the pedal to get the same braking effect as with the bigger booster, but using a slightly smaller booster won't cause anything to break or fall off.
Did you fit the original master cylinder on the replacement booster? If so, you may have to press the brake pedal a little harder to get the same braking effect as with the larger booster, but if you don't want to do that, you can fit a master cylinder with a slightly smaller bore than the original to keep the ratio between booster and master cylinder bore the same as the old setup.
However, if the brakes work fine and you are happy about how the pedal feels, or how well the brakes work, you are good to go, and you don't have to modify anything else.