A Suffolk man who was punched in the face in a Bury St Edmunds pizza restaurant has denied that he was “aggressive by nature and quick to anger”.