Short-range order and near-field effects on optical scattering and structural coloration