Sorry if this obvious, but are you perhaps looking at the raw values without converting them first?
Profile.xlsx in the SDK mentions scale 5, offset 500 for altitude in gps_metadata/160, so the real value should be something like: ENHANCED_ALTITUDE / 5 - 500. If you are using values in the csv generated by the sdk tool, those usually need further processing.
If it's due to outliers in the processed data, then I'm not sure. Perhaps, e.g. the barometer and/or gps are temporarily getting erratic readings somewhere?
EDIT: sorry, you mentioned "record", but the conversion is the same. Also, I believe altitude readings in general are somewhat tricky and not very exact (partly due to the model hinging on air pressure?), so it could simply be that if the values are in the correct magnitude, but still off.