Technically, an MP4 is a digital container file, which means it contains compressed video data and other associated data necessary for playing the video, but the MP4 is only a wrapper around the video, not the video itself. MP4 files are typically more compressed and thus smaller than other video file types.
TL;DR: MP4 can contain compressed assets (and usually does) but it doesn't have to