You can kinda skip Big Hero 4, it's sort of a side plot from the main story. Big Hero 5 really picks up the story from where Big Hero 3 left off for the most part.
Actually lore-wise the world building really starts with steamboat willie. If you miss out on that the character progression and backstories are just gonna make no sense.