You're missing out a lot then. B5 is one of the best television series made, be it scifi or not. I would say just skip the first season completely and start from the second one, you're not gonna miss much.
I could see myself skipping the first season completely, but regardless of downvotes I will never endure an admittedly bad season just to get to the good stuff. That simply doesn't make any sense as long there are still other series out there that have tolerable first seasons.
The problem is that the first season is really good at setting up the universe an start the story. A lot of groundstones are layed there that you will definitely enjoy later on. Its just that some of the episodes feel like they were still trying to find their way of storytelling. And the production values suck, but hey - we still watch 1940s cinema today.
Also, it has some really outstanding episodes, e.g. the introduction of the agent of the enemy.
I would suggest skipping the first season, aside from the handful of episodes people named above, at least the first time you watch. Once you fall in love with the story, going back to some of the first season episodes is fun.
The pilot is particularly long and tedious, though. I often skip it even when I'm watching the entire rest of the show.
