I used to watch sports that weren't normally aired on TV outside of the Olympics, such as skateboarding, bobsled, etc. but stopped caring when I could no longer view all of the events for free* via the BBC. I'm not paying an arm and a leg to NBC or whoever has it in the US, especially when they don't even have coverage of everything anyway.
*By free, I mean it was just the cost of the TV license to have BBC in the first place; there wasn't an extra charge on top.
Even if I don't have time to watch any other thing in the Olympics, there's no way I would miss watching Simone Biles. The American gymnast is an incredible athlete. She gives me job whenever I watch her.
I used to watch the Olympics in the past until a couple of controverses started following the tournament. Since then, I have decided not to be watching the Olympics again.
I mostly watch the opening ceremony of the games (starting with the 2008 Olympics, that I still remember vividly), though usually I watch certain sports in them (for example, the freestyle snowboarding in the 2010 Olympics is one).