It's that not black and white.
Here's just ONE example of a difference in experience that could lead to a person not voting.
This morning, I walked to my polling place from my apartment. It took me 10 minutes to walk there, it took me fifteen minutes to vote (short line to both vote and scan) and then I was already going in the right direction to get to work, on time. My employers, however, had sent an email saying that if we were late due to voting, that would be excused. My state does not have early voting, so unless you can vote absentee, you must go to the polls on Election Day to vote.
Compare that to someone with a polling place that is not convenient. They must travel out of the direction of their job to get to their polling place. Maybe they don't have a car, so they have to figure out how to get there as well. They then have to get to work from the polling place. Their polling place is crowded, and the scanners aren't working, so they are waiting for an hour, maybe two, to cast their vote. In the meantime, they are late for work, and unlike some places of employment, their boss is not going to be lenient about the delay.
These two situations are not anywhere NEAR the same. Do you think that people in Situation 1 have more of the right to cast their vote than people in Situation 2? It's not just "filling out a ballot." It should be! But it's not.