But where does that money go? This infographic helps visualize where those funds go, as broken down by time worked per day to pay them and the actual value of those average daily taxes. Over half of the money we pay out goes to defense, social security and unemployment taxes, which is something everyone should be aware of, no matter what side of the political spectrum they happen to be on. Source – Visual.ly