Wall Street keeps modest losses after Fed minutes