"We are facing the gravest humanitarian crisis in Europe since World War II," he said at the Munich Security Conference, which has been dominated by the Syrian conflict which is driving the mass flight.
"The United States understands the near existential nature of this threat to the politics and fabric of life in Europe," he told the meeting.
Europe has been deeply split by how to handle the mass influx of people fleeing war-torn Syria, Iraq, Afghanistan and other countries.
Sweden and Austria have also taken in large numbers, but many EU members, especially in the east, have been deeply reluctant to open their doors.
French Prime Minister Manuel Valls said today that the view in Paris is "not favourable" to Berlin's call for a permanent quota system to distribute more refugees across the EU, adding that France had already agreed to take in 30,000 refugees.
Kerry said about the refugee influx: "We are not saying, 'This is your problem, not ours'. This is our problem."
"And we will join you in other ways to stem this tide because of the potential of its damage to the fabric of a united Europe," said Kerry.
He praised German Chancellor Angela Merkel for showing "great courage in helping so many who need so much" and European communities who are taking in those fleeing the violence and "rejecting intolerance and racism" within their societies.
